Jul 08 23:05:19.439336 ip-10-0-133-37 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 08 23:05:19.439349 ip-10-0-133-37 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 08 23:05:19.439359 ip-10-0-133-37 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 08 23:05:19.439705 ip-10-0-133-37 systemd[1]: Failed to start Kubernetes Kubelet. Jul 08 23:05:29.441369 ip-10-0-133-37 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 08 23:05:29.441404 ip-10-0-133-37 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 9a43d901d1c3404bb63ab4f2195ff4dc -- Jul 08 23:07:22.599238 ip-10-0-133-37 systemd[1]: Starting Kubernetes Kubelet... Jul 08 23:07:24.179557 ip-10-0-133-37 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 23:07:24.179557 ip-10-0-133-37 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 23:07:24.179557 ip-10-0-133-37 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 23:07:24.179557 ip-10-0-133-37 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 23:07:24.179557 ip-10-0-133-37 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 23:07:24.179557 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.966345 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 23:07:24.179557 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974108 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 08 23:07:24.179557 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974121 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 23:07:24.179557 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974125 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 23:07:24.179557 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974129 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 23:07:24.179557 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974132 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 23:07:24.179557 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974135 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 23:07:24.179557 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974137 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 23:07:24.179557 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974140 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 23:07:23.043619 ip-10-0-133-37 systemd[1]: Started Kubernetes Kubelet. Jul 08 23:07:24.181963 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974143 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 23:07:24.181963 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974145 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 23:07:24.181963 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974148 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 23:07:24.181963 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974151 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 23:07:24.181963 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974153 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 23:07:24.181963 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974156 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 23:07:24.181963 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974158 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 23:07:24.181963 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974161 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 23:07:24.181963 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974163 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 23:07:24.181963 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974166 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 23:07:24.181963 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974168 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 23:07:24.181963 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974171 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 23:07:24.181963 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974173 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 23:07:24.181963 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974175 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 23:07:24.181963 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974178 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 23:07:24.181963 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974181 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 23:07:24.181963 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974184 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 23:07:24.181963 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974186 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 23:07:24.181963 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974189 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 23:07:24.181963 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974191 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 23:07:24.183161 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974194 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 23:07:24.183161 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974198 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 23:07:24.183161 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974202 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 23:07:24.183161 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974213 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 23:07:24.183161 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974216 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 23:07:24.183161 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974219 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 23:07:24.183161 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974222 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 23:07:24.183161 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974224 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 23:07:24.183161 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974227 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 23:07:24.183161 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974230 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 23:07:24.183161 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974233 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 23:07:24.183161 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974235 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 23:07:24.183161 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974238 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 23:07:24.183161 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974240 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 23:07:24.183161 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974243 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 23:07:24.183161 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974246 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 23:07:24.183161 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974248 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 23:07:24.183161 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974251 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 23:07:24.183161 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974254 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 23:07:24.186749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974257 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 23:07:24.186749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974261 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 23:07:24.186749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974264 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 23:07:24.186749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974267 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 23:07:24.186749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974270 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 23:07:24.186749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974274 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 23:07:24.186749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974276 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 23:07:24.186749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974279 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 23:07:24.186749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974282 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 23:07:24.186749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974285 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 23:07:24.186749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974287 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 23:07:24.186749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974290 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 23:07:24.186749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974293 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 23:07:24.186749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974297 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 23:07:24.186749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974299 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 23:07:24.186749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974302 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 23:07:24.186749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974305 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 23:07:24.186749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974308 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 23:07:24.186749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974310 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 23:07:24.187483 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974313 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 23:07:24.187483 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974316 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 23:07:24.187483 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974318 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 23:07:24.187483 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974321 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 23:07:24.187483 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974323 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 23:07:24.187483 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974326 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 23:07:24.187483 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974328 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 23:07:24.187483 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974331 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 23:07:24.187483 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974333 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 23:07:24.187483 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974336 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 23:07:24.187483 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974338 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 23:07:24.187483 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974340 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 23:07:24.187483 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974343 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 23:07:24.187483 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974346 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 23:07:24.187483 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974348 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 23:07:24.187483 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974351 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 23:07:24.187483 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974353 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 23:07:24.187483 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974356 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 23:07:24.187483 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974359 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 23:07:24.187483 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974362 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 23:07:24.188792 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974365 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 23:07:24.188792 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974367 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 23:07:24.188792 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974371 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 23:07:24.188792 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974374 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 23:07:24.188792 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974376 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 23:07:24.188792 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974379 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 23:07:24.188792 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974381 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 23:07:24.188792 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974384 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 23:07:24.188792 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974388 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 23:07:24.188792 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974391 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 23:07:24.188792 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974394 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 23:07:24.188792 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974397 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 23:07:24.188792 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.974400 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 23:07:24.188792 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975115 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 23:07:24.188792 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975122 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 23:07:24.188792 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975126 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 23:07:24.188792 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975130 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 23:07:24.188792 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975133 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 23:07:24.188792 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975136 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 23:07:24.188792 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975139 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 23:07:24.189455 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975142 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 23:07:24.189455 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975145 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 23:07:24.189455 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975147 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 23:07:24.189455 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975150 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 23:07:24.189455 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975152 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 23:07:24.189455 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975155 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 23:07:24.189455 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975158 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 23:07:24.189455 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975160 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 23:07:24.189455 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975163 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 23:07:24.189455 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975167 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 23:07:24.189455 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975170 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 23:07:24.189455 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975173 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 23:07:24.189455 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975175 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 23:07:24.189455 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975178 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 23:07:24.189455 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975180 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 23:07:24.189455 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975183 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 23:07:24.189455 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975186 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 23:07:24.189455 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975188 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 08 23:07:24.189455 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975191 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 23:07:24.189455 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975194 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 23:07:24.190749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975196 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 23:07:24.190749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975199 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 23:07:24.190749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975201 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 23:07:24.190749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975204 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 23:07:24.190749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975206 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 23:07:24.190749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975209 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 23:07:24.190749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975212 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 23:07:24.190749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975214 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 23:07:24.190749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975217 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 23:07:24.190749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975221 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 23:07:24.190749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975224 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 23:07:24.190749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975228 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 23:07:24.190749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975230 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 23:07:24.190749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975233 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 23:07:24.190749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975236 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 23:07:24.190749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975239 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 23:07:24.190749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975241 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 23:07:24.190749 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975244 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 23:07:24.191381 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975247 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 23:07:24.191381 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975252 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 23:07:24.191381 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975255 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 23:07:24.191381 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975257 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 23:07:24.191381 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975260 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 23:07:24.191381 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975263 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 23:07:24.191381 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975265 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 23:07:24.191381 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975268 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 23:07:24.191381 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975270 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 23:07:24.191381 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975273 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 23:07:24.191381 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975275 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 23:07:24.191381 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975277 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 23:07:24.191381 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975280 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 23:07:24.191381 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975283 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 23:07:24.191381 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975285 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 23:07:24.191381 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975288 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 23:07:24.191381 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975291 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 23:07:24.191381 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975293 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 23:07:24.191381 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975296 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 23:07:24.191381 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975298 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 23:07:24.193171 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975301 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 23:07:24.193171 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975304 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 23:07:24.193171 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975308 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 23:07:24.193171 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975311 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 23:07:24.193171 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975313 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 23:07:24.193171 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975316 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 23:07:24.193171 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975318 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 23:07:24.193171 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975322 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 23:07:24.193171 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975324 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 23:07:24.193171 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975327 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 23:07:24.193171 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975329 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 23:07:24.193171 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975331 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 23:07:24.193171 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975334 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 23:07:24.193171 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975338 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 23:07:24.193171 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975340 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 23:07:24.193171 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975343 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 23:07:24.193171 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975345 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 23:07:24.193171 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975348 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 23:07:24.193171 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975350 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 23:07:24.193171 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975353 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 23:07:24.193764 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975355 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 23:07:24.193764 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975358 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 23:07:24.193764 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975360 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 23:07:24.193764 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975363 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 23:07:24.193764 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975367 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 23:07:24.193764 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975370 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 23:07:24.193764 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975372 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 23:07:24.193764 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975375 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 23:07:24.193764 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975377 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 23:07:24.193764 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975380 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 23:07:24.193764 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975382 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 23:07:24.193764 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975386 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 23:07:24.193764 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975389 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 23:07:24.193764 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975392 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 23:07:24.193764 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975795 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 23:07:24.193764 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975803 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 23:07:24.193764 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975807 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 23:07:24.193764 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975809 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 23:07:24.193764 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975813 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 23:07:24.193764 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975815 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 23:07:24.194804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975818 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 23:07:24.194804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975821 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 23:07:24.194804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975824 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 23:07:24.194804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975827 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 23:07:24.194804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975831 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 23:07:24.194804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975835 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 23:07:24.194804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975838 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 23:07:24.194804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975841 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 23:07:24.194804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975844 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 23:07:24.194804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975847 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 23:07:24.194804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975850 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 08 23:07:24.194804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975853 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 23:07:24.194804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975856 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 23:07:24.194804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975859 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 23:07:24.194804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975861 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 23:07:24.194804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975864 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 23:07:24.194804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975867 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 23:07:24.194804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975869 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 23:07:24.194804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975872 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 23:07:24.194804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975874 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 23:07:24.195776 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975877 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 23:07:24.195776 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975879 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 23:07:24.195776 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975883 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 23:07:24.195776 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975885 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 23:07:24.195776 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975889 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 23:07:24.195776 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975892 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 23:07:24.195776 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975896 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 23:07:24.195776 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975899 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 23:07:24.195776 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975901 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 23:07:24.195776 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975904 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 23:07:24.195776 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975907 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 23:07:24.195776 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975910 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 23:07:24.195776 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975912 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 23:07:24.195776 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975915 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 23:07:24.195776 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975917 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 23:07:24.195776 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975920 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 23:07:24.195776 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975923 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 23:07:24.195776 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975925 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 23:07:24.196992 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975928 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 23:07:24.196992 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975930 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 23:07:24.196992 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975932 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 23:07:24.196992 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975935 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 23:07:24.196992 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975937 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 23:07:24.196992 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975940 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 23:07:24.196992 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975943 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 23:07:24.196992 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975946 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 23:07:24.196992 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975948 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 23:07:24.196992 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975950 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 23:07:24.196992 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975953 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 23:07:24.196992 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975955 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 23:07:24.196992 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975958 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 23:07:24.196992 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975960 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 23:07:24.196992 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975962 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 23:07:24.196992 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975965 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 23:07:24.196992 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975968 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 23:07:24.196992 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975971 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 23:07:24.196992 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975973 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 23:07:24.196992 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975976 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 23:07:24.363362 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975979 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 23:07:24.363362 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975983 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 23:07:24.363362 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975986 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 23:07:24.363362 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975988 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 23:07:24.363362 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975990 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 23:07:24.363362 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975993 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 23:07:24.363362 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975995 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 23:07:24.363362 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.975998 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 23:07:24.363362 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.976014 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 23:07:24.363362 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.976018 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 23:07:24.363362 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.976022 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 23:07:24.363362 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.976025 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 23:07:24.363362 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.976028 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 23:07:24.363362 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.976032 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 23:07:24.363362 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.976036 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 23:07:24.363362 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.976040 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 23:07:24.363362 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.976044 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 23:07:24.363362 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.976047 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 23:07:24.363362 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.976051 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 23:07:24.363362 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.976053 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 23:07:24.385720 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.976057 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 23:07:24.385720 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.976061 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 23:07:24.385720 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.976065 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 23:07:24.385720 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.976070 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 23:07:24.385720 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.976075 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 23:07:24.385720 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.976077 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 23:07:24.385720 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.976080 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 23:07:24.385720 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.976084 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 23:07:24.385720 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.976091 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 23:07:24.385720 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.976095 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 23:07:24.385720 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.976099 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 23:07:24.385720 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.976103 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 23:07:24.385720 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.976106 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 23:07:24.385720 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.976110 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 23:07:24.385720 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.976114 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 23:07:24.385720 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976205 2572 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 23:07:24.385720 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976225 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 23:07:24.385720 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976234 2572 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 23:07:24.385720 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976240 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 23:07:24.385720 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976246 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 23:07:24.386469 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976251 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 23:07:24.386469 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976257 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 23:07:24.386469 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976262 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 23:07:24.386469 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976267 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 23:07:24.386469 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976272 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 23:07:24.386469 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976277 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 23:07:24.386469 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976282 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 23:07:24.386469 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976286 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 23:07:24.386469 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976289 2572 flags.go:64] FLAG: --cgroup-root="" Jul 08 23:07:24.386469 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976292 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 23:07:24.386469 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976297 2572 flags.go:64] FLAG: --client-ca-file="" Jul 08 23:07:24.386469 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976301 2572 flags.go:64] FLAG: --cloud-provider="external" Jul 08 23:07:24.386469 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976306 2572 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 23:07:24.386469 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976312 2572 flags.go:64] FLAG: --cluster-domain="" Jul 08 23:07:24.386469 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976315 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 23:07:24.386469 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976320 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 23:07:24.386469 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976324 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 23:07:24.386469 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976329 2572 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 23:07:24.386469 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976334 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 23:07:24.386469 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976338 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 23:07:24.386469 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976350 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 23:07:24.386469 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976355 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 23:07:24.386469 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976360 2572 flags.go:64] FLAG: --contention-profiling="false" Jul 08 23:07:24.386469 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976364 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 23:07:24.389124 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976368 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 23:07:24.389124 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976373 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 23:07:24.389124 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976377 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 23:07:24.389124 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976384 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 23:07:24.389124 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976388 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 23:07:24.389124 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976392 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 23:07:24.389124 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976396 2572 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 23:07:24.389124 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976400 2572 flags.go:64] FLAG: --enable-server="true" Jul 08 23:07:24.389124 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976404 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 23:07:24.389124 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976411 2572 flags.go:64] FLAG: --event-burst="100" Jul 08 23:07:24.389124 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976415 2572 flags.go:64] FLAG: --event-qps="50" Jul 08 23:07:24.389124 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976419 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 23:07:24.389124 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976423 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 23:07:24.389124 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976427 2572 flags.go:64] FLAG: --eviction-hard="" Jul 08 23:07:24.389124 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976433 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 23:07:24.389124 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976437 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 23:07:24.389124 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976441 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 23:07:24.389124 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976446 2572 flags.go:64] FLAG: --eviction-soft="" Jul 08 23:07:24.389124 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976450 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 23:07:24.389124 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976455 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 23:07:24.389124 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976460 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 23:07:24.389124 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976464 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 23:07:24.389124 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976468 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 23:07:24.389124 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976473 2572 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 23:07:24.389124 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976477 2572 flags.go:64] FLAG: --feature-gates="" Jul 08 23:07:24.390130 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976482 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 23:07:24.390130 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976486 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 23:07:24.390130 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976490 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 23:07:24.390130 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976497 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 23:07:24.390130 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976500 2572 flags.go:64] FLAG: --healthz-port="10248" Jul 08 23:07:24.390130 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976503 2572 flags.go:64] FLAG: --help="false" Jul 08 23:07:24.390130 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976507 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-133-37.ec2.internal" Jul 08 23:07:24.390130 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976512 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 23:07:24.390130 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976516 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 23:07:24.390130 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976521 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 23:07:24.390130 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976525 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 23:07:24.390130 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976531 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 23:07:24.390130 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976535 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 23:07:24.390130 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976539 2572 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 23:07:24.390130 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976543 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 23:07:24.390130 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976547 2572 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 23:07:24.390130 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976551 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 23:07:24.390130 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976556 2572 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 23:07:24.390130 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976560 2572 flags.go:64] FLAG: --kube-reserved="" Jul 08 23:07:24.390130 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976564 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 23:07:24.390130 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976568 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 23:07:24.390130 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976572 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 23:07:24.390130 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976576 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 23:07:24.390130 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976580 2572 flags.go:64] FLAG: --lock-file="" Jul 08 23:07:24.391515 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976584 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 23:07:24.391515 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976588 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 23:07:24.391515 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976592 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 23:07:24.391515 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976600 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 23:07:24.391515 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976606 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 23:07:24.391515 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976610 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 23:07:24.391515 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976614 2572 flags.go:64] FLAG: --logging-format="text" Jul 08 23:07:24.391515 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976618 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 23:07:24.391515 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976623 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 23:07:24.391515 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976627 2572 flags.go:64] FLAG: --manifest-url="" Jul 08 23:07:24.391515 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976631 2572 flags.go:64] FLAG: --manifest-url-header="" Jul 08 23:07:24.391515 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976640 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 23:07:24.391515 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976644 2572 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 23:07:24.391515 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976649 2572 flags.go:64] FLAG: --max-pods="110" Jul 08 23:07:24.391515 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976654 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 23:07:24.391515 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976657 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 23:07:24.391515 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976662 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 23:07:24.391515 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976666 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 23:07:24.391515 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976670 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 23:07:24.391515 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976674 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 23:07:24.391515 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976679 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 23:07:24.391515 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976688 2572 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 23:07:24.391515 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976692 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 23:07:24.391515 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976696 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 23:07:24.391515 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976701 2572 flags.go:64] FLAG: --pod-cidr="" Jul 08 23:07:24.392244 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976705 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 23:07:24.392244 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976727 2572 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 23:07:24.392244 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976732 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 23:07:24.392244 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976737 2572 flags.go:64] FLAG: --pods-per-core="0" Jul 08 23:07:24.392244 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976741 2572 flags.go:64] FLAG: --port="10250" Jul 08 23:07:24.392244 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976745 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 23:07:24.392244 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976749 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b4a9e0abcd0adfb5" Jul 08 23:07:24.392244 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976754 2572 flags.go:64] FLAG: --qos-reserved="" Jul 08 23:07:24.392244 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976758 2572 flags.go:64] FLAG: --read-only-port="10255" Jul 08 23:07:24.392244 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976762 2572 flags.go:64] FLAG: --register-node="true" Jul 08 23:07:24.392244 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976767 2572 flags.go:64] FLAG: --register-with-taints="" Jul 08 23:07:24.392244 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976771 2572 flags.go:64] FLAG: --registry-burst="10" Jul 08 23:07:24.392244 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976776 2572 flags.go:64] FLAG: --registry-qps="5" Jul 08 23:07:24.392244 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976780 2572 flags.go:64] FLAG: --reserved-cpus="" Jul 08 23:07:24.392244 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976783 2572 flags.go:64] FLAG: --reserved-memory="" Jul 08 23:07:24.392244 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976789 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 23:07:24.392244 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976793 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 23:07:24.392244 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976798 2572 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 23:07:24.392244 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976803 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 23:07:24.392244 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976809 2572 flags.go:64] FLAG: --runonce="false" Jul 08 23:07:24.392244 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976813 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 23:07:24.392244 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976818 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 23:07:24.392244 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976822 2572 flags.go:64] FLAG: --seccomp-default="false" Jul 08 23:07:24.392244 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976826 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 23:07:24.392244 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976830 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 23:07:24.393118 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976834 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 23:07:24.393118 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976839 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 23:07:24.393118 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976843 2572 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 23:07:24.393118 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976847 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 23:07:24.393118 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976851 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 23:07:24.393118 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976855 2572 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 23:07:24.393118 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976860 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 23:07:24.393118 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976864 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 23:07:24.393118 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976869 2572 flags.go:64] FLAG: --system-cgroups="" Jul 08 23:07:24.393118 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976872 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 23:07:24.393118 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976881 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 23:07:24.393118 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976885 2572 flags.go:64] FLAG: --tls-cert-file="" Jul 08 23:07:24.393118 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976889 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 23:07:24.393118 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976895 2572 flags.go:64] FLAG: --tls-min-version="" Jul 08 23:07:24.393118 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976899 2572 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 23:07:24.393118 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976902 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 23:07:24.393118 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976906 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 23:07:24.393118 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976911 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 23:07:24.393118 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976915 2572 flags.go:64] FLAG: --v="2" Jul 08 23:07:24.393118 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976922 2572 flags.go:64] FLAG: --version="false" Jul 08 23:07:24.393118 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976928 2572 flags.go:64] FLAG: --vmodule="" Jul 08 23:07:24.393118 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976933 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 23:07:24.393118 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.976938 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 23:07:24.393118 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977092 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 23:07:24.393789 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977097 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 23:07:24.393789 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977103 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 23:07:24.393789 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977108 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 23:07:24.393789 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977113 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 23:07:24.393789 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977116 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 23:07:24.393789 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977120 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 23:07:24.393789 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977124 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 23:07:24.393789 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977128 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 23:07:24.393789 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977130 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 23:07:24.393789 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977133 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 23:07:24.393789 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977137 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 23:07:24.393789 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977141 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 23:07:24.393789 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977144 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 23:07:24.393789 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977149 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 23:07:24.393789 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977152 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 23:07:24.393789 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977156 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 23:07:24.393789 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977160 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 23:07:24.393789 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977164 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 23:07:24.393789 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977167 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 23:07:24.394683 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977171 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 23:07:24.394683 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977176 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 23:07:24.394683 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977179 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 23:07:24.394683 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977183 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 23:07:24.394683 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977187 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 23:07:24.394683 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977190 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 23:07:24.394683 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977193 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 23:07:24.394683 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977197 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 23:07:24.394683 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977200 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 23:07:24.394683 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977204 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 23:07:24.394683 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977209 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 23:07:24.394683 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977212 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 23:07:24.394683 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977216 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 23:07:24.394683 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977219 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 23:07:24.394683 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977225 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 23:07:24.394683 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977230 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 23:07:24.394683 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977233 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 23:07:24.394683 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977237 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 08 23:07:24.394683 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977240 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 23:07:24.394683 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977244 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 23:07:24.395297 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977248 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 23:07:24.395297 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977251 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 23:07:24.395297 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977255 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 23:07:24.395297 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977258 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 23:07:24.395297 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977262 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 23:07:24.395297 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977265 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 23:07:24.395297 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977270 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 23:07:24.395297 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977274 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 23:07:24.395297 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977277 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 23:07:24.395297 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977281 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 23:07:24.395297 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977287 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 23:07:24.395297 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977292 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 23:07:24.395297 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977296 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 23:07:24.395297 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977302 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 23:07:24.395297 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977307 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 23:07:24.395297 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977310 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 23:07:24.395297 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977314 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 23:07:24.395297 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977319 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 23:07:24.395297 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977323 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 23:07:24.396081 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977327 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 23:07:24.396081 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977331 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 23:07:24.396081 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977336 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 23:07:24.396081 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977339 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 23:07:24.396081 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977342 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 23:07:24.396081 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977344 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 23:07:24.396081 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977348 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 23:07:24.396081 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977353 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 23:07:24.396081 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977359 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 23:07:24.396081 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977363 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 23:07:24.396081 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977366 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 23:07:24.396081 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977370 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 23:07:24.396081 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977374 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 23:07:24.396081 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977378 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 23:07:24.396081 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977382 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 23:07:24.396081 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977385 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 23:07:24.396081 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977388 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 23:07:24.396081 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977393 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 23:07:24.396081 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977397 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 23:07:24.396081 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977401 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 23:07:24.396656 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977404 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 23:07:24.396656 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977408 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 23:07:24.396656 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977412 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 23:07:24.396656 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977418 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 23:07:24.396656 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977423 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 23:07:24.396656 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977427 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 23:07:24.396656 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977431 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 23:07:24.396656 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977435 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 23:07:24.396656 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977439 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 23:07:24.396656 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977443 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 23:07:24.396656 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977447 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 23:07:24.396656 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977451 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 23:07:24.396656 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977455 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 23:07:24.396656 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977459 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 23:07:24.396656 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977463 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 23:07:24.396656 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977467 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 23:07:24.396656 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977471 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 23:07:24.396656 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977476 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 23:07:24.396656 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977480 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 23:07:24.586507 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.977486 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 23:07:24.586507 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.977496 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 23:07:24.586507 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.987229 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 23:07:24.586507 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.987244 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 23:07:24.586507 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.987943 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 23:07:24.586507 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.987954 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 23:07:24.586507 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988016 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 23:07:24.586507 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988022 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 23:07:24.586507 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988025 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 23:07:24.586507 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988028 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 23:07:24.586507 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988031 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 23:07:24.586507 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988034 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 23:07:24.586507 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988037 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 23:07:24.586507 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988040 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 23:07:24.587153 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988043 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 23:07:24.587153 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988046 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 23:07:24.587153 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988049 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 23:07:24.587153 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988051 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 23:07:24.587153 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988054 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 23:07:24.587153 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988056 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 23:07:24.587153 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988059 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 23:07:24.587153 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988061 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 23:07:24.587153 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988064 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 23:07:24.587153 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988066 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 23:07:24.587153 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988069 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 23:07:24.587153 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988071 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 23:07:24.587153 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988077 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 23:07:24.587153 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988079 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 23:07:24.587153 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988082 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 23:07:24.587153 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988084 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 23:07:24.587153 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988087 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 23:07:24.587153 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988089 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 23:07:24.587153 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988092 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 23:07:24.587153 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988095 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 23:07:24.587995 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988098 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 23:07:24.587995 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988102 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 23:07:24.587995 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988104 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 23:07:24.587995 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988107 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 23:07:24.587995 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988109 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 23:07:24.587995 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988112 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 23:07:24.587995 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988114 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 23:07:24.587995 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988116 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 23:07:24.587995 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988119 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 23:07:24.587995 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988121 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 23:07:24.587995 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988124 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 23:07:24.587995 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988128 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 23:07:24.587995 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988132 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 23:07:24.587995 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988135 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 23:07:24.587995 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988137 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 23:07:24.587995 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988140 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 23:07:24.587995 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988143 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 23:07:24.587995 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988145 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 23:07:24.587995 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988148 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 23:07:24.588540 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988151 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 23:07:24.588540 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988154 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 23:07:24.588540 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988156 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 23:07:24.588540 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988158 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 23:07:24.588540 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988161 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 23:07:24.588540 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988164 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 23:07:24.588540 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988166 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 23:07:24.588540 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988169 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 23:07:24.588540 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988171 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 23:07:24.588540 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988175 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 23:07:24.588540 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988179 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 23:07:24.588540 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988182 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 23:07:24.588540 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988188 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 23:07:24.588540 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988191 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 23:07:24.588540 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988193 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 23:07:24.588540 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988196 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 23:07:24.588540 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988199 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 23:07:24.588540 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988201 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 23:07:24.588540 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988204 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 23:07:24.589372 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988206 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 23:07:24.589372 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988209 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 23:07:24.589372 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988211 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 23:07:24.589372 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988214 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 23:07:24.589372 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988216 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 23:07:24.589372 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988219 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 23:07:24.589372 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988223 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 23:07:24.589372 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988226 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 23:07:24.589372 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988229 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 23:07:24.589372 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988232 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 23:07:24.589372 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988235 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 23:07:24.589372 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988237 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 23:07:24.589372 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988240 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 23:07:24.589372 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988243 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 23:07:24.589372 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988245 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 23:07:24.589372 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988248 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 23:07:24.589372 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988250 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 23:07:24.589372 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988253 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 23:07:24.589372 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988256 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 23:07:24.589921 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988258 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 23:07:24.589921 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988261 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 08 23:07:24.589921 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988263 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 23:07:24.589921 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988266 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 23:07:24.589921 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988268 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 23:07:24.589921 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988271 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 23:07:24.589921 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988276 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 23:07:24.589921 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988278 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 23:07:24.589921 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988281 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 23:07:24.589921 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988284 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 23:07:24.589921 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988287 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 23:07:24.589921 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988289 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 23:07:24.589921 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988292 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 23:07:24.589921 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988294 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 23:07:24.589921 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.988299 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 23:07:24.590668 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988421 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 23:07:24.590668 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988426 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 23:07:24.590668 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988429 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 23:07:24.590668 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988432 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 23:07:24.590668 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988435 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 23:07:24.590668 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988437 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 23:07:24.590668 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988440 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 23:07:24.590668 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988442 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 23:07:24.590668 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988445 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 23:07:24.590668 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988448 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 23:07:24.590668 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988452 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 23:07:24.590668 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988456 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 23:07:24.590668 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988459 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 23:07:24.590668 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988461 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 23:07:24.590668 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988464 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 23:07:24.590668 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988466 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 23:07:24.590668 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988469 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 23:07:24.590668 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988473 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 23:07:24.590668 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988476 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 23:07:24.591234 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988479 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 23:07:24.591234 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988482 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 23:07:24.591234 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988485 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 23:07:24.591234 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988488 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 23:07:24.591234 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988492 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 23:07:24.591234 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988496 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 23:07:24.591234 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988498 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 23:07:24.591234 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988501 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 23:07:24.591234 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988503 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 23:07:24.591234 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988506 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 23:07:24.591234 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988509 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 23:07:24.591234 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988512 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 23:07:24.591234 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988514 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 23:07:24.591234 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988517 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 23:07:24.591234 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988519 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 23:07:24.591234 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988522 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 23:07:24.591234 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988525 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 23:07:24.591234 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988527 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 23:07:24.591234 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988529 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 23:07:24.591234 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988532 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 23:07:24.591804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988534 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 23:07:24.591804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988537 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 23:07:24.591804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988539 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 23:07:24.591804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988542 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 23:07:24.591804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988545 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 23:07:24.591804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988548 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 23:07:24.591804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988551 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 23:07:24.591804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988554 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 23:07:24.591804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988557 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 23:07:24.591804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988560 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 23:07:24.591804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988562 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 23:07:24.591804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988565 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 23:07:24.591804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988567 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 23:07:24.591804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988570 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 23:07:24.591804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988572 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 23:07:24.591804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988575 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 23:07:24.591804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988578 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 23:07:24.591804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988582 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 23:07:24.591804 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988585 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 23:07:24.592616 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988587 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 23:07:24.592616 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988590 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 23:07:24.592616 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988592 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 23:07:24.592616 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988596 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 08 23:07:24.592616 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988599 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 23:07:24.592616 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988601 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 23:07:24.592616 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988604 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 23:07:24.592616 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988606 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 23:07:24.592616 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988609 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 23:07:24.592616 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988611 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 23:07:24.592616 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988614 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 23:07:24.592616 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988616 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 23:07:24.592616 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988619 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 23:07:24.592616 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988621 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 23:07:24.592616 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988624 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 23:07:24.592616 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988626 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 23:07:24.592616 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988628 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 23:07:24.592616 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988631 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 23:07:24.592616 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988633 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 23:07:24.592616 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988636 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 23:07:24.593198 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988638 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 23:07:24.593198 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988641 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 23:07:24.593198 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988643 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 23:07:24.593198 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988645 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 23:07:24.593198 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988648 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 23:07:24.593198 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988650 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 23:07:24.593198 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988653 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 23:07:24.593198 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988655 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 23:07:24.593198 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988658 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 23:07:24.593198 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988662 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 23:07:24.593198 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988666 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 23:07:24.593198 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988669 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 23:07:24.593198 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988672 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 23:07:24.593198 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988674 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 23:07:24.593198 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988677 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 23:07:24.593198 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988680 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 23:07:24.593198 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988683 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 23:07:24.593198 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988685 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 23:07:24.593198 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988688 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 23:07:24.593198 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988690 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 23:07:24.593748 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:22.988693 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 23:07:24.593748 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.988697 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 23:07:24.593748 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.988804 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 23:07:24.593748 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.990899 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 23:07:24.593748 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.992145 2572 server.go:1019] "Starting client certificate rotation" Jul 08 23:07:24.593748 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.994958 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 23:07:24.593748 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.997454 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 23:07:24.593748 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.997478 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 23:07:24.593748 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:22.997763 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 23:07:24.593748 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.006647 2572 log.go:25] "Validated CRI v1 runtime API" Jul 08 23:07:24.593748 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.008834 2572 log.go:25] "Validated CRI v1 image API" Jul 08 23:07:24.593748 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.009548 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 23:07:24.780364 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.015639 2572 fs.go:135] Filesystem UUIDs: map[0bd6caff-6bc1-491b-84d1-c77c0c6d85a2:/dev/nvme0n1p3 1a347900-efa1-43de-95ee-0c64f6bffa70:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 08 23:07:24.780364 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.015653 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 23:07:24.783203 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.021852 2572 manager.go:216] Machine: {Timestamp:2026-07-08 23:07:23.020638025 +0000 UTC m=+0.295105442 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3042329 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec262fe9eea6389f90ac489f8aa047c3 SystemUUID:ec262fe9-eea6-389f-90ac-489f8aa047c3 BootID:9a43d901-d1c3-404b-b63a-b4f2195ff4dc Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cc:ef:83:cf:9d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cc:ef:83:cf:9d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:0e:ce:61:84:11 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 23:07:24.783203 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.021954 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 23:07:24.783203 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.022027 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 23:07:24.783203 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.024751 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 23:07:24.783203 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.024773 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-37.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 23:07:24.783203 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.025945 2572 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 23:07:24.783203 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.025958 2572 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 23:07:24.783203 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.025971 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 23:07:24.783203 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.026518 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 23:07:24.783203 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.026956 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 23:07:24.783203 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.027831 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 23:07:24.783203 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.032451 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 08 23:07:24.783203 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.032600 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 23:07:24.783203 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.032629 2572 kubelet.go:486] "Attempting to sync node with API server" Jul 08 23:07:24.783203 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.032644 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 23:07:24.783203 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.032655 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 23:07:24.783203 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.032669 2572 kubelet.go:398] "Adding apiserver pod source" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.032678 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.033017 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.033034 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.035567 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.037529 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.037556 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.038652 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.038666 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.038672 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.038678 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.038686 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.038692 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.038700 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.038705 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.038728 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.038733 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.038752 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.038757 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.039410 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.039426 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.042789 2572 server.go:1268] "Started kubelet" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.042937 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.042997 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:23.043013 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.161267 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:24.161866 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-37.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:24.161963 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.162387 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-37.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.163497 2572 server.go:310] "Adding debug handlers to kubelet server" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:24.165676 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:24.165102 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-37.ec2.internal.18c073222bfab7cc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-37.ec2.internal,UID:ip-10-0-133-37.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-37.ec2.internal,},FirstTimestamp:2026-07-08 23:07:23.04265006 +0000 UTC m=+0.317117475,LastTimestamp:2026-07-08 23:07:23.04265006 +0000 UTC m=+0.317117475,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-37.ec2.internal,}" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.169453 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.169465 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:24.169530 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-37.ec2.internal\" not found" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.170024 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.170055 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.170024 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.170194 2572 reconstruct.go:97] "Volume reconstruction finished" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.170202 2572 reconciler.go:29] "Reconciler: start to sync state" Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.170234 2572 factory.go:55] Registering systemd factory Jul 08 23:07:24.783741 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.170249 2572 factory.go:223] Registration of the systemd container factory successfully Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.170526 2572 factory.go:153] Registering CRI-O factory Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.170541 2572 factory.go:223] Registration of the crio container factory successfully Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.170589 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.170607 2572 factory.go:103] Registering Raw factory Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.170617 2572 manager.go:1196] Started watching for new ooms in manager Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.171148 2572 manager.go:349] Starting recovery of all containers Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.178219 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.182142 2572 manager.go:354] Recovery completed Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:24.186322 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:24.186336 2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-37.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.187730 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.191766 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jxcvr" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.193841 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-37.ec2.internal" event="NodeHasSufficientMemory" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.193866 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.193876 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-37.ec2.internal" event="NodeHasSufficientPID" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.194708 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.194722 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.194732 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.194766 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.195696 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-37.ec2.internal" event="NodeHasSufficientMemory" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.195731 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.195747 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-37.ec2.internal" event="NodeHasSufficientPID" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.197743 2572 policy_none.go:49] "None policy: Start" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.197761 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.197775 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.199248 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jxcvr" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.200668 2572 policy_none.go:47] "Start" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.245434 2572 manager.go:337] "Starting Device Plugin manager" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:24.245567 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.245578 2572 server.go:87] "Starting device plugin registration server" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.245772 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.245782 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.245889 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.245994 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.246003 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:24.246362 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:24.246404 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-37.ec2.internal\" not found" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.323557 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.323591 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.323611 2572 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:24.323639 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.326364 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.346488 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.347262 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-37.ec2.internal" event="NodeHasSufficientMemory" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.347283 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 23:07:24.785104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.347294 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-37.ec2.internal" event="NodeHasSufficientPID" Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.347314 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-37.ec2.internal" Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.358957 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-37.ec2.internal" Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:24.358974 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-37.ec2.internal\": node \"ip-10-0-133-37.ec2.internal\" not found" Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:24.381383 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-37.ec2.internal\" not found" Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.424620 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-37.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-37.ec2.internal"] Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.424685 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.426309 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-37.ec2.internal" event="NodeHasSufficientMemory" Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.426335 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.426345 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-37.ec2.internal" event="NodeHasSufficientPID" Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.428557 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.428670 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-37.ec2.internal" Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.428695 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.429275 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-37.ec2.internal" event="NodeHasSufficientMemory" Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.429284 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-37.ec2.internal" event="NodeHasSufficientMemory" Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.429313 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.429323 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-37.ec2.internal" event="NodeHasSufficientPID" Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.429329 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.429348 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-37.ec2.internal" event="NodeHasSufficientPID" Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.431523 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-37.ec2.internal" Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.431544 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.432183 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-37.ec2.internal" event="NodeHasSufficientMemory" Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.432204 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.432215 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-37.ec2.internal" event="NodeHasSufficientPID" Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:24.458458 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-37.ec2.internal\" not found" node="ip-10-0-133-37.ec2.internal" Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:24.462754 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-37.ec2.internal\" not found" node="ip-10-0-133-37.ec2.internal" Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.471992 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab9c400afd6d2292d4bb39e251d603d3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-37.ec2.internal\" (UID: \"ab9c400afd6d2292d4bb39e251d603d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-37.ec2.internal" Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.472014 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab9c400afd6d2292d4bb39e251d603d3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-37.ec2.internal\" (UID: \"ab9c400afd6d2292d4bb39e251d603d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-37.ec2.internal" Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.472048 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c30d50af267f54e89a2e53ab8e34c4f0-config\") pod \"kube-apiserver-proxy-ip-10-0-133-37.ec2.internal\" (UID: \"c30d50af267f54e89a2e53ab8e34c4f0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-37.ec2.internal" Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:24.481713 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-37.ec2.internal\" not found" Jul 08 23:07:24.786342 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.572748 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab9c400afd6d2292d4bb39e251d603d3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-37.ec2.internal\" (UID: \"ab9c400afd6d2292d4bb39e251d603d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-37.ec2.internal" Jul 08 23:07:24.949819 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.572792 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab9c400afd6d2292d4bb39e251d603d3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-37.ec2.internal\" (UID: \"ab9c400afd6d2292d4bb39e251d603d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-37.ec2.internal" Jul 08 23:07:24.949819 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.572815 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c30d50af267f54e89a2e53ab8e34c4f0-config\") pod \"kube-apiserver-proxy-ip-10-0-133-37.ec2.internal\" (UID: \"c30d50af267f54e89a2e53ab8e34c4f0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-37.ec2.internal" Jul 08 23:07:24.949819 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.572852 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c30d50af267f54e89a2e53ab8e34c4f0-config\") pod \"kube-apiserver-proxy-ip-10-0-133-37.ec2.internal\" (UID: \"c30d50af267f54e89a2e53ab8e34c4f0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-37.ec2.internal" Jul 08 23:07:24.949819 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.572859 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab9c400afd6d2292d4bb39e251d603d3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-37.ec2.internal\" (UID: \"ab9c400afd6d2292d4bb39e251d603d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-37.ec2.internal" Jul 08 23:07:24.949819 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.572863 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab9c400afd6d2292d4bb39e251d603d3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-37.ec2.internal\" (UID: \"ab9c400afd6d2292d4bb39e251d603d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-37.ec2.internal" Jul 08 23:07:24.949819 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:24.581777 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-37.ec2.internal\" not found" Jul 08 23:07:24.949819 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:24.682596 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-37.ec2.internal\" not found" Jul 08 23:07:24.949819 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.761786 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-37.ec2.internal" Jul 08 23:07:24.949819 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:24.769853 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-37.ec2.internal" Jul 08 23:07:24.949819 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:24.783473 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-37.ec2.internal\" not found" Jul 08 23:07:24.949819 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:24.884486 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-37.ec2.internal\" not found" Jul 08 23:07:25.116640 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:24.985601 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-37.ec2.internal\" not found" Jul 08 23:07:25.116640 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:25.086244 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-37.ec2.internal\" not found" Jul 08 23:07:25.116640 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:25.107391 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 23:07:25.116640 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:25.107513 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 23:07:25.178753 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:25.178723 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 23:07:25.187204 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:25.187174 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-37.ec2.internal\" not found" Jul 08 23:07:25.203337 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:25.203309 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 23:02:24 +0000 UTC" deadline="2028-03-05 09:24:49.509601377 +0000 UTC" Jul 08 23:07:25.203337 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:25.203333 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14530h17m24.306271149s" Jul 08 23:07:25.287962 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:25.287936 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-37.ec2.internal\" not found" Jul 08 23:07:25.309784 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:25.309762 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 23:07:25.388286 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:25.388212 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-37.ec2.internal\" not found" Jul 08 23:07:25.393921 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:25.393878 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 23:07:25.469760 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:25.469732 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-37.ec2.internal" Jul 08 23:07:25.483006 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:25.482990 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 23:07:25.483825 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:25.483814 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-37.ec2.internal" Jul 08 23:07:25.488083 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:25.488058 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab9c400afd6d2292d4bb39e251d603d3.slice/crio-8541cf744685e15d7a0f78c7ea4f9b3e2cc89ae768ab70fe1e5a529623d7ecbb WatchSource:0}: Error finding container 8541cf744685e15d7a0f78c7ea4f9b3e2cc89ae768ab70fe1e5a529623d7ecbb: Status 404 returned error can't find the container with id 8541cf744685e15d7a0f78c7ea4f9b3e2cc89ae768ab70fe1e5a529623d7ecbb Jul 08 23:07:25.488448 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:25.488427 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc30d50af267f54e89a2e53ab8e34c4f0.slice/crio-63178bf95567da8d5fe76c27be6f9d66c130028dcda59776377dfb6ba8f7c996 WatchSource:0}: Error finding container 63178bf95567da8d5fe76c27be6f9d66c130028dcda59776377dfb6ba8f7c996: Status 404 returned error can't find the container with id 63178bf95567da8d5fe76c27be6f9d66c130028dcda59776377dfb6ba8f7c996 Jul 08 23:07:25.490985 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:25.490270 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 23:07:25.493185 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:25.493169 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 23:07:26.042447 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.042422 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 23:07:26.149754 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.149724 2572 apiserver.go:52] "Watching apiserver" Jul 08 23:07:26.157959 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.157936 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 23:07:26.158352 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.158328 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-pfq7d","openshift-image-registry/node-ca-42qwx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-37.ec2.internal","openshift-multus/network-metrics-daemon-kwcdm","openshift-network-diagnostics/network-check-target-8cr2z","kube-system/konnectivity-agent-2bpwm","kube-system/kube-apiserver-proxy-ip-10-0-133-37.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjd8","openshift-cluster-node-tuning-operator/tuned-vxf8t","openshift-multus/multus-additional-cni-plugins-zwfwd","openshift-multus/multus-wvtzz","openshift-network-operator/iptables-alerter-4bwdd","openshift-ovn-kubernetes/ovnkube-node-7lg72","kube-system/global-pull-secret-syncer-2p25w"] Jul 08 23:07:26.160912 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.160877 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zwfwd" Jul 08 23:07:26.163346 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.163319 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.163720 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.163459 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 23:07:26.163720 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.163562 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 23:07:26.163720 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.163699 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fmtgk\"" Jul 08 23:07:26.163922 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.163766 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 23:07:26.163922 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.163914 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 23:07:26.164032 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.163955 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 23:07:26.165605 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.165578 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:26.165711 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:26.165649 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p25w" podUID="19cfadf2-80c1-49c5-b9ff-29c372a05a7f" Jul 08 23:07:26.166789 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.166767 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 23:07:26.166882 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.166788 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 23:07:26.166882 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.166875 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 23:07:26.167016 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.166950 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 23:07:26.167070 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.167043 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 23:07:26.167070 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.167056 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 23:07:26.167268 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.167252 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-v7dqn\"" Jul 08 23:07:26.168369 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.168352 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:07:26.168470 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:26.168426 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwcdm" podUID="3d290d52-819f-4ece-bc8e-11ce3dbb4d29" Jul 08 23:07:26.169915 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.169877 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 23:07:26.171498 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.171475 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:07:26.171588 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:26.171559 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cr2z" podUID="29b0e180-c5ba-4775-888e-f57cd955a7ab" Jul 08 23:07:26.174001 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.173981 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2bpwm" Jul 08 23:07:26.176311 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.176284 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cm4j2\"" Jul 08 23:07:26.176486 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.176381 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 23:07:26.176486 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.176426 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 23:07:26.177087 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.176691 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.179654 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.178983 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 23:07:26.179654 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.179370 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9sls2\"" Jul 08 23:07:26.179654 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.179424 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjd8" Jul 08 23:07:26.179654 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.179560 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 23:07:26.180642 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.180420 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-host-cni-netd\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.180642 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.180452 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-kubelet-config\") pod \"global-pull-secret-syncer-2p25w\" (UID: \"19cfadf2-80c1-49c5-b9ff-29c372a05a7f\") " pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:26.180642 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.180479 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-original-pull-secret\") pod \"global-pull-secret-syncer-2p25w\" (UID: \"19cfadf2-80c1-49c5-b9ff-29c372a05a7f\") " pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:26.180642 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.180507 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/563c7484-0036-46e3-81fd-e0809d864d8c-cnibin\") pod \"multus-additional-cni-plugins-zwfwd\" (UID: \"563c7484-0036-46e3-81fd-e0809d864d8c\") " pod="openshift-multus/multus-additional-cni-plugins-zwfwd" Jul 08 23:07:26.180642 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.180532 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/563c7484-0036-46e3-81fd-e0809d864d8c-os-release\") pod \"multus-additional-cni-plugins-zwfwd\" (UID: \"563c7484-0036-46e3-81fd-e0809d864d8c\") " pod="openshift-multus/multus-additional-cni-plugins-zwfwd" Jul 08 23:07:26.180642 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.180557 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/563c7484-0036-46e3-81fd-e0809d864d8c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zwfwd\" (UID: \"563c7484-0036-46e3-81fd-e0809d864d8c\") " pod="openshift-multus/multus-additional-cni-plugins-zwfwd" Jul 08 23:07:26.180642 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.180581 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-run-ovn\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.180642 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.180605 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-ovn-node-metrics-cert\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.181094 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.180652 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl95b\" (UniqueName: \"kubernetes.io/projected/563c7484-0036-46e3-81fd-e0809d864d8c-kube-api-access-rl95b\") pod \"multus-additional-cni-plugins-zwfwd\" (UID: \"563c7484-0036-46e3-81fd-e0809d864d8c\") " pod="openshift-multus/multus-additional-cni-plugins-zwfwd" Jul 08 23:07:26.181094 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.180682 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-systemd-units\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.181094 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.180708 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-node-log\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.181094 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.180732 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-ovnkube-config\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.181094 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.180754 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-host-kubelet\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.181094 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.180776 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-host-slash\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.181094 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.180840 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-host-run-netns\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.181094 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.180863 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkxw9\" (UniqueName: \"kubernetes.io/projected/29b0e180-c5ba-4775-888e-f57cd955a7ab-kube-api-access-dkxw9\") pod \"network-check-target-8cr2z\" (UID: \"29b0e180-c5ba-4775-888e-f57cd955a7ab\") " pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:07:26.181094 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.180887 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/563c7484-0036-46e3-81fd-e0809d864d8c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zwfwd\" (UID: \"563c7484-0036-46e3-81fd-e0809d864d8c\") " pod="openshift-multus/multus-additional-cni-plugins-zwfwd" Jul 08 23:07:26.181094 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.180941 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-run-openvswitch\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.181094 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.180963 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-env-overrides\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.181094 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.180983 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-ovnkube-script-lib\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.181094 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.181005 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pldb8\" (UniqueName: \"kubernetes.io/projected/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-kube-api-access-pldb8\") pod \"network-metrics-daemon-kwcdm\" (UID: \"3d290d52-819f-4ece-bc8e-11ce3dbb4d29\") " pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:07:26.181094 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.181029 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/563c7484-0036-46e3-81fd-e0809d864d8c-cni-binary-copy\") pod \"multus-additional-cni-plugins-zwfwd\" (UID: \"563c7484-0036-46e3-81fd-e0809d864d8c\") " pod="openshift-multus/multus-additional-cni-plugins-zwfwd" Jul 08 23:07:26.181094 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.181054 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/563c7484-0036-46e3-81fd-e0809d864d8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zwfwd\" (UID: \"563c7484-0036-46e3-81fd-e0809d864d8c\") " pod="openshift-multus/multus-additional-cni-plugins-zwfwd" Jul 08 23:07:26.181094 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.181078 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-run-systemd\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.181774 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.181100 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-var-lib-openvswitch\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.181774 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.181122 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-etc-openvswitch\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.181774 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.181146 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.181774 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.181168 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-host-cni-bin\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.181774 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.181192 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.181774 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.181241 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d7kn\" (UniqueName: \"kubernetes.io/projected/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-kube-api-access-8d7kn\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.181774 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.181295 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs\") pod \"network-metrics-daemon-kwcdm\" (UID: \"3d290d52-819f-4ece-bc8e-11ce3dbb4d29\") " pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:07:26.181774 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.181329 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/563c7484-0036-46e3-81fd-e0809d864d8c-system-cni-dir\") pod \"multus-additional-cni-plugins-zwfwd\" (UID: \"563c7484-0036-46e3-81fd-e0809d864d8c\") " pod="openshift-multus/multus-additional-cni-plugins-zwfwd" Jul 08 23:07:26.181774 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.181353 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-log-socket\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.181774 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.181374 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-dbus\") pod \"global-pull-secret-syncer-2p25w\" (UID: \"19cfadf2-80c1-49c5-b9ff-29c372a05a7f\") " pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:26.181774 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.181751 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-42qwx" Jul 08 23:07:26.182289 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.181798 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-s5526\"" Jul 08 23:07:26.182289 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.182023 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 23:07:26.182289 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.182126 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 23:07:26.182432 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.182377 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 23:07:26.182776 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.182624 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 23:07:26.184503 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.183915 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 23:07:26.184503 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.184055 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 23:07:26.184503 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.184272 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 23:07:26.184503 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.184278 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lf6ss\"" Jul 08 23:07:26.184503 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.184274 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pfq7d" Jul 08 23:07:26.187015 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.186975 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.187829 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.187787 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 23:07:26.188366 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.187842 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7ltzd\"" Jul 08 23:07:26.188366 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.188120 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 23:07:26.189094 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.189074 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 23:07:26.189186 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.189132 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4bwdd" Jul 08 23:07:26.189484 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.189269 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-c8x9n\"" Jul 08 23:07:26.191439 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.191409 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 23:07:26.191980 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.191821 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 23:07:26.191980 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.191858 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 23:07:26.191980 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.191876 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qdjpd\"" Jul 08 23:07:26.207431 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.207408 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ltt84" Jul 08 23:07:26.215568 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.215549 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ltt84" Jul 08 23:07:26.272030 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.272009 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 23:07:26.282545 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.282517 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d7kn\" (UniqueName: \"kubernetes.io/projected/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-kube-api-access-8d7kn\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.282656 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.282555 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/67c89124-1155-472f-879b-6d2fab0880dc-device-dir\") pod \"aws-ebs-csi-driver-node-fvjd8\" (UID: \"67c89124-1155-472f-879b-6d2fab0880dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjd8" Jul 08 23:07:26.282656 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.282586 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/67c89124-1155-472f-879b-6d2fab0880dc-etc-selinux\") pod \"aws-ebs-csi-driver-node-fvjd8\" (UID: \"67c89124-1155-472f-879b-6d2fab0880dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjd8" Jul 08 23:07:26.282656 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.282609 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnj64\" (UniqueName: \"kubernetes.io/projected/68fda8d2-5fe9-40a0-8d69-a8ff51d15e23-kube-api-access-qnj64\") pod \"node-resolver-pfq7d\" (UID: \"68fda8d2-5fe9-40a0-8d69-a8ff51d15e23\") " pod="openshift-dns/node-resolver-pfq7d" Jul 08 23:07:26.282656 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.282636 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/563c7484-0036-46e3-81fd-e0809d864d8c-system-cni-dir\") pod \"multus-additional-cni-plugins-zwfwd\" (UID: \"563c7484-0036-46e3-81fd-e0809d864d8c\") " pod="openshift-multus/multus-additional-cni-plugins-zwfwd" Jul 08 23:07:26.282858 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.282699 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-log-socket\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.282858 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.282716 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/563c7484-0036-46e3-81fd-e0809d864d8c-system-cni-dir\") pod \"multus-additional-cni-plugins-zwfwd\" (UID: \"563c7484-0036-46e3-81fd-e0809d864d8c\") " pod="openshift-multus/multus-additional-cni-plugins-zwfwd" Jul 08 23:07:26.282858 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.282749 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-dbus\") pod \"global-pull-secret-syncer-2p25w\" (UID: \"19cfadf2-80c1-49c5-b9ff-29c372a05a7f\") " pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:26.282858 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.282761 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-log-socket\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.282858 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.282776 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-etc-sysctl-conf\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.282858 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.282800 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/67c89124-1155-472f-879b-6d2fab0880dc-sys-fs\") pod \"aws-ebs-csi-driver-node-fvjd8\" (UID: \"67c89124-1155-472f-879b-6d2fab0880dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjd8" Jul 08 23:07:26.282858 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.282824 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-host-cni-netd\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.282858 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.282847 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-kubelet-config\") pod \"global-pull-secret-syncer-2p25w\" (UID: \"19cfadf2-80c1-49c5-b9ff-29c372a05a7f\") " pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:26.283287 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.282868 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-etc-systemd\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.283287 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.282948 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-hostroot\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.283287 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.282989 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-dbus\") pod \"global-pull-secret-syncer-2p25w\" (UID: \"19cfadf2-80c1-49c5-b9ff-29c372a05a7f\") " pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:26.283287 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283011 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/563c7484-0036-46e3-81fd-e0809d864d8c-cnibin\") pod \"multus-additional-cni-plugins-zwfwd\" (UID: \"563c7484-0036-46e3-81fd-e0809d864d8c\") " pod="openshift-multus/multus-additional-cni-plugins-zwfwd" Jul 08 23:07:26.283287 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283036 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/563c7484-0036-46e3-81fd-e0809d864d8c-os-release\") pod \"multus-additional-cni-plugins-zwfwd\" (UID: \"563c7484-0036-46e3-81fd-e0809d864d8c\") " pod="openshift-multus/multus-additional-cni-plugins-zwfwd" Jul 08 23:07:26.283287 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283036 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-host-cni-netd\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.283287 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283060 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-run-ovn\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.283287 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283085 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-kubelet-config\") pod \"global-pull-secret-syncer-2p25w\" (UID: \"19cfadf2-80c1-49c5-b9ff-29c372a05a7f\") " pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:26.283287 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283090 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-var-lib-kubelet\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.283287 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283130 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-run-ovn\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.283287 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283153 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/563c7484-0036-46e3-81fd-e0809d864d8c-cnibin\") pod \"multus-additional-cni-plugins-zwfwd\" (UID: \"563c7484-0036-46e3-81fd-e0809d864d8c\") " pod="openshift-multus/multus-additional-cni-plugins-zwfwd" Jul 08 23:07:26.283287 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283160 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4f14c98f-3358-494e-bde0-76dd7436a833-serviceca\") pod \"node-ca-42qwx\" (UID: \"4f14c98f-3358-494e-bde0-76dd7436a833\") " pod="openshift-image-registry/node-ca-42qwx" Jul 08 23:07:26.283287 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283208 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-host-run-k8s-cni-cncf-io\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.283287 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283233 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/563c7484-0036-46e3-81fd-e0809d864d8c-os-release\") pod \"multus-additional-cni-plugins-zwfwd\" (UID: \"563c7484-0036-46e3-81fd-e0809d864d8c\") " pod="openshift-multus/multus-additional-cni-plugins-zwfwd" Jul 08 23:07:26.283287 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283239 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-host-var-lib-cni-bin\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.283287 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283276 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl95b\" (UniqueName: \"kubernetes.io/projected/563c7484-0036-46e3-81fd-e0809d864d8c-kube-api-access-rl95b\") pod \"multus-additional-cni-plugins-zwfwd\" (UID: \"563c7484-0036-46e3-81fd-e0809d864d8c\") " pod="openshift-multus/multus-additional-cni-plugins-zwfwd" Jul 08 23:07:26.284160 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283316 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-node-log\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.284160 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283339 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-lib-modules\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.284160 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283360 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-host\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.284160 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283391 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-system-cni-dir\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.284160 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283414 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-os-release\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.284160 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283437 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/773549fb-9a77-46a7-bc5e-c7d401f89e95-multus-daemon-config\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.284160 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283462 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-host-kubelet\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.284160 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283501 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-multus-cni-dir\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.284160 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283526 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-ovnkube-script-lib\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.284160 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283549 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/559d9149-021d-4f5f-85f0-17474dea7b60-tmp\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.284160 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283574 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk8wg\" (UniqueName: \"kubernetes.io/projected/4f14c98f-3358-494e-bde0-76dd7436a833-kube-api-access-sk8wg\") pod \"node-ca-42qwx\" (UID: \"4f14c98f-3358-494e-bde0-76dd7436a833\") " pod="openshift-image-registry/node-ca-42qwx" Jul 08 23:07:26.284160 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283582 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-node-log\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.284160 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283595 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-cnibin\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.284160 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283614 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-host-kubelet\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.284160 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283724 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-multus-socket-dir-parent\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.284160 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283755 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/563c7484-0036-46e3-81fd-e0809d864d8c-cni-binary-copy\") pod \"multus-additional-cni-plugins-zwfwd\" (UID: \"563c7484-0036-46e3-81fd-e0809d864d8c\") " pod="openshift-multus/multus-additional-cni-plugins-zwfwd" Jul 08 23:07:26.284160 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283819 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-etc-openvswitch\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.284959 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283841 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-host-cni-bin\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.284959 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283865 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.284959 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283889 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs\") pod \"network-metrics-daemon-kwcdm\" (UID: \"3d290d52-819f-4ece-bc8e-11ce3dbb4d29\") " pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:07:26.284959 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283930 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-host-run-netns\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.284959 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283955 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-etc-sysctl-d\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.284959 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283978 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-sys\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.284959 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.283999 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/773549fb-9a77-46a7-bc5e-c7d401f89e95-cni-binary-copy\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.284959 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284024 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/171d5513-9470-4154-9a10-fd209122a411-iptables-alerter-script\") pod \"iptables-alerter-4bwdd\" (UID: \"171d5513-9470-4154-9a10-fd209122a411\") " pod="openshift-network-operator/iptables-alerter-4bwdd" Jul 08 23:07:26.284959 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284046 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-host-run-multus-certs\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.284959 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284062 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-original-pull-secret\") pod \"global-pull-secret-syncer-2p25w\" (UID: \"19cfadf2-80c1-49c5-b9ff-29c372a05a7f\") " pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:26.284959 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284080 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-etc-sysconfig\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.284959 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284103 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/559d9149-021d-4f5f-85f0-17474dea7b60-etc-tuned\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.284959 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284118 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-multus-conf-dir\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.284959 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284134 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/563c7484-0036-46e3-81fd-e0809d864d8c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zwfwd\" (UID: \"563c7484-0036-46e3-81fd-e0809d864d8c\") " pod="openshift-multus/multus-additional-cni-plugins-zwfwd" Jul 08 23:07:26.284959 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284156 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-ovn-node-metrics-cert\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.284959 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284182 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-run\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.284959 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284197 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-host-var-lib-kubelet\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.285821 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284229 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-systemd-units\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.285821 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284244 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-ovnkube-script-lib\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.285821 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284250 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-ovnkube-config\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.285821 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284338 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1d37c23c-9492-45f3-8e9f-ef3855f05727-konnectivity-ca\") pod \"konnectivity-agent-2bpwm\" (UID: \"1d37c23c-9492-45f3-8e9f-ef3855f05727\") " pod="kube-system/konnectivity-agent-2bpwm" Jul 08 23:07:26.285821 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284363 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-etc-modprobe-d\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.285821 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284388 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/67c89124-1155-472f-879b-6d2fab0880dc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fvjd8\" (UID: \"67c89124-1155-472f-879b-6d2fab0880dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjd8" Jul 08 23:07:26.285821 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284411 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/67c89124-1155-472f-879b-6d2fab0880dc-registration-dir\") pod \"aws-ebs-csi-driver-node-fvjd8\" (UID: \"67c89124-1155-472f-879b-6d2fab0880dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjd8" Jul 08 23:07:26.285821 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284437 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-etc-kubernetes\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.285821 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284514 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64hg2\" (UniqueName: \"kubernetes.io/projected/171d5513-9470-4154-9a10-fd209122a411-kube-api-access-64hg2\") pod \"iptables-alerter-4bwdd\" (UID: \"171d5513-9470-4154-9a10-fd209122a411\") " pod="openshift-network-operator/iptables-alerter-4bwdd" Jul 08 23:07:26.285821 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284541 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-host-slash\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.285821 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284566 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-host-run-netns\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.285821 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284589 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1d37c23c-9492-45f3-8e9f-ef3855f05727-agent-certs\") pod \"konnectivity-agent-2bpwm\" (UID: \"1d37c23c-9492-45f3-8e9f-ef3855f05727\") " pod="kube-system/konnectivity-agent-2bpwm" Jul 08 23:07:26.285821 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284612 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-etc-kubernetes\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.285821 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284639 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-host-var-lib-cni-multus\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.285821 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284664 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/171d5513-9470-4154-9a10-fd209122a411-host-slash\") pod \"iptables-alerter-4bwdd\" (UID: \"171d5513-9470-4154-9a10-fd209122a411\") " pod="openshift-network-operator/iptables-alerter-4bwdd" Jul 08 23:07:26.285821 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284690 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkxw9\" (UniqueName: \"kubernetes.io/projected/29b0e180-c5ba-4775-888e-f57cd955a7ab-kube-api-access-dkxw9\") pod \"network-check-target-8cr2z\" (UID: \"29b0e180-c5ba-4775-888e-f57cd955a7ab\") " pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:07:26.285821 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284728 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-ovnkube-config\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.286618 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284750 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/563c7484-0036-46e3-81fd-e0809d864d8c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zwfwd\" (UID: \"563c7484-0036-46e3-81fd-e0809d864d8c\") " pod="openshift-multus/multus-additional-cni-plugins-zwfwd" Jul 08 23:07:26.286618 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284775 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-run-openvswitch\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.286618 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284799 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-env-overrides\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.286618 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284824 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pldb8\" (UniqueName: \"kubernetes.io/projected/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-kube-api-access-pldb8\") pod \"network-metrics-daemon-kwcdm\" (UID: \"3d290d52-819f-4ece-bc8e-11ce3dbb4d29\") " pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:07:26.286618 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284847 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/67c89124-1155-472f-879b-6d2fab0880dc-socket-dir\") pod \"aws-ebs-csi-driver-node-fvjd8\" (UID: \"67c89124-1155-472f-879b-6d2fab0880dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjd8" Jul 08 23:07:26.286618 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284871 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4f14c98f-3358-494e-bde0-76dd7436a833-host\") pod \"node-ca-42qwx\" (UID: \"4f14c98f-3358-494e-bde0-76dd7436a833\") " pod="openshift-image-registry/node-ca-42qwx" Jul 08 23:07:26.286618 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284910 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68fda8d2-5fe9-40a0-8d69-a8ff51d15e23-tmp-dir\") pod \"node-resolver-pfq7d\" (UID: \"68fda8d2-5fe9-40a0-8d69-a8ff51d15e23\") " pod="openshift-dns/node-resolver-pfq7d" Jul 08 23:07:26.286618 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284939 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/563c7484-0036-46e3-81fd-e0809d864d8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zwfwd\" (UID: \"563c7484-0036-46e3-81fd-e0809d864d8c\") " pod="openshift-multus/multus-additional-cni-plugins-zwfwd" Jul 08 23:07:26.286618 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284964 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-run-systemd\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.286618 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.284987 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-var-lib-openvswitch\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.286618 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.285013 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.286618 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.285037 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq27z\" (UniqueName: \"kubernetes.io/projected/559d9149-021d-4f5f-85f0-17474dea7b60-kube-api-access-kq27z\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.286618 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.285064 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmlmv\" (UniqueName: \"kubernetes.io/projected/67c89124-1155-472f-879b-6d2fab0880dc-kube-api-access-rmlmv\") pod \"aws-ebs-csi-driver-node-fvjd8\" (UID: \"67c89124-1155-472f-879b-6d2fab0880dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjd8" Jul 08 23:07:26.286618 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.285089 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/68fda8d2-5fe9-40a0-8d69-a8ff51d15e23-hosts-file\") pod \"node-resolver-pfq7d\" (UID: \"68fda8d2-5fe9-40a0-8d69-a8ff51d15e23\") " pod="openshift-dns/node-resolver-pfq7d" Jul 08 23:07:26.286618 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.285134 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdl57\" (UniqueName: \"kubernetes.io/projected/773549fb-9a77-46a7-bc5e-c7d401f89e95-kube-api-access-mdl57\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.286618 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.285206 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/563c7484-0036-46e3-81fd-e0809d864d8c-cni-binary-copy\") pod \"multus-additional-cni-plugins-zwfwd\" (UID: \"563c7484-0036-46e3-81fd-e0809d864d8c\") " pod="openshift-multus/multus-additional-cni-plugins-zwfwd" Jul 08 23:07:26.286618 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.285264 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-etc-openvswitch\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.287429 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.285305 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-host-cni-bin\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.287429 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.285357 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.287429 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:26.285438 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 23:07:26.287429 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:26.285517 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs podName:3d290d52-819f-4ece-bc8e-11ce3dbb4d29 nodeName:}" failed. No retries permitted until 2026-07-08 23:07:26.785487615 +0000 UTC m=+2.944771106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs") pod "network-metrics-daemon-kwcdm" (UID: "3d290d52-819f-4ece-bc8e-11ce3dbb4d29") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 23:07:26.287429 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.285728 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/563c7484-0036-46e3-81fd-e0809d864d8c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zwfwd\" (UID: \"563c7484-0036-46e3-81fd-e0809d864d8c\") " pod="openshift-multus/multus-additional-cni-plugins-zwfwd" Jul 08 23:07:26.287429 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:26.285768 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 23:07:26.287429 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:26.285812 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-original-pull-secret podName:19cfadf2-80c1-49c5-b9ff-29c372a05a7f nodeName:}" failed. No retries permitted until 2026-07-08 23:07:26.78579751 +0000 UTC m=+2.945081002 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-original-pull-secret") pod "global-pull-secret-syncer-2p25w" (UID: "19cfadf2-80c1-49c5-b9ff-29c372a05a7f") : object "kube-system"/"original-pull-secret" not registered Jul 08 23:07:26.287429 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.285837 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-run-openvswitch\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.287429 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.285921 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-systemd-units\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.287429 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.285963 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-var-lib-openvswitch\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.287429 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.286126 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.287429 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.286149 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 23:07:26.287429 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.286172 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-host-slash\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.287429 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.286360 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-env-overrides\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.287429 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.286360 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/563c7484-0036-46e3-81fd-e0809d864d8c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zwfwd\" (UID: \"563c7484-0036-46e3-81fd-e0809d864d8c\") " pod="openshift-multus/multus-additional-cni-plugins-zwfwd" Jul 08 23:07:26.287429 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.286395 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-run-systemd\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.287429 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.286437 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-host-run-netns\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.288242 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.286570 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/563c7484-0036-46e3-81fd-e0809d864d8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zwfwd\" (UID: \"563c7484-0036-46e3-81fd-e0809d864d8c\") " pod="openshift-multus/multus-additional-cni-plugins-zwfwd" Jul 08 23:07:26.290077 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.290057 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-ovn-node-metrics-cert\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.292182 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.292157 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl95b\" (UniqueName: \"kubernetes.io/projected/563c7484-0036-46e3-81fd-e0809d864d8c-kube-api-access-rl95b\") pod \"multus-additional-cni-plugins-zwfwd\" (UID: \"563c7484-0036-46e3-81fd-e0809d864d8c\") " pod="openshift-multus/multus-additional-cni-plugins-zwfwd" Jul 08 23:07:26.292927 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.292576 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d7kn\" (UniqueName: \"kubernetes.io/projected/4e6e4143-1cbb-4df2-8d27-487fdecf06ea-kube-api-access-8d7kn\") pod \"ovnkube-node-7lg72\" (UID: \"4e6e4143-1cbb-4df2-8d27-487fdecf06ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.294025 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:26.294008 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 23:07:26.294025 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:26.294028 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 23:07:26.294133 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:26.294038 2572 projected.go:196] Error preparing data for projected volume kube-api-access-dkxw9 for pod openshift-network-diagnostics/network-check-target-8cr2z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 23:07:26.294133 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:26.294091 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29b0e180-c5ba-4775-888e-f57cd955a7ab-kube-api-access-dkxw9 podName:29b0e180-c5ba-4775-888e-f57cd955a7ab nodeName:}" failed. No retries permitted until 2026-07-08 23:07:26.794077443 +0000 UTC m=+2.953360936 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dkxw9" (UniqueName: "kubernetes.io/projected/29b0e180-c5ba-4775-888e-f57cd955a7ab-kube-api-access-dkxw9") pod "network-check-target-8cr2z" (UID: "29b0e180-c5ba-4775-888e-f57cd955a7ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 23:07:26.297220 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.297184 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pldb8\" (UniqueName: \"kubernetes.io/projected/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-kube-api-access-pldb8\") pod \"network-metrics-daemon-kwcdm\" (UID: \"3d290d52-819f-4ece-bc8e-11ce3dbb4d29\") " pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:07:26.329174 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.329117 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-37.ec2.internal" event={"ID":"ab9c400afd6d2292d4bb39e251d603d3","Type":"ContainerStarted","Data":"8541cf744685e15d7a0f78c7ea4f9b3e2cc89ae768ab70fe1e5a529623d7ecbb"} Jul 08 23:07:26.330794 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.330767 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-37.ec2.internal" event={"ID":"c30d50af267f54e89a2e53ab8e34c4f0","Type":"ContainerStarted","Data":"63178bf95567da8d5fe76c27be6f9d66c130028dcda59776377dfb6ba8f7c996"} Jul 08 23:07:26.385769 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.385730 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-host-run-netns\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.385769 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.385770 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-etc-sysctl-d\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.386035 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.385786 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-sys\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.386035 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.385804 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/773549fb-9a77-46a7-bc5e-c7d401f89e95-cni-binary-copy\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.386035 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.385826 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/171d5513-9470-4154-9a10-fd209122a411-iptables-alerter-script\") pod \"iptables-alerter-4bwdd\" (UID: \"171d5513-9470-4154-9a10-fd209122a411\") " pod="openshift-network-operator/iptables-alerter-4bwdd" Jul 08 23:07:26.386035 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.385848 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-host-run-multus-certs\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.386035 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.385858 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-host-run-netns\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.386035 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.385878 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-etc-sysconfig\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.386035 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.385925 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-sys\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.386035 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.385934 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/559d9149-021d-4f5f-85f0-17474dea7b60-etc-tuned\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.386035 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.385946 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-etc-sysconfig\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.386035 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.385947 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-etc-sysctl-d\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.386035 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.385963 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-multus-conf-dir\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.386035 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.385992 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-run\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.386035 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.385996 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-host-run-multus-certs\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.386605 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.386053 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-run\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.386605 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.386321 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-host-var-lib-kubelet\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.386605 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.386375 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1d37c23c-9492-45f3-8e9f-ef3855f05727-konnectivity-ca\") pod \"konnectivity-agent-2bpwm\" (UID: \"1d37c23c-9492-45f3-8e9f-ef3855f05727\") " pod="kube-system/konnectivity-agent-2bpwm" Jul 08 23:07:26.386605 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.386410 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-etc-modprobe-d\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.386605 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.386450 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/67c89124-1155-472f-879b-6d2fab0880dc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fvjd8\" (UID: \"67c89124-1155-472f-879b-6d2fab0880dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjd8" Jul 08 23:07:26.386605 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.386481 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/67c89124-1155-472f-879b-6d2fab0880dc-registration-dir\") pod \"aws-ebs-csi-driver-node-fvjd8\" (UID: \"67c89124-1155-472f-879b-6d2fab0880dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjd8" Jul 08 23:07:26.387007 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.386955 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-multus-conf-dir\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.387007 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.386506 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-etc-kubernetes\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.387144 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.387035 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64hg2\" (UniqueName: \"kubernetes.io/projected/171d5513-9470-4154-9a10-fd209122a411-kube-api-access-64hg2\") pod \"iptables-alerter-4bwdd\" (UID: \"171d5513-9470-4154-9a10-fd209122a411\") " pod="openshift-network-operator/iptables-alerter-4bwdd" Jul 08 23:07:26.387144 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.387092 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/773549fb-9a77-46a7-bc5e-c7d401f89e95-cni-binary-copy\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.387414 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.387388 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/171d5513-9470-4154-9a10-fd209122a411-iptables-alerter-script\") pod \"iptables-alerter-4bwdd\" (UID: \"171d5513-9470-4154-9a10-fd209122a411\") " pod="openshift-network-operator/iptables-alerter-4bwdd" Jul 08 23:07:26.387495 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.387423 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/67c89124-1155-472f-879b-6d2fab0880dc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fvjd8\" (UID: \"67c89124-1155-472f-879b-6d2fab0880dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjd8" Jul 08 23:07:26.387550 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.387500 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/67c89124-1155-472f-879b-6d2fab0880dc-registration-dir\") pod \"aws-ebs-csi-driver-node-fvjd8\" (UID: \"67c89124-1155-472f-879b-6d2fab0880dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjd8" Jul 08 23:07:26.387599 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.387549 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-host-var-lib-kubelet\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.387599 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.387546 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-etc-modprobe-d\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.387599 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.387568 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1d37c23c-9492-45f3-8e9f-ef3855f05727-agent-certs\") pod \"konnectivity-agent-2bpwm\" (UID: \"1d37c23c-9492-45f3-8e9f-ef3855f05727\") " pod="kube-system/konnectivity-agent-2bpwm" Jul 08 23:07:26.387802 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.387604 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-etc-kubernetes\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.387802 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.387628 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1d37c23c-9492-45f3-8e9f-ef3855f05727-konnectivity-ca\") pod \"konnectivity-agent-2bpwm\" (UID: \"1d37c23c-9492-45f3-8e9f-ef3855f05727\") " pod="kube-system/konnectivity-agent-2bpwm" Jul 08 23:07:26.387802 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.387669 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-etc-kubernetes\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.387984 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.387947 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-etc-kubernetes\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.388109 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.388090 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-host-var-lib-cni-multus\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.388183 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.388136 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/171d5513-9470-4154-9a10-fd209122a411-host-slash\") pod \"iptables-alerter-4bwdd\" (UID: \"171d5513-9470-4154-9a10-fd209122a411\") " pod="openshift-network-operator/iptables-alerter-4bwdd" Jul 08 23:07:26.388236 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.388190 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/67c89124-1155-472f-879b-6d2fab0880dc-socket-dir\") pod \"aws-ebs-csi-driver-node-fvjd8\" (UID: \"67c89124-1155-472f-879b-6d2fab0880dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjd8" Jul 08 23:07:26.388236 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.388223 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4f14c98f-3358-494e-bde0-76dd7436a833-host\") pod \"node-ca-42qwx\" (UID: \"4f14c98f-3358-494e-bde0-76dd7436a833\") " pod="openshift-image-registry/node-ca-42qwx" Jul 08 23:07:26.388331 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.388255 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68fda8d2-5fe9-40a0-8d69-a8ff51d15e23-tmp-dir\") pod \"node-resolver-pfq7d\" (UID: \"68fda8d2-5fe9-40a0-8d69-a8ff51d15e23\") " pod="openshift-dns/node-resolver-pfq7d" Jul 08 23:07:26.388331 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.388291 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq27z\" (UniqueName: \"kubernetes.io/projected/559d9149-021d-4f5f-85f0-17474dea7b60-kube-api-access-kq27z\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.388331 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.388319 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmlmv\" (UniqueName: \"kubernetes.io/projected/67c89124-1155-472f-879b-6d2fab0880dc-kube-api-access-rmlmv\") pod \"aws-ebs-csi-driver-node-fvjd8\" (UID: \"67c89124-1155-472f-879b-6d2fab0880dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjd8" Jul 08 23:07:26.388477 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.388350 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/68fda8d2-5fe9-40a0-8d69-a8ff51d15e23-hosts-file\") pod \"node-resolver-pfq7d\" (UID: \"68fda8d2-5fe9-40a0-8d69-a8ff51d15e23\") " pod="openshift-dns/node-resolver-pfq7d" Jul 08 23:07:26.388477 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.388384 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdl57\" (UniqueName: \"kubernetes.io/projected/773549fb-9a77-46a7-bc5e-c7d401f89e95-kube-api-access-mdl57\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.388477 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.388421 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/67c89124-1155-472f-879b-6d2fab0880dc-device-dir\") pod \"aws-ebs-csi-driver-node-fvjd8\" (UID: \"67c89124-1155-472f-879b-6d2fab0880dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjd8" Jul 08 23:07:26.388477 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.388426 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-host-var-lib-cni-multus\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.388477 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.388447 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/67c89124-1155-472f-879b-6d2fab0880dc-etc-selinux\") pod \"aws-ebs-csi-driver-node-fvjd8\" (UID: \"67c89124-1155-472f-879b-6d2fab0880dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjd8" Jul 08 23:07:26.388709 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.388480 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnj64\" (UniqueName: \"kubernetes.io/projected/68fda8d2-5fe9-40a0-8d69-a8ff51d15e23-kube-api-access-qnj64\") pod \"node-resolver-pfq7d\" (UID: \"68fda8d2-5fe9-40a0-8d69-a8ff51d15e23\") " pod="openshift-dns/node-resolver-pfq7d" Jul 08 23:07:26.388709 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.388514 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-etc-sysctl-conf\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.388709 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.388546 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/67c89124-1155-472f-879b-6d2fab0880dc-sys-fs\") pod \"aws-ebs-csi-driver-node-fvjd8\" (UID: \"67c89124-1155-472f-879b-6d2fab0880dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjd8" Jul 08 23:07:26.388709 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.388561 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/67c89124-1155-472f-879b-6d2fab0880dc-socket-dir\") pod \"aws-ebs-csi-driver-node-fvjd8\" (UID: \"67c89124-1155-472f-879b-6d2fab0880dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjd8" Jul 08 23:07:26.388709 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.388579 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-etc-systemd\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.388709 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.388605 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-hostroot\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.388709 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.388641 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-var-lib-kubelet\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.388709 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.388673 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4f14c98f-3358-494e-bde0-76dd7436a833-serviceca\") pod \"node-ca-42qwx\" (UID: \"4f14c98f-3358-494e-bde0-76dd7436a833\") " pod="openshift-image-registry/node-ca-42qwx" Jul 08 23:07:26.389102 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.388713 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-host-run-k8s-cni-cncf-io\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.389102 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.388745 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-host-var-lib-cni-bin\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.389102 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.388773 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-lib-modules\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.389102 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.388802 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-host\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.389102 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.388839 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-system-cni-dir\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.389102 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.388869 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-os-release\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.389102 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.388910 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/773549fb-9a77-46a7-bc5e-c7d401f89e95-multus-daemon-config\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.389102 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.388943 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-multus-cni-dir\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.389102 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.388974 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/559d9149-021d-4f5f-85f0-17474dea7b60-tmp\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.389102 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.389006 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk8wg\" (UniqueName: \"kubernetes.io/projected/4f14c98f-3358-494e-bde0-76dd7436a833-kube-api-access-sk8wg\") pod \"node-ca-42qwx\" (UID: \"4f14c98f-3358-494e-bde0-76dd7436a833\") " pod="openshift-image-registry/node-ca-42qwx" Jul 08 23:07:26.389102 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.389035 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-cnibin\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.389102 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.389062 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-multus-socket-dir-parent\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.389630 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.389129 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68fda8d2-5fe9-40a0-8d69-a8ff51d15e23-tmp-dir\") pod \"node-resolver-pfq7d\" (UID: \"68fda8d2-5fe9-40a0-8d69-a8ff51d15e23\") " pod="openshift-dns/node-resolver-pfq7d" Jul 08 23:07:26.389630 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.389183 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-multus-socket-dir-parent\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.389630 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.389262 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/67c89124-1155-472f-879b-6d2fab0880dc-device-dir\") pod \"aws-ebs-csi-driver-node-fvjd8\" (UID: \"67c89124-1155-472f-879b-6d2fab0880dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjd8" Jul 08 23:07:26.389630 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.389355 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/67c89124-1155-472f-879b-6d2fab0880dc-etc-selinux\") pod \"aws-ebs-csi-driver-node-fvjd8\" (UID: \"67c89124-1155-472f-879b-6d2fab0880dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjd8" Jul 08 23:07:26.389630 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.389402 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/171d5513-9470-4154-9a10-fd209122a411-host-slash\") pod \"iptables-alerter-4bwdd\" (UID: \"171d5513-9470-4154-9a10-fd209122a411\") " pod="openshift-network-operator/iptables-alerter-4bwdd" Jul 08 23:07:26.389863 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.389682 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-etc-sysctl-conf\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.389863 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.389684 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/68fda8d2-5fe9-40a0-8d69-a8ff51d15e23-hosts-file\") pod \"node-resolver-pfq7d\" (UID: \"68fda8d2-5fe9-40a0-8d69-a8ff51d15e23\") " pod="openshift-dns/node-resolver-pfq7d" Jul 08 23:07:26.389863 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.389728 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4f14c98f-3358-494e-bde0-76dd7436a833-host\") pod \"node-ca-42qwx\" (UID: \"4f14c98f-3358-494e-bde0-76dd7436a833\") " pod="openshift-image-registry/node-ca-42qwx" Jul 08 23:07:26.389863 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.389752 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/67c89124-1155-472f-879b-6d2fab0880dc-sys-fs\") pod \"aws-ebs-csi-driver-node-fvjd8\" (UID: \"67c89124-1155-472f-879b-6d2fab0880dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjd8" Jul 08 23:07:26.389863 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.389816 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-etc-systemd\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.389863 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.389824 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-system-cni-dir\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.390209 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.389870 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-hostroot\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.390209 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.389950 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-var-lib-kubelet\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.391086 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.390385 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/773549fb-9a77-46a7-bc5e-c7d401f89e95-multus-daemon-config\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.391086 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.390475 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-os-release\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.391086 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.390492 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-host-run-k8s-cni-cncf-io\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.391086 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.390508 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/559d9149-021d-4f5f-85f0-17474dea7b60-etc-tuned\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.391086 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.390542 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-multus-cni-dir\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.391086 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.390578 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-host-var-lib-cni-bin\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.391086 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.390602 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/773549fb-9a77-46a7-bc5e-c7d401f89e95-cnibin\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.391086 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.390710 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-lib-modules\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.391086 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.390769 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/559d9149-021d-4f5f-85f0-17474dea7b60-host\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.391594 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.391423 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1d37c23c-9492-45f3-8e9f-ef3855f05727-agent-certs\") pod \"konnectivity-agent-2bpwm\" (UID: \"1d37c23c-9492-45f3-8e9f-ef3855f05727\") " pod="kube-system/konnectivity-agent-2bpwm" Jul 08 23:07:26.392502 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.392479 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4f14c98f-3358-494e-bde0-76dd7436a833-serviceca\") pod \"node-ca-42qwx\" (UID: \"4f14c98f-3358-494e-bde0-76dd7436a833\") " pod="openshift-image-registry/node-ca-42qwx" Jul 08 23:07:26.393386 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.393297 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/559d9149-021d-4f5f-85f0-17474dea7b60-tmp\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.398786 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.398710 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnj64\" (UniqueName: \"kubernetes.io/projected/68fda8d2-5fe9-40a0-8d69-a8ff51d15e23-kube-api-access-qnj64\") pod \"node-resolver-pfq7d\" (UID: \"68fda8d2-5fe9-40a0-8d69-a8ff51d15e23\") " pod="openshift-dns/node-resolver-pfq7d" Jul 08 23:07:26.400116 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.399238 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdl57\" (UniqueName: \"kubernetes.io/projected/773549fb-9a77-46a7-bc5e-c7d401f89e95-kube-api-access-mdl57\") pod \"multus-wvtzz\" (UID: \"773549fb-9a77-46a7-bc5e-c7d401f89e95\") " pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.400116 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.399625 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64hg2\" (UniqueName: \"kubernetes.io/projected/171d5513-9470-4154-9a10-fd209122a411-kube-api-access-64hg2\") pod \"iptables-alerter-4bwdd\" (UID: \"171d5513-9470-4154-9a10-fd209122a411\") " pod="openshift-network-operator/iptables-alerter-4bwdd" Jul 08 23:07:26.400116 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.399988 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk8wg\" (UniqueName: \"kubernetes.io/projected/4f14c98f-3358-494e-bde0-76dd7436a833-kube-api-access-sk8wg\") pod \"node-ca-42qwx\" (UID: \"4f14c98f-3358-494e-bde0-76dd7436a833\") " pod="openshift-image-registry/node-ca-42qwx" Jul 08 23:07:26.400116 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.400059 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmlmv\" (UniqueName: \"kubernetes.io/projected/67c89124-1155-472f-879b-6d2fab0880dc-kube-api-access-rmlmv\") pod \"aws-ebs-csi-driver-node-fvjd8\" (UID: \"67c89124-1155-472f-879b-6d2fab0880dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjd8" Jul 08 23:07:26.401097 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.401057 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq27z\" (UniqueName: \"kubernetes.io/projected/559d9149-021d-4f5f-85f0-17474dea7b60-kube-api-access-kq27z\") pod \"tuned-vxf8t\" (UID: \"559d9149-021d-4f5f-85f0-17474dea7b60\") " pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.473323 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.473281 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zwfwd" Jul 08 23:07:26.483600 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.483570 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:26.494354 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.494328 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2bpwm" Jul 08 23:07:26.494951 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:26.494926 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e6e4143_1cbb_4df2_8d27_487fdecf06ea.slice/crio-d01035bf564193f94be248ee25c7b2881831f0a3f8377c49eb09a76bda3932a7 WatchSource:0}: Error finding container d01035bf564193f94be248ee25c7b2881831f0a3f8377c49eb09a76bda3932a7: Status 404 returned error can't find the container with id d01035bf564193f94be248ee25c7b2881831f0a3f8377c49eb09a76bda3932a7 Jul 08 23:07:26.500261 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.500215 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" Jul 08 23:07:26.508628 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.508600 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjd8" Jul 08 23:07:26.509642 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:26.509552 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d37c23c_9492_45f3_8e9f_ef3855f05727.slice/crio-b66d4d8f7a853645550bc6ab12e6ade83b848cbadeb53b4cbf650552193ea0e1 WatchSource:0}: Error finding container b66d4d8f7a853645550bc6ab12e6ade83b848cbadeb53b4cbf650552193ea0e1: Status 404 returned error can't find the container with id b66d4d8f7a853645550bc6ab12e6ade83b848cbadeb53b4cbf650552193ea0e1 Jul 08 23:07:26.517065 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.516769 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-42qwx" Jul 08 23:07:26.526767 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.526650 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pfq7d" Jul 08 23:07:26.529579 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:26.529554 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f14c98f_3358_494e_bde0_76dd7436a833.slice/crio-2dd8da0d1fc4d4abd2edcce477b6fb636d06c93a6d83d109ff053c32b66b9e89 WatchSource:0}: Error finding container 2dd8da0d1fc4d4abd2edcce477b6fb636d06c93a6d83d109ff053c32b66b9e89: Status 404 returned error can't find the container with id 2dd8da0d1fc4d4abd2edcce477b6fb636d06c93a6d83d109ff053c32b66b9e89 Jul 08 23:07:26.537290 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:26.537268 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68fda8d2_5fe9_40a0_8d69_a8ff51d15e23.slice/crio-1b25a2cccd64e7687097089fff7238ada0c4f0b6b6750d157906c11986bdc78c WatchSource:0}: Error finding container 1b25a2cccd64e7687097089fff7238ada0c4f0b6b6750d157906c11986bdc78c: Status 404 returned error can't find the container with id 1b25a2cccd64e7687097089fff7238ada0c4f0b6b6750d157906c11986bdc78c Jul 08 23:07:26.537399 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.537384 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wvtzz" Jul 08 23:07:26.544281 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.544267 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4bwdd" Jul 08 23:07:26.547964 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:26.547943 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod773549fb_9a77_46a7_bc5e_c7d401f89e95.slice/crio-876e56c4e63b688290ae3c4bd731cd560a595791f2d951aaec65e521dc180356 WatchSource:0}: Error finding container 876e56c4e63b688290ae3c4bd731cd560a595791f2d951aaec65e521dc180356: Status 404 returned error can't find the container with id 876e56c4e63b688290ae3c4bd731cd560a595791f2d951aaec65e521dc180356 Jul 08 23:07:26.556984 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:07:26.556965 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod171d5513_9470_4154_9a10_fd209122a411.slice/crio-7ff639fccdacaaaa6d484f2d0fc8b5182de96bf36b2643401d0d91c33012abae WatchSource:0}: Error finding container 7ff639fccdacaaaa6d484f2d0fc8b5182de96bf36b2643401d0d91c33012abae: Status 404 returned error can't find the container with id 7ff639fccdacaaaa6d484f2d0fc8b5182de96bf36b2643401d0d91c33012abae Jul 08 23:07:26.791353 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.791323 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs\") pod \"network-metrics-daemon-kwcdm\" (UID: \"3d290d52-819f-4ece-bc8e-11ce3dbb4d29\") " pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:07:26.791512 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.791362 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-original-pull-secret\") pod \"global-pull-secret-syncer-2p25w\" (UID: \"19cfadf2-80c1-49c5-b9ff-29c372a05a7f\") " pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:26.791512 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:26.791483 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 23:07:26.791629 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:26.791543 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-original-pull-secret podName:19cfadf2-80c1-49c5-b9ff-29c372a05a7f nodeName:}" failed. No retries permitted until 2026-07-08 23:07:27.791526814 +0000 UTC m=+3.950810307 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-original-pull-secret") pod "global-pull-secret-syncer-2p25w" (UID: "19cfadf2-80c1-49c5-b9ff-29c372a05a7f") : object "kube-system"/"original-pull-secret" not registered Jul 08 23:07:26.791629 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:26.791483 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 23:07:26.791715 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:26.791646 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs podName:3d290d52-819f-4ece-bc8e-11ce3dbb4d29 nodeName:}" failed. No retries permitted until 2026-07-08 23:07:27.791624045 +0000 UTC m=+3.950907547 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs") pod "network-metrics-daemon-kwcdm" (UID: "3d290d52-819f-4ece-bc8e-11ce3dbb4d29") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 23:07:26.892202 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:26.892130 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkxw9\" (UniqueName: \"kubernetes.io/projected/29b0e180-c5ba-4775-888e-f57cd955a7ab-kube-api-access-dkxw9\") pod \"network-check-target-8cr2z\" (UID: \"29b0e180-c5ba-4775-888e-f57cd955a7ab\") " pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:07:26.892358 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:26.892277 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 23:07:26.892358 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:26.892295 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 23:07:26.892358 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:26.892305 2572 projected.go:196] Error preparing data for projected volume kube-api-access-dkxw9 for pod openshift-network-diagnostics/network-check-target-8cr2z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 23:07:26.892358 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:26.892358 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29b0e180-c5ba-4775-888e-f57cd955a7ab-kube-api-access-dkxw9 podName:29b0e180-c5ba-4775-888e-f57cd955a7ab nodeName:}" failed. No retries permitted until 2026-07-08 23:07:27.892345581 +0000 UTC m=+4.051629072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dkxw9" (UniqueName: "kubernetes.io/projected/29b0e180-c5ba-4775-888e-f57cd955a7ab-kube-api-access-dkxw9") pod "network-check-target-8cr2z" (UID: "29b0e180-c5ba-4775-888e-f57cd955a7ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 23:07:27.219395 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:27.219294 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 23:02:26 +0000 UTC" deadline="2028-01-01 03:29:54.191817174 +0000 UTC" Jul 08 23:07:27.219395 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:27.219341 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12988h22m26.972478609s" Jul 08 23:07:27.333922 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:27.333843 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4bwdd" event={"ID":"171d5513-9470-4154-9a10-fd209122a411","Type":"ContainerStarted","Data":"7ff639fccdacaaaa6d484f2d0fc8b5182de96bf36b2643401d0d91c33012abae"} Jul 08 23:07:27.335689 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:27.335649 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wvtzz" event={"ID":"773549fb-9a77-46a7-bc5e-c7d401f89e95","Type":"ContainerStarted","Data":"876e56c4e63b688290ae3c4bd731cd560a595791f2d951aaec65e521dc180356"} Jul 08 23:07:27.336839 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:27.336786 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pfq7d" event={"ID":"68fda8d2-5fe9-40a0-8d69-a8ff51d15e23","Type":"ContainerStarted","Data":"1b25a2cccd64e7687097089fff7238ada0c4f0b6b6750d157906c11986bdc78c"} Jul 08 23:07:27.338114 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:27.338070 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" event={"ID":"559d9149-021d-4f5f-85f0-17474dea7b60","Type":"ContainerStarted","Data":"37cca8fca08dccc068b8d452c322896bde4366fb72216aec013411507413ff2f"} Jul 08 23:07:27.339282 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:27.339256 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2bpwm" event={"ID":"1d37c23c-9492-45f3-8e9f-ef3855f05727","Type":"ContainerStarted","Data":"b66d4d8f7a853645550bc6ab12e6ade83b848cbadeb53b4cbf650552193ea0e1"} Jul 08 23:07:27.341129 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:27.341096 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" event={"ID":"4e6e4143-1cbb-4df2-8d27-487fdecf06ea","Type":"ContainerStarted","Data":"d01035bf564193f94be248ee25c7b2881831f0a3f8377c49eb09a76bda3932a7"} Jul 08 23:07:27.342410 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:27.342288 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-42qwx" event={"ID":"4f14c98f-3358-494e-bde0-76dd7436a833","Type":"ContainerStarted","Data":"2dd8da0d1fc4d4abd2edcce477b6fb636d06c93a6d83d109ff053c32b66b9e89"} Jul 08 23:07:27.343636 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:27.343616 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjd8" event={"ID":"67c89124-1155-472f-879b-6d2fab0880dc","Type":"ContainerStarted","Data":"9030fb8fe18a13e3365dac0018100c681db91f5a32f40c033aed0c9276f599ba"} Jul 08 23:07:27.344888 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:27.344865 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwfwd" event={"ID":"563c7484-0036-46e3-81fd-e0809d864d8c","Type":"ContainerStarted","Data":"53721da42c17288ce62c0c06f639c278c16a4546230dc59dcc3742d123a92bb9"} Jul 08 23:07:27.801483 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:27.801253 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs\") pod \"network-metrics-daemon-kwcdm\" (UID: \"3d290d52-819f-4ece-bc8e-11ce3dbb4d29\") " pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:07:27.801483 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:27.801307 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-original-pull-secret\") pod \"global-pull-secret-syncer-2p25w\" (UID: \"19cfadf2-80c1-49c5-b9ff-29c372a05a7f\") " pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:27.801483 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:27.801459 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 23:07:27.801759 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:27.801453 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 23:07:27.801759 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:27.801521 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-original-pull-secret podName:19cfadf2-80c1-49c5-b9ff-29c372a05a7f nodeName:}" failed. No retries permitted until 2026-07-08 23:07:29.801503705 +0000 UTC m=+5.960787194 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-original-pull-secret") pod "global-pull-secret-syncer-2p25w" (UID: "19cfadf2-80c1-49c5-b9ff-29c372a05a7f") : object "kube-system"/"original-pull-secret" not registered Jul 08 23:07:27.801759 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:27.801584 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs podName:3d290d52-819f-4ece-bc8e-11ce3dbb4d29 nodeName:}" failed. No retries permitted until 2026-07-08 23:07:29.801564604 +0000 UTC m=+5.960848116 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs") pod "network-metrics-daemon-kwcdm" (UID: "3d290d52-819f-4ece-bc8e-11ce3dbb4d29") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 23:07:27.902759 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:27.902622 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkxw9\" (UniqueName: \"kubernetes.io/projected/29b0e180-c5ba-4775-888e-f57cd955a7ab-kube-api-access-dkxw9\") pod \"network-check-target-8cr2z\" (UID: \"29b0e180-c5ba-4775-888e-f57cd955a7ab\") " pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:07:27.902870 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:27.902791 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 23:07:27.902870 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:27.902814 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 23:07:27.902870 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:27.902827 2572 projected.go:196] Error preparing data for projected volume kube-api-access-dkxw9 for pod openshift-network-diagnostics/network-check-target-8cr2z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 23:07:27.903029 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:27.902888 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29b0e180-c5ba-4775-888e-f57cd955a7ab-kube-api-access-dkxw9 podName:29b0e180-c5ba-4775-888e-f57cd955a7ab nodeName:}" failed. No retries permitted until 2026-07-08 23:07:29.902869725 +0000 UTC m=+6.062153217 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dkxw9" (UniqueName: "kubernetes.io/projected/29b0e180-c5ba-4775-888e-f57cd955a7ab-kube-api-access-dkxw9") pod "network-check-target-8cr2z" (UID: "29b0e180-c5ba-4775-888e-f57cd955a7ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 23:07:28.219839 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:28.219773 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 23:02:26 +0000 UTC" deadline="2028-04-03 00:30:28.60641522 +0000 UTC" Jul 08 23:07:28.219839 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:28.219810 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15217h23m0.386609991s" Jul 08 23:07:28.328081 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:28.328013 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:28.328230 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:28.328148 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p25w" podUID="19cfadf2-80c1-49c5-b9ff-29c372a05a7f" Jul 08 23:07:28.328561 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:28.328542 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:07:28.328691 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:28.328647 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwcdm" podUID="3d290d52-819f-4ece-bc8e-11ce3dbb4d29" Jul 08 23:07:28.329319 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:28.329297 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:07:28.329428 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:28.329390 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cr2z" podUID="29b0e180-c5ba-4775-888e-f57cd955a7ab" Jul 08 23:07:28.366865 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:28.366212 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-37.ec2.internal" event={"ID":"c30d50af267f54e89a2e53ab8e34c4f0","Type":"ContainerStarted","Data":"b136da240366fe8427dba8951258c343ee1872dd4902fcbd2fd720bc7a2f9fbd"} Jul 08 23:07:29.394796 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:29.394753 2572 generic.go:356] "Generic (PLEG): container finished" podID="ab9c400afd6d2292d4bb39e251d603d3" containerID="4197215473de0b1a47699ac0187df708df402f29d7de003c4aa00b8f4df3d4b4" exitCode=0 Jul 08 23:07:29.395753 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:29.395726 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-37.ec2.internal" event={"ID":"ab9c400afd6d2292d4bb39e251d603d3","Type":"ContainerDied","Data":"4197215473de0b1a47699ac0187df708df402f29d7de003c4aa00b8f4df3d4b4"} Jul 08 23:07:29.411437 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:29.411379 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-37.ec2.internal" podStartSLOduration=4.411359679 podStartE2EDuration="4.411359679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:07:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:07:28.381756838 +0000 UTC m=+4.541040349" watchObservedRunningTime="2026-07-08 23:07:29.411359679 +0000 UTC m=+5.570643191" Jul 08 23:07:29.826888 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:29.826810 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs\") pod \"network-metrics-daemon-kwcdm\" (UID: \"3d290d52-819f-4ece-bc8e-11ce3dbb4d29\") " pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:07:29.826888 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:29.826862 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-original-pull-secret\") pod \"global-pull-secret-syncer-2p25w\" (UID: \"19cfadf2-80c1-49c5-b9ff-29c372a05a7f\") " pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:29.827123 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:29.827032 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 23:07:29.827123 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:29.827089 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-original-pull-secret podName:19cfadf2-80c1-49c5-b9ff-29c372a05a7f nodeName:}" failed. No retries permitted until 2026-07-08 23:07:33.827071906 +0000 UTC m=+9.986355397 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-original-pull-secret") pod "global-pull-secret-syncer-2p25w" (UID: "19cfadf2-80c1-49c5-b9ff-29c372a05a7f") : object "kube-system"/"original-pull-secret" not registered Jul 08 23:07:29.827322 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:29.827304 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 23:07:29.827380 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:29.827363 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs podName:3d290d52-819f-4ece-bc8e-11ce3dbb4d29 nodeName:}" failed. No retries permitted until 2026-07-08 23:07:33.827347086 +0000 UTC m=+9.986630586 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs") pod "network-metrics-daemon-kwcdm" (UID: "3d290d52-819f-4ece-bc8e-11ce3dbb4d29") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 23:07:29.928024 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:29.927991 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkxw9\" (UniqueName: \"kubernetes.io/projected/29b0e180-c5ba-4775-888e-f57cd955a7ab-kube-api-access-dkxw9\") pod \"network-check-target-8cr2z\" (UID: \"29b0e180-c5ba-4775-888e-f57cd955a7ab\") " pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:07:29.928223 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:29.928208 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 23:07:29.928290 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:29.928233 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 23:07:29.928290 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:29.928246 2572 projected.go:196] Error preparing data for projected volume kube-api-access-dkxw9 for pod openshift-network-diagnostics/network-check-target-8cr2z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 23:07:29.928387 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:29.928298 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29b0e180-c5ba-4775-888e-f57cd955a7ab-kube-api-access-dkxw9 podName:29b0e180-c5ba-4775-888e-f57cd955a7ab nodeName:}" failed. No retries permitted until 2026-07-08 23:07:33.928281923 +0000 UTC m=+10.087565425 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dkxw9" (UniqueName: "kubernetes.io/projected/29b0e180-c5ba-4775-888e-f57cd955a7ab-kube-api-access-dkxw9") pod "network-check-target-8cr2z" (UID: "29b0e180-c5ba-4775-888e-f57cd955a7ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 23:07:30.328550 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:30.328525 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:07:30.328724 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:30.328690 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cr2z" podUID="29b0e180-c5ba-4775-888e-f57cd955a7ab" Jul 08 23:07:30.329383 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:30.329095 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:30.329383 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:30.329198 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p25w" podUID="19cfadf2-80c1-49c5-b9ff-29c372a05a7f" Jul 08 23:07:30.329383 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:30.329226 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:07:30.329383 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:30.329336 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwcdm" podUID="3d290d52-819f-4ece-bc8e-11ce3dbb4d29" Jul 08 23:07:32.324079 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:32.323887 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:32.324079 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:32.324039 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p25w" podUID="19cfadf2-80c1-49c5-b9ff-29c372a05a7f" Jul 08 23:07:32.324578 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:32.324416 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:07:32.324578 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:32.324511 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwcdm" podUID="3d290d52-819f-4ece-bc8e-11ce3dbb4d29" Jul 08 23:07:32.324692 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:32.324583 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:07:32.324692 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:32.324659 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cr2z" podUID="29b0e180-c5ba-4775-888e-f57cd955a7ab" Jul 08 23:07:33.859395 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:33.859360 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs\") pod \"network-metrics-daemon-kwcdm\" (UID: \"3d290d52-819f-4ece-bc8e-11ce3dbb4d29\") " pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:07:33.859860 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:33.859414 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-original-pull-secret\") pod \"global-pull-secret-syncer-2p25w\" (UID: \"19cfadf2-80c1-49c5-b9ff-29c372a05a7f\") " pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:33.859860 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:33.859571 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 23:07:33.859860 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:33.859620 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-original-pull-secret podName:19cfadf2-80c1-49c5-b9ff-29c372a05a7f nodeName:}" failed. No retries permitted until 2026-07-08 23:07:41.859608221 +0000 UTC m=+18.018891709 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-original-pull-secret") pod "global-pull-secret-syncer-2p25w" (UID: "19cfadf2-80c1-49c5-b9ff-29c372a05a7f") : object "kube-system"/"original-pull-secret" not registered Jul 08 23:07:33.860061 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:33.860035 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 23:07:33.860116 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:33.860090 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs podName:3d290d52-819f-4ece-bc8e-11ce3dbb4d29 nodeName:}" failed. No retries permitted until 2026-07-08 23:07:41.860072748 +0000 UTC m=+18.019356248 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs") pod "network-metrics-daemon-kwcdm" (UID: "3d290d52-819f-4ece-bc8e-11ce3dbb4d29") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 23:07:33.960783 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:33.960746 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkxw9\" (UniqueName: \"kubernetes.io/projected/29b0e180-c5ba-4775-888e-f57cd955a7ab-kube-api-access-dkxw9\") pod \"network-check-target-8cr2z\" (UID: \"29b0e180-c5ba-4775-888e-f57cd955a7ab\") " pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:07:33.960973 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:33.960916 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 23:07:33.960973 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:33.960941 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 23:07:33.960973 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:33.960955 2572 projected.go:196] Error preparing data for projected volume kube-api-access-dkxw9 for pod openshift-network-diagnostics/network-check-target-8cr2z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 23:07:33.961089 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:33.961017 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29b0e180-c5ba-4775-888e-f57cd955a7ab-kube-api-access-dkxw9 podName:29b0e180-c5ba-4775-888e-f57cd955a7ab nodeName:}" failed. No retries permitted until 2026-07-08 23:07:41.961000557 +0000 UTC m=+18.120284066 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dkxw9" (UniqueName: "kubernetes.io/projected/29b0e180-c5ba-4775-888e-f57cd955a7ab-kube-api-access-dkxw9") pod "network-check-target-8cr2z" (UID: "29b0e180-c5ba-4775-888e-f57cd955a7ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 23:07:34.325114 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:34.325028 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:34.325114 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:34.325046 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:07:34.325324 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:34.325134 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p25w" podUID="19cfadf2-80c1-49c5-b9ff-29c372a05a7f" Jul 08 23:07:34.325324 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:34.325207 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cr2z" podUID="29b0e180-c5ba-4775-888e-f57cd955a7ab" Jul 08 23:07:34.325324 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:34.325229 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:07:34.325446 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:34.325345 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwcdm" podUID="3d290d52-819f-4ece-bc8e-11ce3dbb4d29" Jul 08 23:07:36.324231 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:36.324197 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:36.324678 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:36.324329 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p25w" podUID="19cfadf2-80c1-49c5-b9ff-29c372a05a7f" Jul 08 23:07:36.324678 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:36.324361 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:07:36.324678 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:36.324409 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:07:36.324678 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:36.324536 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cr2z" podUID="29b0e180-c5ba-4775-888e-f57cd955a7ab" Jul 08 23:07:36.324678 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:36.324649 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwcdm" podUID="3d290d52-819f-4ece-bc8e-11ce3dbb4d29" Jul 08 23:07:38.324641 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:38.324361 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:38.325150 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:38.324697 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p25w" podUID="19cfadf2-80c1-49c5-b9ff-29c372a05a7f" Jul 08 23:07:38.325150 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:38.324404 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:07:38.325150 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:38.324360 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:07:38.325150 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:38.324785 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cr2z" podUID="29b0e180-c5ba-4775-888e-f57cd955a7ab" Jul 08 23:07:38.325150 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:38.324882 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwcdm" podUID="3d290d52-819f-4ece-bc8e-11ce3dbb4d29" Jul 08 23:07:38.415682 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:38.415644 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pfq7d" event={"ID":"68fda8d2-5fe9-40a0-8d69-a8ff51d15e23","Type":"ContainerStarted","Data":"fd6a4f990f4607d636fdd62d347dce0fc6c487c2cb55500b65a64e00ff6f5cde"} Jul 08 23:07:38.417808 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:38.417781 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" event={"ID":"559d9149-021d-4f5f-85f0-17474dea7b60","Type":"ContainerStarted","Data":"c25c5b5c94fa3f6eedd4724ff9da3760d5eb887ab9c091955a22e99c10bcb192"} Jul 08 23:07:38.419579 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:38.419557 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2bpwm" event={"ID":"1d37c23c-9492-45f3-8e9f-ef3855f05727","Type":"ContainerStarted","Data":"fe48580f527b48c52feee52ae66693000e85ce3dfcb830f3962bf4aa6c89d01a"} Jul 08 23:07:38.421328 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:38.421300 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-42qwx" event={"ID":"4f14c98f-3358-494e-bde0-76dd7436a833","Type":"ContainerStarted","Data":"2be00b2417ede2a86d39a4932cdc861a77b173cc3213afb58cd3ffcb6467d46f"} Jul 08 23:07:38.422980 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:38.422928 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjd8" event={"ID":"67c89124-1155-472f-879b-6d2fab0880dc","Type":"ContainerStarted","Data":"7792c6109555ca18e6846a8c211a146c5c918310eb46b56658892b5ba0c561dc"} Jul 08 23:07:38.424698 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:38.424666 2572 generic.go:356] "Generic (PLEG): container finished" podID="563c7484-0036-46e3-81fd-e0809d864d8c" containerID="3b117abc097f2f4d52f71685deb4efdd7d41f3cea497a51d836dcd9d0a3e9bc6" exitCode=0 Jul 08 23:07:38.424803 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:38.424746 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwfwd" event={"ID":"563c7484-0036-46e3-81fd-e0809d864d8c","Type":"ContainerDied","Data":"3b117abc097f2f4d52f71685deb4efdd7d41f3cea497a51d836dcd9d0a3e9bc6"} Jul 08 23:07:38.427303 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:38.427256 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-37.ec2.internal" event={"ID":"ab9c400afd6d2292d4bb39e251d603d3","Type":"ContainerStarted","Data":"9a0902371922e9162a40fec05826127fa9b126b0a126cbe3ae77ba0bb322e5b3"} Jul 08 23:07:38.443180 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:38.443135 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pfq7d" podStartSLOduration=3.667779607 podStartE2EDuration="14.443122038s" totalImagesPullingTime="10.775342431s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:07:38.429405096 +0000 UTC m=+14.588688608" watchObservedRunningTime="2026-07-08 23:07:38.443122038 +0000 UTC m=+14.602405546" Jul 08 23:07:38.443365 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:38.443342 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2bpwm" podStartSLOduration=3.639133794 podStartE2EDuration="14.443336348s" totalImagesPullingTime="10.804202554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:07:38.442479075 +0000 UTC m=+14.601762583" watchObservedRunningTime="2026-07-08 23:07:38.443336348 +0000 UTC m=+14.602619856" Jul 08 23:07:38.463184 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:38.463132 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vxf8t" podStartSLOduration=3.6641789080000002 podStartE2EDuration="14.463115908s" totalImagesPullingTime="10.798937s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:07:38.462743856 +0000 UTC m=+14.622027369" watchObservedRunningTime="2026-07-08 23:07:38.463115908 +0000 UTC m=+14.622399418" Jul 08 23:07:38.477216 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:38.477174 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-42qwx" podStartSLOduration=3.72468696 podStartE2EDuration="14.477157834s" totalImagesPullingTime="10.752470874s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:07:38.476584735 +0000 UTC m=+14.635868247" watchObservedRunningTime="2026-07-08 23:07:38.477157834 +0000 UTC m=+14.636441346" Jul 08 23:07:38.523906 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:38.523845 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-37.ec2.internal" podStartSLOduration=13.52383149 podStartE2EDuration="13.52383149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:07:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:07:38.498040591 +0000 UTC m=+14.657324100" watchObservedRunningTime="2026-07-08 23:07:38.52383149 +0000 UTC m=+14.683114999" Jul 08 23:07:39.430522 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:39.430483 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4bwdd" event={"ID":"171d5513-9470-4154-9a10-fd209122a411","Type":"ContainerStarted","Data":"b343f875e0ea543727d0cdcd515046ace20c4b8f738028e2e4b9d09e3e3ee671"} Jul 08 23:07:39.445637 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:39.445594 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4bwdd" podStartSLOduration=4.681275095 podStartE2EDuration="15.445582015s" totalImagesPullingTime="10.76430692s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:07:39.445318978 +0000 UTC m=+15.604602490" watchObservedRunningTime="2026-07-08 23:07:39.445582015 +0000 UTC m=+15.604865570" Jul 08 23:07:39.720730 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:39.720648 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2bpwm" Jul 08 23:07:39.721298 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:39.721278 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2bpwm" Jul 08 23:07:40.324014 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:40.323952 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:40.324014 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:40.323973 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:07:40.324254 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:40.323954 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:07:40.324254 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:40.324070 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p25w" podUID="19cfadf2-80c1-49c5-b9ff-29c372a05a7f" Jul 08 23:07:40.324254 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:40.324143 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwcdm" podUID="3d290d52-819f-4ece-bc8e-11ce3dbb4d29" Jul 08 23:07:40.324254 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:40.324235 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cr2z" podUID="29b0e180-c5ba-4775-888e-f57cd955a7ab" Jul 08 23:07:41.434088 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:41.434059 2572 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 23:07:41.922924 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:41.922879 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs\") pod \"network-metrics-daemon-kwcdm\" (UID: \"3d290d52-819f-4ece-bc8e-11ce3dbb4d29\") " pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:07:41.922924 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:41.922929 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-original-pull-secret\") pod \"global-pull-secret-syncer-2p25w\" (UID: \"19cfadf2-80c1-49c5-b9ff-29c372a05a7f\") " pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:41.923132 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:41.923034 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 23:07:41.923132 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:41.923041 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 23:07:41.923132 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:41.923100 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-original-pull-secret podName:19cfadf2-80c1-49c5-b9ff-29c372a05a7f nodeName:}" failed. No retries permitted until 2026-07-08 23:07:57.923081425 +0000 UTC m=+34.082364915 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-original-pull-secret") pod "global-pull-secret-syncer-2p25w" (UID: "19cfadf2-80c1-49c5-b9ff-29c372a05a7f") : object "kube-system"/"original-pull-secret" not registered Jul 08 23:07:41.923132 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:41.923120 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs podName:3d290d52-819f-4ece-bc8e-11ce3dbb4d29 nodeName:}" failed. No retries permitted until 2026-07-08 23:07:57.92310914 +0000 UTC m=+34.082392627 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs") pod "network-metrics-daemon-kwcdm" (UID: "3d290d52-819f-4ece-bc8e-11ce3dbb4d29") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 23:07:42.023597 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:42.023561 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkxw9\" (UniqueName: \"kubernetes.io/projected/29b0e180-c5ba-4775-888e-f57cd955a7ab-kube-api-access-dkxw9\") pod \"network-check-target-8cr2z\" (UID: \"29b0e180-c5ba-4775-888e-f57cd955a7ab\") " pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:07:42.023763 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:42.023696 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 23:07:42.023763 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:42.023714 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 23:07:42.023763 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:42.023726 2572 projected.go:196] Error preparing data for projected volume kube-api-access-dkxw9 for pod openshift-network-diagnostics/network-check-target-8cr2z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 23:07:42.023941 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:42.023778 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29b0e180-c5ba-4775-888e-f57cd955a7ab-kube-api-access-dkxw9 podName:29b0e180-c5ba-4775-888e-f57cd955a7ab nodeName:}" failed. No retries permitted until 2026-07-08 23:07:58.023763481 +0000 UTC m=+34.183046971 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dkxw9" (UniqueName: "kubernetes.io/projected/29b0e180-c5ba-4775-888e-f57cd955a7ab-kube-api-access-dkxw9") pod "network-check-target-8cr2z" (UID: "29b0e180-c5ba-4775-888e-f57cd955a7ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 23:07:42.324254 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:42.324218 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:42.324254 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:42.324238 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:07:42.324494 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:42.324219 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:07:42.324742 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:42.324713 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwcdm" podUID="3d290d52-819f-4ece-bc8e-11ce3dbb4d29" Jul 08 23:07:42.324866 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:42.324847 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p25w" podUID="19cfadf2-80c1-49c5-b9ff-29c372a05a7f" Jul 08 23:07:42.325001 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:42.324367 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cr2z" podUID="29b0e180-c5ba-4775-888e-f57cd955a7ab" Jul 08 23:07:44.325847 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:44.325752 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:44.325847 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:44.325837 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:07:44.326479 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:44.325879 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:07:44.326479 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:44.325888 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p25w" podUID="19cfadf2-80c1-49c5-b9ff-29c372a05a7f" Jul 08 23:07:44.326479 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:44.325970 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwcdm" podUID="3d290d52-819f-4ece-bc8e-11ce3dbb4d29" Jul 08 23:07:44.326479 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:44.326078 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cr2z" podUID="29b0e180-c5ba-4775-888e-f57cd955a7ab" Jul 08 23:07:46.324246 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:46.324217 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:07:46.324246 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:46.324246 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:07:46.324643 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:46.324217 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:46.324643 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:46.324320 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwcdm" podUID="3d290d52-819f-4ece-bc8e-11ce3dbb4d29" Jul 08 23:07:46.324643 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:46.324392 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p25w" podUID="19cfadf2-80c1-49c5-b9ff-29c372a05a7f" Jul 08 23:07:46.324643 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:46.324444 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cr2z" podUID="29b0e180-c5ba-4775-888e-f57cd955a7ab" Jul 08 23:07:48.324352 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:48.324180 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:07:48.324691 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:48.324180 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:48.324691 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:48.324440 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwcdm" podUID="3d290d52-819f-4ece-bc8e-11ce3dbb4d29" Jul 08 23:07:48.324691 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:48.324222 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:07:48.324691 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:48.324515 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p25w" podUID="19cfadf2-80c1-49c5-b9ff-29c372a05a7f" Jul 08 23:07:48.324691 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:48.324612 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cr2z" podUID="29b0e180-c5ba-4775-888e-f57cd955a7ab" Jul 08 23:07:48.449676 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:48.449640 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wvtzz" event={"ID":"773549fb-9a77-46a7-bc5e-c7d401f89e95","Type":"ContainerStarted","Data":"dba5e05ad6231926c317bf58320c0ced8062568b6adf6294244b16fdaac22695"} Jul 08 23:07:48.451151 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:48.451125 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" event={"ID":"4e6e4143-1cbb-4df2-8d27-487fdecf06ea","Type":"ContainerStarted","Data":"7e4bede96a4f9dcc28c417ce28594565344b662d1e1b2f0346cb153339193940"} Jul 08 23:07:48.469662 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:48.469622 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wvtzz" podStartSLOduration=2.83552119 podStartE2EDuration="24.46961044s" totalImagesPullingTime="21.63408925s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:07:48.469488351 +0000 UTC m=+24.628771860" watchObservedRunningTime="2026-07-08 23:07:48.46961044 +0000 UTC m=+24.628893949" Jul 08 23:07:48.953498 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:48.953457 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 23:07:49.133023 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:49.132996 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2bpwm" Jul 08 23:07:49.133174 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:49.133156 2572 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 23:07:49.133467 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:49.133446 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2bpwm" Jul 08 23:07:49.261839 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:49.261755 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T23:07:48.953475755Z","UUID":"30d8bd06-187c-4f76-8229-7d064e117b5c","Handler":null,"Name":"","Endpoint":""} Jul 08 23:07:49.263401 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:49.263383 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 23:07:49.263500 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:49.263410 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 23:07:49.456141 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:49.456110 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" event={"ID":"4e6e4143-1cbb-4df2-8d27-487fdecf06ea","Type":"ContainerStarted","Data":"3dec7c791ea2c3af460a76d497b55a7ddf491595df0ec896c20389644a0aad11"} Jul 08 23:07:49.456650 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:49.456179 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" event={"ID":"4e6e4143-1cbb-4df2-8d27-487fdecf06ea","Type":"ContainerStarted","Data":"4498f297b93a1d925a23c9d2c9812941b75af9d060f831b0db49fa90a18f9e4a"} Jul 08 23:07:49.456650 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:49.456211 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" event={"ID":"4e6e4143-1cbb-4df2-8d27-487fdecf06ea","Type":"ContainerStarted","Data":"2ef6c5a107266ac82eabb5bff9e0c7e20c04d299b203b319ecaa307cabc4a649"} Jul 08 23:07:49.456650 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:49.456247 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" event={"ID":"4e6e4143-1cbb-4df2-8d27-487fdecf06ea","Type":"ContainerStarted","Data":"2ae082c34300e06cf62059e4a6db65675a7452259ffb116b5049260041497e5f"} Jul 08 23:07:49.456650 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:49.456276 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" event={"ID":"4e6e4143-1cbb-4df2-8d27-487fdecf06ea","Type":"ContainerStarted","Data":"576000827a117d6c26a9fbbf0c32255231cff8751725dcf3f41896e8990da6d7"} Jul 08 23:07:49.457773 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:49.457751 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjd8" event={"ID":"67c89124-1155-472f-879b-6d2fab0880dc","Type":"ContainerStarted","Data":"56225c693704c41b6f82b86f96af8aa4485237643d0d4ce0957a5660d795cbfc"} Jul 08 23:07:49.459395 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:49.459371 2572 generic.go:356] "Generic (PLEG): container finished" podID="563c7484-0036-46e3-81fd-e0809d864d8c" containerID="2cdf09968ebdff60e90ff5a770e5d6ace54d741ea5e7a709dfe94a73cc55d5ae" exitCode=0 Jul 08 23:07:49.459490 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:49.459461 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwfwd" event={"ID":"563c7484-0036-46e3-81fd-e0809d864d8c","Type":"ContainerDied","Data":"2cdf09968ebdff60e90ff5a770e5d6ace54d741ea5e7a709dfe94a73cc55d5ae"} Jul 08 23:07:50.324020 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:50.323981 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:50.324020 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:50.324006 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:07:50.324348 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:50.324116 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p25w" podUID="19cfadf2-80c1-49c5-b9ff-29c372a05a7f" Jul 08 23:07:50.324348 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:50.324169 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:07:50.324348 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:50.324295 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwcdm" podUID="3d290d52-819f-4ece-bc8e-11ce3dbb4d29" Jul 08 23:07:50.324500 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:50.324372 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cr2z" podUID="29b0e180-c5ba-4775-888e-f57cd955a7ab" Jul 08 23:07:51.466915 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:51.466825 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" event={"ID":"4e6e4143-1cbb-4df2-8d27-487fdecf06ea","Type":"ContainerStarted","Data":"28e47ff280ca202fdfbdc8c879fdfe36afaf50bd735b819e47dfb58583720f55"} Jul 08 23:07:51.468736 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:51.468709 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjd8" event={"ID":"67c89124-1155-472f-879b-6d2fab0880dc","Type":"ContainerStarted","Data":"2cd533843ee73cae4ce78492a2dda6774a23ccab95c93ffb785c4ea17439f7a9"} Jul 08 23:07:51.470663 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:51.470631 2572 generic.go:356] "Generic (PLEG): container finished" podID="563c7484-0036-46e3-81fd-e0809d864d8c" containerID="707ad8ce6775418babaaadf4d1074d6d851ab8bfa855faff6d0e33a51079af7a" exitCode=0 Jul 08 23:07:51.470663 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:51.470662 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwfwd" event={"ID":"563c7484-0036-46e3-81fd-e0809d864d8c","Type":"ContainerDied","Data":"707ad8ce6775418babaaadf4d1074d6d851ab8bfa855faff6d0e33a51079af7a"} Jul 08 23:07:51.485113 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:51.485080 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjd8" podStartSLOduration=3.587148238 podStartE2EDuration="27.485069496s" totalImagesPullingTime="23.897921258s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:07:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:07:51.48506171 +0000 UTC m=+27.644345220" watchObservedRunningTime="2026-07-08 23:07:51.485069496 +0000 UTC m=+27.644353005" Jul 08 23:07:52.324393 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:52.324356 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:07:52.324564 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:52.324398 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:52.324564 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:52.324479 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:07:52.324564 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:52.324497 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cr2z" podUID="29b0e180-c5ba-4775-888e-f57cd955a7ab" Jul 08 23:07:52.324686 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:52.324567 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwcdm" podUID="3d290d52-819f-4ece-bc8e-11ce3dbb4d29" Jul 08 23:07:52.324686 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:52.324628 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p25w" podUID="19cfadf2-80c1-49c5-b9ff-29c372a05a7f" Jul 08 23:07:53.481264 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:53.480866 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" event={"ID":"4e6e4143-1cbb-4df2-8d27-487fdecf06ea","Type":"ContainerStarted","Data":"9d8a8dde333c5a89718f9ac211350f64ace8d5d4da498822eee0d3a76a846fcd"} Jul 08 23:07:53.482281 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:53.481365 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:53.482281 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:53.481440 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:53.484248 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:53.483796 2572 generic.go:356] "Generic (PLEG): container finished" podID="563c7484-0036-46e3-81fd-e0809d864d8c" containerID="909607e86db5f18dd73b7abcb54da1e6fef42cd13ebfe876f34dc4490ac6fcd5" exitCode=0 Jul 08 23:07:53.484248 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:53.483832 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwfwd" event={"ID":"563c7484-0036-46e3-81fd-e0809d864d8c","Type":"ContainerDied","Data":"909607e86db5f18dd73b7abcb54da1e6fef42cd13ebfe876f34dc4490ac6fcd5"} Jul 08 23:07:53.500090 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:53.500071 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:53.513657 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:53.513623 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" podStartSLOduration=7.789662395 podStartE2EDuration="29.513611503s" totalImagesPullingTime="21.723949108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:07:53.511864793 +0000 UTC m=+29.671148313" watchObservedRunningTime="2026-07-08 23:07:53.513611503 +0000 UTC m=+29.672895015" Jul 08 23:07:54.325016 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:54.324984 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:54.325218 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:54.325070 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:07:54.325218 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:54.325082 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p25w" podUID="19cfadf2-80c1-49c5-b9ff-29c372a05a7f" Jul 08 23:07:54.325218 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:54.325185 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:07:54.325360 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:54.325209 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwcdm" podUID="3d290d52-819f-4ece-bc8e-11ce3dbb4d29" Jul 08 23:07:54.325360 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:54.325252 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cr2z" podUID="29b0e180-c5ba-4775-888e-f57cd955a7ab" Jul 08 23:07:54.486755 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:54.486720 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:54.501553 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:54.501534 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:07:55.689078 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:55.689045 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kwcdm"] Jul 08 23:07:55.689616 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:55.689224 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:07:55.689616 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:55.689346 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwcdm" podUID="3d290d52-819f-4ece-bc8e-11ce3dbb4d29" Jul 08 23:07:55.691442 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:55.691420 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2p25w"] Jul 08 23:07:55.691546 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:55.691521 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:55.691644 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:55.691620 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p25w" podUID="19cfadf2-80c1-49c5-b9ff-29c372a05a7f" Jul 08 23:07:55.694742 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:55.694719 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8cr2z"] Jul 08 23:07:55.694826 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:55.694815 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:07:55.694932 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:55.694912 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cr2z" podUID="29b0e180-c5ba-4775-888e-f57cd955a7ab" Jul 08 23:07:57.324495 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:57.324428 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:07:57.324946 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:57.324545 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:57.324946 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:57.324556 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cr2z" podUID="29b0e180-c5ba-4775-888e-f57cd955a7ab" Jul 08 23:07:57.324946 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:57.324581 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:07:57.324946 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:57.324688 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p25w" podUID="19cfadf2-80c1-49c5-b9ff-29c372a05a7f" Jul 08 23:07:57.324946 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:57.324790 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwcdm" podUID="3d290d52-819f-4ece-bc8e-11ce3dbb4d29" Jul 08 23:07:57.943449 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:57.943417 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-original-pull-secret\") pod \"global-pull-secret-syncer-2p25w\" (UID: \"19cfadf2-80c1-49c5-b9ff-29c372a05a7f\") " pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:57.943591 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:57.943520 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs\") pod \"network-metrics-daemon-kwcdm\" (UID: \"3d290d52-819f-4ece-bc8e-11ce3dbb4d29\") " pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:07:57.943591 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:57.943574 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 23:07:57.943591 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:57.943592 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 23:07:57.943719 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:57.943642 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-original-pull-secret podName:19cfadf2-80c1-49c5-b9ff-29c372a05a7f nodeName:}" failed. No retries permitted until 2026-07-08 23:08:29.943627299 +0000 UTC m=+66.102910803 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-original-pull-secret") pod "global-pull-secret-syncer-2p25w" (UID: "19cfadf2-80c1-49c5-b9ff-29c372a05a7f") : object "kube-system"/"original-pull-secret" not registered Jul 08 23:07:57.943719 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:57.943664 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs podName:3d290d52-819f-4ece-bc8e-11ce3dbb4d29 nodeName:}" failed. No retries permitted until 2026-07-08 23:08:29.943652903 +0000 UTC m=+66.102936392 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs") pod "network-metrics-daemon-kwcdm" (UID: "3d290d52-819f-4ece-bc8e-11ce3dbb4d29") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 23:07:58.044726 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:58.044694 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkxw9\" (UniqueName: \"kubernetes.io/projected/29b0e180-c5ba-4775-888e-f57cd955a7ab-kube-api-access-dkxw9\") pod \"network-check-target-8cr2z\" (UID: \"29b0e180-c5ba-4775-888e-f57cd955a7ab\") " pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:07:58.044962 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:58.044855 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 23:07:58.044962 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:58.044885 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 23:07:58.044962 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:58.044915 2572 projected.go:196] Error preparing data for projected volume kube-api-access-dkxw9 for pod openshift-network-diagnostics/network-check-target-8cr2z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 23:07:58.045133 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:58.044972 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29b0e180-c5ba-4775-888e-f57cd955a7ab-kube-api-access-dkxw9 podName:29b0e180-c5ba-4775-888e-f57cd955a7ab nodeName:}" failed. No retries permitted until 2026-07-08 23:08:30.044958252 +0000 UTC m=+66.204241743 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dkxw9" (UniqueName: "kubernetes.io/projected/29b0e180-c5ba-4775-888e-f57cd955a7ab-kube-api-access-dkxw9") pod "network-check-target-8cr2z" (UID: "29b0e180-c5ba-4775-888e-f57cd955a7ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 23:07:59.323875 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:59.323838 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:07:59.324211 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:59.323885 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:07:59.324211 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:59.323885 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:07:59.324211 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:59.323980 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cr2z" podUID="29b0e180-c5ba-4775-888e-f57cd955a7ab" Jul 08 23:07:59.324211 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:59.324092 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p25w" podUID="19cfadf2-80c1-49c5-b9ff-29c372a05a7f" Jul 08 23:07:59.324211 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:07:59.324168 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwcdm" podUID="3d290d52-819f-4ece-bc8e-11ce3dbb4d29" Jul 08 23:07:59.499955 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:59.499866 2572 generic.go:356] "Generic (PLEG): container finished" podID="563c7484-0036-46e3-81fd-e0809d864d8c" containerID="9d0ee1128185b12bed11764cc2ad13ffad81719ff3fc49a4eed74fa591c625f3" exitCode=0 Jul 08 23:07:59.499955 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:07:59.499928 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwfwd" event={"ID":"563c7484-0036-46e3-81fd-e0809d864d8c","Type":"ContainerDied","Data":"9d0ee1128185b12bed11764cc2ad13ffad81719ff3fc49a4eed74fa591c625f3"} Jul 08 23:08:00.505184 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:00.505106 2572 generic.go:356] "Generic (PLEG): container finished" podID="563c7484-0036-46e3-81fd-e0809d864d8c" containerID="8b7b221f5ad21861435e5f37ed9fa9256a80b0b86997580077c2757c41071189" exitCode=0 Jul 08 23:08:00.505184 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:00.505151 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwfwd" event={"ID":"563c7484-0036-46e3-81fd-e0809d864d8c","Type":"ContainerDied","Data":"8b7b221f5ad21861435e5f37ed9fa9256a80b0b86997580077c2757c41071189"} Jul 08 23:08:01.324717 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:01.324690 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:08:01.324860 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:01.324785 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cr2z" podUID="29b0e180-c5ba-4775-888e-f57cd955a7ab" Jul 08 23:08:01.324860 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:01.324803 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:08:01.324969 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:01.324882 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p25w" podUID="19cfadf2-80c1-49c5-b9ff-29c372a05a7f" Jul 08 23:08:01.324969 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:01.324807 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:08:01.325031 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:01.324994 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwcdm" podUID="3d290d52-819f-4ece-bc8e-11ce3dbb4d29" Jul 08 23:08:01.513825 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:01.513787 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwfwd" event={"ID":"563c7484-0036-46e3-81fd-e0809d864d8c","Type":"ContainerStarted","Data":"a36734912a3d8a5cb5b9846030a29438869ff201435fbb87f2c4857294d89574"} Jul 08 23:08:01.537141 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:01.537096 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zwfwd" podStartSLOduration=8.070166372 podStartE2EDuration="37.537082072s" totalImagesPullingTime="29.4669157s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:07:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:08:01.535524773 +0000 UTC m=+37.694808283" watchObservedRunningTime="2026-07-08 23:08:01.537082072 +0000 UTC m=+37.696365578" Jul 08 23:08:02.021902 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.021877 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-37.ec2.internal" event="NodeReady" Jul 08 23:08:02.022070 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.022006 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 23:08:02.055430 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.055403 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-j7ds6"] Jul 08 23:08:02.074160 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.074134 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bdc54fbb5-9tsk2"] Jul 08 23:08:02.074327 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.074310 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-j7ds6" Jul 08 23:08:02.076833 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.076792 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 08 23:08:02.076968 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.076797 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7bchb\"" Jul 08 23:08:02.077068 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.077047 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 08 23:08:02.084732 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.084713 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-j7ds6"] Jul 08 23:08:02.084844 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.084751 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-l5z9c"] Jul 08 23:08:02.084931 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.084852 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:02.087176 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.087156 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 08 23:08:02.087439 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.087421 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sq6cw\"" Jul 08 23:08:02.087540 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.087438 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 08 23:08:02.087540 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.087422 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 08 23:08:02.092349 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.092328 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 08 23:08:02.097182 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.097164 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bdc54fbb5-9tsk2"] Jul 08 23:08:02.097260 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.097192 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4zw4w"] Jul 08 23:08:02.097296 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.097262 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l5z9c" Jul 08 23:08:02.100164 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.100129 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 23:08:02.100258 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.100210 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 23:08:02.100417 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.100396 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mtwjf\"" Jul 08 23:08:02.100486 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.100401 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 23:08:02.108268 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.108250 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l5z9c"] Jul 08 23:08:02.108359 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.108281 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4zw4w"] Jul 08 23:08:02.108425 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.108375 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4zw4w" Jul 08 23:08:02.110723 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.110703 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 23:08:02.110791 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.110715 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 23:08:02.110830 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.110749 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vhnmb\"" Jul 08 23:08:02.174085 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.174052 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5713a5a1-749f-48ca-a02f-dc9579c86957-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-j7ds6\" (UID: \"5713a5a1-749f-48ca-a02f-dc9579c86957\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j7ds6" Jul 08 23:08:02.174245 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.174093 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-j7ds6\" (UID: \"5713a5a1-749f-48ca-a02f-dc9579c86957\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j7ds6" Jul 08 23:08:02.260431 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.260397 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:08:02.274528 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.274480 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l679h\" (UniqueName: \"kubernetes.io/projected/0f505b62-231b-46d0-b4f7-214081f12923-kube-api-access-l679h\") pod \"dns-default-4zw4w\" (UID: \"0f505b62-231b-46d0-b4f7-214081f12923\") " pod="openshift-dns/dns-default-4zw4w" Jul 08 23:08:02.274528 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.274505 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/675b1c56-1f9f-4dec-8a98-07dfb16fece3-image-registry-private-configuration\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:02.274528 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.274523 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/675b1c56-1f9f-4dec-8a98-07dfb16fece3-ca-trust-extracted\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:02.274728 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.274540 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/675b1c56-1f9f-4dec-8a98-07dfb16fece3-trusted-ca\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:02.274728 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.274561 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5713a5a1-749f-48ca-a02f-dc9579c86957-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-j7ds6\" (UID: \"5713a5a1-749f-48ca-a02f-dc9579c86957\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j7ds6" Jul 08 23:08:02.274728 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.274576 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-certificates\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:02.274728 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.274598 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls\") pod \"dns-default-4zw4w\" (UID: \"0f505b62-231b-46d0-b4f7-214081f12923\") " pod="openshift-dns/dns-default-4zw4w" Jul 08 23:08:02.274728 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.274614 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-j7ds6\" (UID: \"5713a5a1-749f-48ca-a02f-dc9579c86957\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j7ds6" Jul 08 23:08:02.274728 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.274630 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-bound-sa-token\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:02.274728 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.274648 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8zmd\" (UniqueName: \"kubernetes.io/projected/8c67c695-4fa0-4d4d-a8c1-2e24e1f3012c-kube-api-access-r8zmd\") pod \"ingress-canary-l5z9c\" (UID: \"8c67c695-4fa0-4d4d-a8c1-2e24e1f3012c\") " pod="openshift-ingress-canary/ingress-canary-l5z9c" Jul 08 23:08:02.274728 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.274661 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f505b62-231b-46d0-b4f7-214081f12923-tmp-dir\") pod \"dns-default-4zw4w\" (UID: \"0f505b62-231b-46d0-b4f7-214081f12923\") " pod="openshift-dns/dns-default-4zw4w" Jul 08 23:08:02.274728 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.274676 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:02.274728 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.274726 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0f505b62-231b-46d0-b4f7-214081f12923-config-volume\") pod \"dns-default-4zw4w\" (UID: \"0f505b62-231b-46d0-b4f7-214081f12923\") " pod="openshift-dns/dns-default-4zw4w" Jul 08 23:08:02.275131 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:02.274742 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 23:08:02.275131 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.274781 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c67c695-4fa0-4d4d-a8c1-2e24e1f3012c-cert\") pod \"ingress-canary-l5z9c\" (UID: \"8c67c695-4fa0-4d4d-a8c1-2e24e1f3012c\") " pod="openshift-ingress-canary/ingress-canary-l5z9c" Jul 08 23:08:02.275131 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:02.274810 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert podName:5713a5a1-749f-48ca-a02f-dc9579c86957 nodeName:}" failed. No retries permitted until 2026-07-08 23:08:02.7747891 +0000 UTC m=+38.934072587 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-j7ds6" (UID: "5713a5a1-749f-48ca-a02f-dc9579c86957") : secret "networking-console-plugin-cert" not found Jul 08 23:08:02.275131 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.274861 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/675b1c56-1f9f-4dec-8a98-07dfb16fece3-installation-pull-secrets\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:02.275131 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.274888 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rbls\" (UniqueName: \"kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-kube-api-access-9rbls\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:02.275298 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.275190 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5713a5a1-749f-48ca-a02f-dc9579c86957-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-j7ds6\" (UID: \"5713a5a1-749f-48ca-a02f-dc9579c86957\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j7ds6" Jul 08 23:08:02.339546 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.339521 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:08:02.375435 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.375407 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls\") pod \"dns-default-4zw4w\" (UID: \"0f505b62-231b-46d0-b4f7-214081f12923\") " pod="openshift-dns/dns-default-4zw4w" Jul 08 23:08:02.375566 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.375448 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-bound-sa-token\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:02.375566 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.375466 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8zmd\" (UniqueName: \"kubernetes.io/projected/8c67c695-4fa0-4d4d-a8c1-2e24e1f3012c-kube-api-access-r8zmd\") pod \"ingress-canary-l5z9c\" (UID: \"8c67c695-4fa0-4d4d-a8c1-2e24e1f3012c\") " pod="openshift-ingress-canary/ingress-canary-l5z9c" Jul 08 23:08:02.375566 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.375482 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f505b62-231b-46d0-b4f7-214081f12923-tmp-dir\") pod \"dns-default-4zw4w\" (UID: \"0f505b62-231b-46d0-b4f7-214081f12923\") " pod="openshift-dns/dns-default-4zw4w" Jul 08 23:08:02.375566 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.375497 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:02.375566 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.375519 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0f505b62-231b-46d0-b4f7-214081f12923-config-volume\") pod \"dns-default-4zw4w\" (UID: \"0f505b62-231b-46d0-b4f7-214081f12923\") " pod="openshift-dns/dns-default-4zw4w" Jul 08 23:08:02.375566 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.375543 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c67c695-4fa0-4d4d-a8c1-2e24e1f3012c-cert\") pod \"ingress-canary-l5z9c\" (UID: \"8c67c695-4fa0-4d4d-a8c1-2e24e1f3012c\") " pod="openshift-ingress-canary/ingress-canary-l5z9c" Jul 08 23:08:02.375853 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.375567 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/675b1c56-1f9f-4dec-8a98-07dfb16fece3-installation-pull-secrets\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:02.375853 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.375623 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rbls\" (UniqueName: \"kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-kube-api-access-9rbls\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:02.375853 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:02.375668 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 23:08:02.375853 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.375695 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l679h\" (UniqueName: \"kubernetes.io/projected/0f505b62-231b-46d0-b4f7-214081f12923-kube-api-access-l679h\") pod \"dns-default-4zw4w\" (UID: \"0f505b62-231b-46d0-b4f7-214081f12923\") " pod="openshift-dns/dns-default-4zw4w" Jul 08 23:08:02.375853 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:02.375730 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls podName:0f505b62-231b-46d0-b4f7-214081f12923 nodeName:}" failed. No retries permitted until 2026-07-08 23:08:02.875712281 +0000 UTC m=+39.034995768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls") pod "dns-default-4zw4w" (UID: "0f505b62-231b-46d0-b4f7-214081f12923") : secret "dns-default-metrics-tls" not found Jul 08 23:08:02.375853 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:02.375672 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 23:08:02.375853 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:02.375796 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bdc54fbb5-9tsk2: secret "image-registry-tls" not found Jul 08 23:08:02.375853 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.375834 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/675b1c56-1f9f-4dec-8a98-07dfb16fece3-image-registry-private-configuration\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:02.375853 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:02.375859 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls podName:675b1c56-1f9f-4dec-8a98-07dfb16fece3 nodeName:}" failed. No retries permitted until 2026-07-08 23:08:02.875842396 +0000 UTC m=+39.035125883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls") pod "image-registry-5bdc54fbb5-9tsk2" (UID: "675b1c56-1f9f-4dec-8a98-07dfb16fece3") : secret "image-registry-tls" not found Jul 08 23:08:02.376317 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.375926 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/675b1c56-1f9f-4dec-8a98-07dfb16fece3-ca-trust-extracted\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:02.376317 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.375979 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/675b1c56-1f9f-4dec-8a98-07dfb16fece3-trusted-ca\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:02.376317 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.376039 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-certificates\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:02.376317 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.375946 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f505b62-231b-46d0-b4f7-214081f12923-tmp-dir\") pod \"dns-default-4zw4w\" (UID: \"0f505b62-231b-46d0-b4f7-214081f12923\") " pod="openshift-dns/dns-default-4zw4w" Jul 08 23:08:02.376496 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.376330 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0f505b62-231b-46d0-b4f7-214081f12923-config-volume\") pod \"dns-default-4zw4w\" (UID: \"0f505b62-231b-46d0-b4f7-214081f12923\") " pod="openshift-dns/dns-default-4zw4w" Jul 08 23:08:02.376496 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.376343 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/675b1c56-1f9f-4dec-8a98-07dfb16fece3-ca-trust-extracted\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:02.376592 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.376557 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-certificates\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:02.377073 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.376885 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/675b1c56-1f9f-4dec-8a98-07dfb16fece3-trusted-ca\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:02.379966 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.379943 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/675b1c56-1f9f-4dec-8a98-07dfb16fece3-image-registry-private-configuration\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:02.380050 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.379985 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/675b1c56-1f9f-4dec-8a98-07dfb16fece3-installation-pull-secrets\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:02.380050 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.380035 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c67c695-4fa0-4d4d-a8c1-2e24e1f3012c-cert\") pod \"ingress-canary-l5z9c\" (UID: \"8c67c695-4fa0-4d4d-a8c1-2e24e1f3012c\") " pod="openshift-ingress-canary/ingress-canary-l5z9c" Jul 08 23:08:02.386503 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.386478 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l679h\" (UniqueName: \"kubernetes.io/projected/0f505b62-231b-46d0-b4f7-214081f12923-kube-api-access-l679h\") pod \"dns-default-4zw4w\" (UID: \"0f505b62-231b-46d0-b4f7-214081f12923\") " pod="openshift-dns/dns-default-4zw4w" Jul 08 23:08:02.386618 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.386477 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8zmd\" (UniqueName: \"kubernetes.io/projected/8c67c695-4fa0-4d4d-a8c1-2e24e1f3012c-kube-api-access-r8zmd\") pod \"ingress-canary-l5z9c\" (UID: \"8c67c695-4fa0-4d4d-a8c1-2e24e1f3012c\") " pod="openshift-ingress-canary/ingress-canary-l5z9c" Jul 08 23:08:02.386829 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.386809 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-bound-sa-token\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:02.386909 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.386842 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rbls\" (UniqueName: \"kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-kube-api-access-9rbls\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:02.406724 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.406696 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l5z9c" Jul 08 23:08:02.590471 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.590303 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l5z9c"] Jul 08 23:08:02.593708 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:08:02.593681 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c67c695_4fa0_4d4d_a8c1_2e24e1f3012c.slice/crio-954408ab7995bba3fde1586c169628f9a0050ea3195d9786d0b3ad83c14df88d WatchSource:0}: Error finding container 954408ab7995bba3fde1586c169628f9a0050ea3195d9786d0b3ad83c14df88d: Status 404 returned error can't find the container with id 954408ab7995bba3fde1586c169628f9a0050ea3195d9786d0b3ad83c14df88d Jul 08 23:08:02.714268 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.714222 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:08:02.779264 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.779232 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-j7ds6\" (UID: \"5713a5a1-749f-48ca-a02f-dc9579c86957\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j7ds6" Jul 08 23:08:02.779403 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:02.779349 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 23:08:02.779441 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:02.779404 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert podName:5713a5a1-749f-48ca-a02f-dc9579c86957 nodeName:}" failed. No retries permitted until 2026-07-08 23:08:03.779391497 +0000 UTC m=+39.938674988 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-j7ds6" (UID: "5713a5a1-749f-48ca-a02f-dc9579c86957") : secret "networking-console-plugin-cert" not found Jul 08 23:08:02.879621 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.879549 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls\") pod \"dns-default-4zw4w\" (UID: \"0f505b62-231b-46d0-b4f7-214081f12923\") " pod="openshift-dns/dns-default-4zw4w" Jul 08 23:08:02.879621 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:02.879590 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:02.879788 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:02.879682 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 23:08:02.879788 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:02.879702 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 23:08:02.879788 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:02.879713 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bdc54fbb5-9tsk2: secret "image-registry-tls" not found Jul 08 23:08:02.879788 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:02.879736 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls podName:0f505b62-231b-46d0-b4f7-214081f12923 nodeName:}" failed. No retries permitted until 2026-07-08 23:08:03.879721972 +0000 UTC m=+40.039005458 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls") pod "dns-default-4zw4w" (UID: "0f505b62-231b-46d0-b4f7-214081f12923") : secret "dns-default-metrics-tls" not found Jul 08 23:08:02.879788 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:02.879752 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls podName:675b1c56-1f9f-4dec-8a98-07dfb16fece3 nodeName:}" failed. No retries permitted until 2026-07-08 23:08:03.87974157 +0000 UTC m=+40.039025057 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls") pod "image-registry-5bdc54fbb5-9tsk2" (UID: "675b1c56-1f9f-4dec-8a98-07dfb16fece3") : secret "image-registry-tls" not found Jul 08 23:08:03.324557 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:03.324520 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:08:03.324777 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:03.324532 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:08:03.324777 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:03.324713 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:08:03.328468 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:03.328446 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 23:08:03.328468 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:03.328456 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2g9tf\"" Jul 08 23:08:03.328637 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:03.328484 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 23:08:03.328637 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:03.328500 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dwbh8\"" Jul 08 23:08:03.328637 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:03.328501 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 23:08:03.328637 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:03.328450 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 23:08:03.520749 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:03.520716 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l5z9c" event={"ID":"8c67c695-4fa0-4d4d-a8c1-2e24e1f3012c","Type":"ContainerStarted","Data":"954408ab7995bba3fde1586c169628f9a0050ea3195d9786d0b3ad83c14df88d"} Jul 08 23:08:03.787698 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:03.787657 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-j7ds6\" (UID: \"5713a5a1-749f-48ca-a02f-dc9579c86957\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j7ds6" Jul 08 23:08:03.788139 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:03.787793 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 23:08:03.788139 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:03.787849 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert podName:5713a5a1-749f-48ca-a02f-dc9579c86957 nodeName:}" failed. No retries permitted until 2026-07-08 23:08:05.787835509 +0000 UTC m=+41.947118996 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-j7ds6" (UID: "5713a5a1-749f-48ca-a02f-dc9579c86957") : secret "networking-console-plugin-cert" not found Jul 08 23:08:03.888408 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:03.888372 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls\") pod \"dns-default-4zw4w\" (UID: \"0f505b62-231b-46d0-b4f7-214081f12923\") " pod="openshift-dns/dns-default-4zw4w" Jul 08 23:08:03.888578 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:03.888426 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:03.888578 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:03.888552 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 23:08:03.888578 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:03.888566 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 23:08:03.888704 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:03.888584 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bdc54fbb5-9tsk2: secret "image-registry-tls" not found Jul 08 23:08:03.888704 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:03.888629 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls podName:0f505b62-231b-46d0-b4f7-214081f12923 nodeName:}" failed. No retries permitted until 2026-07-08 23:08:05.888608969 +0000 UTC m=+42.047892469 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls") pod "dns-default-4zw4w" (UID: "0f505b62-231b-46d0-b4f7-214081f12923") : secret "dns-default-metrics-tls" not found Jul 08 23:08:03.888704 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:03.888653 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls podName:675b1c56-1f9f-4dec-8a98-07dfb16fece3 nodeName:}" failed. No retries permitted until 2026-07-08 23:08:05.888639111 +0000 UTC m=+42.047922600 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls") pod "image-registry-5bdc54fbb5-9tsk2" (UID: "675b1c56-1f9f-4dec-8a98-07dfb16fece3") : secret "image-registry-tls" not found Jul 08 23:08:05.801742 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:05.801713 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-j7ds6\" (UID: \"5713a5a1-749f-48ca-a02f-dc9579c86957\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j7ds6" Jul 08 23:08:05.802042 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:05.801853 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 23:08:05.802042 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:05.801930 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert podName:5713a5a1-749f-48ca-a02f-dc9579c86957 nodeName:}" failed. No retries permitted until 2026-07-08 23:08:09.801913881 +0000 UTC m=+45.961197373 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-j7ds6" (UID: "5713a5a1-749f-48ca-a02f-dc9579c86957") : secret "networking-console-plugin-cert" not found Jul 08 23:08:05.902222 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:05.902183 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls\") pod \"dns-default-4zw4w\" (UID: \"0f505b62-231b-46d0-b4f7-214081f12923\") " pod="openshift-dns/dns-default-4zw4w" Jul 08 23:08:05.902436 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:05.902258 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:05.902436 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:05.902321 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 23:08:05.902436 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:05.902387 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls podName:0f505b62-231b-46d0-b4f7-214081f12923 nodeName:}" failed. No retries permitted until 2026-07-08 23:08:09.902372486 +0000 UTC m=+46.061655973 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls") pod "dns-default-4zw4w" (UID: "0f505b62-231b-46d0-b4f7-214081f12923") : secret "dns-default-metrics-tls" not found Jul 08 23:08:05.902436 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:05.902420 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 23:08:05.902436 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:05.902438 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bdc54fbb5-9tsk2: secret "image-registry-tls" not found Jul 08 23:08:05.902601 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:05.902497 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls podName:675b1c56-1f9f-4dec-8a98-07dfb16fece3 nodeName:}" failed. No retries permitted until 2026-07-08 23:08:09.902483014 +0000 UTC m=+46.061766501 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls") pod "image-registry-5bdc54fbb5-9tsk2" (UID: "675b1c56-1f9f-4dec-8a98-07dfb16fece3") : secret "image-registry-tls" not found Jul 08 23:08:06.529707 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:06.529676 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l5z9c" event={"ID":"8c67c695-4fa0-4d4d-a8c1-2e24e1f3012c","Type":"ContainerStarted","Data":"dce8fe8966a1e0937d74478dd558680892f44868f2c8f1ace3f4de36f74456e4"} Jul 08 23:08:06.546545 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:06.546499 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-l5z9c" podStartSLOduration=1.406247952 podStartE2EDuration="4.546485097s" totalImagesPullingTime="3.140237145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:08:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:08:06.544835662 +0000 UTC m=+42.704119171" watchObservedRunningTime="2026-07-08 23:08:06.546485097 +0000 UTC m=+42.705768605" Jul 08 23:08:09.830093 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:09.830051 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-j7ds6\" (UID: \"5713a5a1-749f-48ca-a02f-dc9579c86957\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j7ds6" Jul 08 23:08:09.830479 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:09.830208 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 23:08:09.830479 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:09.830271 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert podName:5713a5a1-749f-48ca-a02f-dc9579c86957 nodeName:}" failed. No retries permitted until 2026-07-08 23:08:17.830254605 +0000 UTC m=+53.989538102 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-j7ds6" (UID: "5713a5a1-749f-48ca-a02f-dc9579c86957") : secret "networking-console-plugin-cert" not found Jul 08 23:08:09.930602 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:09.930565 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls\") pod \"dns-default-4zw4w\" (UID: \"0f505b62-231b-46d0-b4f7-214081f12923\") " pod="openshift-dns/dns-default-4zw4w" Jul 08 23:08:09.930757 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:09.930614 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:09.930757 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:09.930722 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 23:08:09.930757 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:09.930742 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 23:08:09.930757 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:09.930752 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bdc54fbb5-9tsk2: secret "image-registry-tls" not found Jul 08 23:08:09.930879 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:09.930792 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls podName:0f505b62-231b-46d0-b4f7-214081f12923 nodeName:}" failed. No retries permitted until 2026-07-08 23:08:17.930777049 +0000 UTC m=+54.090060535 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls") pod "dns-default-4zw4w" (UID: "0f505b62-231b-46d0-b4f7-214081f12923") : secret "dns-default-metrics-tls" not found Jul 08 23:08:09.930879 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:09.930813 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls podName:675b1c56-1f9f-4dec-8a98-07dfb16fece3 nodeName:}" failed. No retries permitted until 2026-07-08 23:08:17.930802503 +0000 UTC m=+54.090085994 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls") pod "image-registry-5bdc54fbb5-9tsk2" (UID: "675b1c56-1f9f-4dec-8a98-07dfb16fece3") : secret "image-registry-tls" not found Jul 08 23:08:10.948770 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:10.948738 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:08:10.999207 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:10.999179 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:08:12.117010 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:12.116971 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:08:12.217300 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:12.217270 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:08:12.317595 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:12.317565 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:08:13.981102 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:13.981070 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:08:14.038825 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:14.038795 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:08:16.523890 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:16.523856 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:08:16.581414 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:16.581378 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:08:17.488921 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:17.488843 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:08:17.887019 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:17.886976 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-j7ds6\" (UID: \"5713a5a1-749f-48ca-a02f-dc9579c86957\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j7ds6" Jul 08 23:08:17.887408 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:17.887128 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 23:08:17.887408 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:17.887206 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert podName:5713a5a1-749f-48ca-a02f-dc9579c86957 nodeName:}" failed. No retries permitted until 2026-07-08 23:08:33.887190018 +0000 UTC m=+70.046473505 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-j7ds6" (UID: "5713a5a1-749f-48ca-a02f-dc9579c86957") : secret "networking-console-plugin-cert" not found Jul 08 23:08:17.987962 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:17.987921 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls\") pod \"dns-default-4zw4w\" (UID: \"0f505b62-231b-46d0-b4f7-214081f12923\") " pod="openshift-dns/dns-default-4zw4w" Jul 08 23:08:17.988043 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:17.987980 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:17.988091 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:17.988049 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 23:08:17.988091 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:17.988081 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 23:08:17.988091 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:17.988091 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bdc54fbb5-9tsk2: secret "image-registry-tls" not found Jul 08 23:08:17.988180 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:17.988116 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls podName:0f505b62-231b-46d0-b4f7-214081f12923 nodeName:}" failed. No retries permitted until 2026-07-08 23:08:33.988100975 +0000 UTC m=+70.147384462 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls") pod "dns-default-4zw4w" (UID: "0f505b62-231b-46d0-b4f7-214081f12923") : secret "dns-default-metrics-tls" not found Jul 08 23:08:17.988180 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:17.988136 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls podName:675b1c56-1f9f-4dec-8a98-07dfb16fece3 nodeName:}" failed. No retries permitted until 2026-07-08 23:08:33.988124648 +0000 UTC m=+70.147408134 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls") pod "image-registry-5bdc54fbb5-9tsk2" (UID: "675b1c56-1f9f-4dec-8a98-07dfb16fece3") : secret "image-registry-tls" not found Jul 08 23:08:18.853727 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:18.853695 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:08:18.917857 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:18.917829 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:08:26.500431 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:26.500404 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7lg72" Jul 08 23:08:26.652695 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:26.652655 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:08:26.724951 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:26.724920 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:08:29.978873 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:29.978834 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs\") pod \"network-metrics-daemon-kwcdm\" (UID: \"3d290d52-819f-4ece-bc8e-11ce3dbb4d29\") " pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:08:29.978873 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:29.978877 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-original-pull-secret\") pod \"global-pull-secret-syncer-2p25w\" (UID: \"19cfadf2-80c1-49c5-b9ff-29c372a05a7f\") " pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:08:29.981727 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:29.981708 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 23:08:29.981788 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:29.981708 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 23:08:29.989191 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:29.989174 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 23:08:29.989271 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:29.989242 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs podName:3d290d52-819f-4ece-bc8e-11ce3dbb4d29 nodeName:}" failed. No retries permitted until 2026-07-08 23:09:33.989225075 +0000 UTC m=+130.148508563 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs") pod "network-metrics-daemon-kwcdm" (UID: "3d290d52-819f-4ece-bc8e-11ce3dbb4d29") : secret "metrics-daemon-secret" not found Jul 08 23:08:29.992748 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:29.992726 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19cfadf2-80c1-49c5-b9ff-29c372a05a7f-original-pull-secret\") pod \"global-pull-secret-syncer-2p25w\" (UID: \"19cfadf2-80c1-49c5-b9ff-29c372a05a7f\") " pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:08:30.050383 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:30.050341 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p25w" Jul 08 23:08:30.079679 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:30.079648 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkxw9\" (UniqueName: \"kubernetes.io/projected/29b0e180-c5ba-4775-888e-f57cd955a7ab-kube-api-access-dkxw9\") pod \"network-check-target-8cr2z\" (UID: \"29b0e180-c5ba-4775-888e-f57cd955a7ab\") " pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:08:30.082647 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:30.082629 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 23:08:30.092770 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:30.092748 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 23:08:30.103401 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:30.103378 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkxw9\" (UniqueName: \"kubernetes.io/projected/29b0e180-c5ba-4775-888e-f57cd955a7ab-kube-api-access-dkxw9\") pod \"network-check-target-8cr2z\" (UID: \"29b0e180-c5ba-4775-888e-f57cd955a7ab\") " pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:08:30.197849 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:30.197814 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2p25w"] Jul 08 23:08:30.201390 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:08:30.201367 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19cfadf2_80c1_49c5_b9ff_29c372a05a7f.slice/crio-b6dc5cf6c0c62c78cfde52dd286e7eae7e732674185f09ad8c8ab39ec0004d67 WatchSource:0}: Error finding container b6dc5cf6c0c62c78cfde52dd286e7eae7e732674185f09ad8c8ab39ec0004d67: Status 404 returned error can't find the container with id b6dc5cf6c0c62c78cfde52dd286e7eae7e732674185f09ad8c8ab39ec0004d67 Jul 08 23:08:30.346020 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:30.345996 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2g9tf\"" Jul 08 23:08:30.354082 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:30.354068 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:08:30.497551 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:30.497519 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8cr2z"] Jul 08 23:08:30.500320 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:08:30.500290 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29b0e180_c5ba_4775_888e_f57cd955a7ab.slice/crio-3c17b2a0fbd932a382697ccf2dc69a332fb05548c12e2686b58cb8a09bbe42ac WatchSource:0}: Error finding container 3c17b2a0fbd932a382697ccf2dc69a332fb05548c12e2686b58cb8a09bbe42ac: Status 404 returned error can't find the container with id 3c17b2a0fbd932a382697ccf2dc69a332fb05548c12e2686b58cb8a09bbe42ac Jul 08 23:08:30.586366 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:30.586333 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8cr2z" event={"ID":"29b0e180-c5ba-4775-888e-f57cd955a7ab","Type":"ContainerStarted","Data":"3c17b2a0fbd932a382697ccf2dc69a332fb05548c12e2686b58cb8a09bbe42ac"} Jul 08 23:08:30.587430 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:30.587407 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2p25w" event={"ID":"19cfadf2-80c1-49c5-b9ff-29c372a05a7f","Type":"ContainerStarted","Data":"b6dc5cf6c0c62c78cfde52dd286e7eae7e732674185f09ad8c8ab39ec0004d67"} Jul 08 23:08:32.963492 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:32.963457 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:08:33.017798 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:33.017731 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:08:33.912119 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:33.912078 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-j7ds6\" (UID: \"5713a5a1-749f-48ca-a02f-dc9579c86957\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j7ds6" Jul 08 23:08:33.912287 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:33.912247 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 23:08:33.912348 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:33.912333 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert podName:5713a5a1-749f-48ca-a02f-dc9579c86957 nodeName:}" failed. No retries permitted until 2026-07-08 23:09:05.912309999 +0000 UTC m=+102.071593497 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-j7ds6" (UID: "5713a5a1-749f-48ca-a02f-dc9579c86957") : secret "networking-console-plugin-cert" not found Jul 08 23:08:34.013415 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:34.013378 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls\") pod \"dns-default-4zw4w\" (UID: \"0f505b62-231b-46d0-b4f7-214081f12923\") " pod="openshift-dns/dns-default-4zw4w" Jul 08 23:08:34.013790 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:34.013437 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:08:34.013790 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:34.013557 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 23:08:34.013790 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:34.013572 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 23:08:34.013790 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:34.013585 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bdc54fbb5-9tsk2: secret "image-registry-tls" not found Jul 08 23:08:34.013790 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:34.013635 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls podName:0f505b62-231b-46d0-b4f7-214081f12923 nodeName:}" failed. No retries permitted until 2026-07-08 23:09:06.013614833 +0000 UTC m=+102.172898325 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls") pod "dns-default-4zw4w" (UID: "0f505b62-231b-46d0-b4f7-214081f12923") : secret "dns-default-metrics-tls" not found Jul 08 23:08:34.013790 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:08:34.013655 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls podName:675b1c56-1f9f-4dec-8a98-07dfb16fece3 nodeName:}" failed. No retries permitted until 2026-07-08 23:09:06.013645944 +0000 UTC m=+102.172929435 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls") pod "image-registry-5bdc54fbb5-9tsk2" (UID: "675b1c56-1f9f-4dec-8a98-07dfb16fece3") : secret "image-registry-tls" not found Jul 08 23:08:34.110840 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:34.110804 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-578d45fbdd-tgcd6"] Jul 08 23:08:34.113661 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:34.113637 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578d45fbdd-tgcd6" Jul 08 23:08:34.116160 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:34.116125 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 08 23:08:34.116272 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:34.116219 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 08 23:08:34.116464 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:34.116449 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 08 23:08:34.117436 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:34.117416 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 08 23:08:34.122256 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:34.122232 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-578d45fbdd-tgcd6"] Jul 08 23:08:34.214885 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:34.214808 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e692f568-f546-4617-a262-4c6e6b6307e8-tmp\") pod \"klusterlet-addon-workmgr-578d45fbdd-tgcd6\" (UID: \"e692f568-f546-4617-a262-4c6e6b6307e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578d45fbdd-tgcd6" Jul 08 23:08:34.214885 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:34.214841 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e692f568-f546-4617-a262-4c6e6b6307e8-klusterlet-config\") pod \"klusterlet-addon-workmgr-578d45fbdd-tgcd6\" (UID: \"e692f568-f546-4617-a262-4c6e6b6307e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578d45fbdd-tgcd6" Jul 08 23:08:34.215120 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:34.214986 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vprl6\" (UniqueName: \"kubernetes.io/projected/e692f568-f546-4617-a262-4c6e6b6307e8-kube-api-access-vprl6\") pod \"klusterlet-addon-workmgr-578d45fbdd-tgcd6\" (UID: \"e692f568-f546-4617-a262-4c6e6b6307e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578d45fbdd-tgcd6" Jul 08 23:08:34.316294 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:34.316247 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e692f568-f546-4617-a262-4c6e6b6307e8-tmp\") pod \"klusterlet-addon-workmgr-578d45fbdd-tgcd6\" (UID: \"e692f568-f546-4617-a262-4c6e6b6307e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578d45fbdd-tgcd6" Jul 08 23:08:34.316294 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:34.316294 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e692f568-f546-4617-a262-4c6e6b6307e8-klusterlet-config\") pod \"klusterlet-addon-workmgr-578d45fbdd-tgcd6\" (UID: \"e692f568-f546-4617-a262-4c6e6b6307e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578d45fbdd-tgcd6" Jul 08 23:08:34.316516 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:34.316387 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vprl6\" (UniqueName: \"kubernetes.io/projected/e692f568-f546-4617-a262-4c6e6b6307e8-kube-api-access-vprl6\") pod \"klusterlet-addon-workmgr-578d45fbdd-tgcd6\" (UID: \"e692f568-f546-4617-a262-4c6e6b6307e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578d45fbdd-tgcd6" Jul 08 23:08:34.316747 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:34.316698 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e692f568-f546-4617-a262-4c6e6b6307e8-tmp\") pod \"klusterlet-addon-workmgr-578d45fbdd-tgcd6\" (UID: \"e692f568-f546-4617-a262-4c6e6b6307e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578d45fbdd-tgcd6" Jul 08 23:08:34.319092 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:34.319045 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e692f568-f546-4617-a262-4c6e6b6307e8-klusterlet-config\") pod \"klusterlet-addon-workmgr-578d45fbdd-tgcd6\" (UID: \"e692f568-f546-4617-a262-4c6e6b6307e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578d45fbdd-tgcd6" Jul 08 23:08:34.326449 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:34.326420 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vprl6\" (UniqueName: \"kubernetes.io/projected/e692f568-f546-4617-a262-4c6e6b6307e8-kube-api-access-vprl6\") pod \"klusterlet-addon-workmgr-578d45fbdd-tgcd6\" (UID: \"e692f568-f546-4617-a262-4c6e6b6307e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578d45fbdd-tgcd6" Jul 08 23:08:34.425452 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:34.425419 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578d45fbdd-tgcd6" Jul 08 23:08:35.474590 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:35.474567 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-578d45fbdd-tgcd6"] Jul 08 23:08:35.477521 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:08:35.477491 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode692f568_f546_4617_a262_4c6e6b6307e8.slice/crio-3a7aaabacdd2ee51ccb944d5215af591b2d478aa0154f7148a95ac63f430c880 WatchSource:0}: Error finding container 3a7aaabacdd2ee51ccb944d5215af591b2d478aa0154f7148a95ac63f430c880: Status 404 returned error can't find the container with id 3a7aaabacdd2ee51ccb944d5215af591b2d478aa0154f7148a95ac63f430c880 Jul 08 23:08:35.603471 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:35.603384 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2p25w" event={"ID":"19cfadf2-80c1-49c5-b9ff-29c372a05a7f","Type":"ContainerStarted","Data":"a8d0d1268797bd14e27a64c363940e4016e0e6da78be88ed781f3a57e7a9a8ef"} Jul 08 23:08:35.604487 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:35.604459 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578d45fbdd-tgcd6" event={"ID":"e692f568-f546-4617-a262-4c6e6b6307e8","Type":"ContainerStarted","Data":"3a7aaabacdd2ee51ccb944d5215af591b2d478aa0154f7148a95ac63f430c880"} Jul 08 23:08:35.605819 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:35.605795 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8cr2z" event={"ID":"29b0e180-c5ba-4775-888e-f57cd955a7ab","Type":"ContainerStarted","Data":"485edee37ce6c6fb1971f680887ab3aa0c442d7923365e0a448d71930a81aabf"} Jul 08 23:08:35.605951 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:35.605939 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:08:35.618448 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:35.618407 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2p25w" podStartSLOduration=66.462111403 podStartE2EDuration="1m11.618394738s" totalImagesPullingTime="5.156283335s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:08:35.617858182 +0000 UTC m=+71.777141703" watchObservedRunningTime="2026-07-08 23:08:35.618394738 +0000 UTC m=+71.777678250" Jul 08 23:08:35.632243 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:35.632206 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8cr2z" podStartSLOduration=66.776153622 podStartE2EDuration="1m11.632193879s" totalImagesPullingTime="4.856040257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:08:35.631220767 +0000 UTC m=+71.790504269" watchObservedRunningTime="2026-07-08 23:08:35.632193879 +0000 UTC m=+71.791477393" Jul 08 23:08:38.795909 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:38.795847 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:08:38.896724 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:38.896675 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:08:39.621787 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:39.621704 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578d45fbdd-tgcd6" event={"ID":"e692f568-f546-4617-a262-4c6e6b6307e8","Type":"ContainerStarted","Data":"608e93f8362493285d4083893767e018155ffe125889ee8cfe2a1a464a2b6425"} Jul 08 23:08:39.621942 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:39.621922 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578d45fbdd-tgcd6" Jul 08 23:08:39.623408 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:39.623392 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578d45fbdd-tgcd6" Jul 08 23:08:39.638595 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:39.638545 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578d45fbdd-tgcd6" podStartSLOduration=1.785324688 podStartE2EDuration="5.638528042s" totalImagesPullingTime="3.853203354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:08:39.638085359 +0000 UTC m=+75.797368868" watchObservedRunningTime="2026-07-08 23:08:39.638528042 +0000 UTC m=+75.797811554" Jul 08 23:08:42.229303 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:42.229269 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:08:42.278846 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:08:42.278805 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:09:05.942951 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:09:05.942879 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-j7ds6\" (UID: \"5713a5a1-749f-48ca-a02f-dc9579c86957\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j7ds6" Jul 08 23:09:05.943411 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:09:05.943026 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 23:09:05.943411 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:09:05.943102 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert podName:5713a5a1-749f-48ca-a02f-dc9579c86957 nodeName:}" failed. No retries permitted until 2026-07-08 23:10:09.94308669 +0000 UTC m=+166.102370176 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-j7ds6" (UID: "5713a5a1-749f-48ca-a02f-dc9579c86957") : secret "networking-console-plugin-cert" not found Jul 08 23:09:06.043766 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:09:06.043715 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls\") pod \"dns-default-4zw4w\" (UID: \"0f505b62-231b-46d0-b4f7-214081f12923\") " pod="openshift-dns/dns-default-4zw4w" Jul 08 23:09:06.043766 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:09:06.043780 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:09:06.044049 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:09:06.043868 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 23:09:06.044049 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:09:06.043878 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bdc54fbb5-9tsk2: secret "image-registry-tls" not found Jul 08 23:09:06.044049 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:09:06.043910 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 23:09:06.044049 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:09:06.043943 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls podName:675b1c56-1f9f-4dec-8a98-07dfb16fece3 nodeName:}" failed. No retries permitted until 2026-07-08 23:10:10.043929874 +0000 UTC m=+166.203213360 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls") pod "image-registry-5bdc54fbb5-9tsk2" (UID: "675b1c56-1f9f-4dec-8a98-07dfb16fece3") : secret "image-registry-tls" not found Jul 08 23:09:06.044049 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:09:06.043982 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls podName:0f505b62-231b-46d0-b4f7-214081f12923 nodeName:}" failed. No retries permitted until 2026-07-08 23:10:10.043963791 +0000 UTC m=+166.203247285 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls") pod "dns-default-4zw4w" (UID: "0f505b62-231b-46d0-b4f7-214081f12923") : secret "dns-default-metrics-tls" not found Jul 08 23:09:06.614972 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:09:06.614945 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8cr2z" Jul 08 23:09:34.042910 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:09:34.042867 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs\") pod \"network-metrics-daemon-kwcdm\" (UID: \"3d290d52-819f-4ece-bc8e-11ce3dbb4d29\") " pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:09:34.043542 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:09:34.043056 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 23:09:34.043542 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:09:34.043151 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs podName:3d290d52-819f-4ece-bc8e-11ce3dbb4d29 nodeName:}" failed. No retries permitted until 2026-07-08 23:11:36.043127215 +0000 UTC m=+252.202410701 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs") pod "network-metrics-daemon-kwcdm" (UID: "3d290d52-819f-4ece-bc8e-11ce3dbb4d29") : secret "metrics-daemon-secret" not found Jul 08 23:10:05.083462 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:10:05.083430 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-j7ds6" podUID="5713a5a1-749f-48ca-a02f-dc9579c86957" Jul 08 23:10:05.094576 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:10:05.094548 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" podUID="675b1c56-1f9f-4dec-8a98-07dfb16fece3" Jul 08 23:10:05.116877 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:10:05.116838 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4zw4w" podUID="0f505b62-231b-46d0-b4f7-214081f12923" Jul 08 23:10:05.820933 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:10:05.820881 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-j7ds6" Jul 08 23:10:05.821097 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:10:05.820881 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:10:06.336657 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:10:06.336624 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-kwcdm" podUID="3d290d52-819f-4ece-bc8e-11ce3dbb4d29" Jul 08 23:10:10.003520 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:10:10.003474 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-j7ds6\" (UID: \"5713a5a1-749f-48ca-a02f-dc9579c86957\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j7ds6" Jul 08 23:10:10.003948 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:10:10.003606 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 23:10:10.003948 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:10:10.003662 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert podName:5713a5a1-749f-48ca-a02f-dc9579c86957 nodeName:}" failed. No retries permitted until 2026-07-08 23:12:12.003647957 +0000 UTC m=+288.162931445 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-j7ds6" (UID: "5713a5a1-749f-48ca-a02f-dc9579c86957") : secret "networking-console-plugin-cert" not found Jul 08 23:10:10.104506 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:10:10.104460 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls\") pod \"dns-default-4zw4w\" (UID: \"0f505b62-231b-46d0-b4f7-214081f12923\") " pod="openshift-dns/dns-default-4zw4w" Jul 08 23:10:10.104630 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:10:10.104518 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:10:10.104630 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:10:10.104601 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 23:10:10.104630 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:10:10.104609 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 23:10:10.104630 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:10:10.104622 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bdc54fbb5-9tsk2: secret "image-registry-tls" not found Jul 08 23:10:10.104751 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:10:10.104668 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls podName:0f505b62-231b-46d0-b4f7-214081f12923 nodeName:}" failed. No retries permitted until 2026-07-08 23:12:12.104654473 +0000 UTC m=+288.263937960 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls") pod "dns-default-4zw4w" (UID: "0f505b62-231b-46d0-b4f7-214081f12923") : secret "dns-default-metrics-tls" not found Jul 08 23:10:10.104751 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:10:10.104682 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls podName:675b1c56-1f9f-4dec-8a98-07dfb16fece3 nodeName:}" failed. No retries permitted until 2026-07-08 23:12:12.104676669 +0000 UTC m=+288.263960180 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls") pod "image-registry-5bdc54fbb5-9tsk2" (UID: "675b1c56-1f9f-4dec-8a98-07dfb16fece3") : secret "image-registry-tls" not found Jul 08 23:10:17.324040 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:10:17.323888 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:10:20.324648 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:10:20.324606 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4zw4w" Jul 08 23:10:39.623089 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:10:39.623033 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578d45fbdd-tgcd6" podUID="e692f568-f546-4617-a262-4c6e6b6307e8" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.10:8000/readyz\": dial tcp 10.132.0.10:8000: connect: connection refused" Jul 08 23:10:39.904136 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:10:39.904102 2572 generic.go:356] "Generic (PLEG): container finished" podID="e692f568-f546-4617-a262-4c6e6b6307e8" containerID="608e93f8362493285d4083893767e018155ffe125889ee8cfe2a1a464a2b6425" exitCode=1 Jul 08 23:10:39.904307 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:10:39.904141 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578d45fbdd-tgcd6" event={"ID":"e692f568-f546-4617-a262-4c6e6b6307e8","Type":"ContainerDied","Data":"608e93f8362493285d4083893767e018155ffe125889ee8cfe2a1a464a2b6425"} Jul 08 23:10:39.904439 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:10:39.904426 2572 scope.go:117] "RemoveContainer" containerID="608e93f8362493285d4083893767e018155ffe125889ee8cfe2a1a464a2b6425" Jul 08 23:10:40.908222 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:10:40.908188 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578d45fbdd-tgcd6" event={"ID":"e692f568-f546-4617-a262-4c6e6b6307e8","Type":"ContainerStarted","Data":"cab9c1ce598debceb1ecc5d4de1182bc522d22e63957ad0eb4eee3f970ba88c9"} Jul 08 23:10:40.908640 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:10:40.908446 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578d45fbdd-tgcd6" Jul 08 23:10:40.909044 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:10:40.909027 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578d45fbdd-tgcd6" Jul 08 23:11:05.893973 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:05.893938 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:11:36.126011 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:36.125958 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs\") pod \"network-metrics-daemon-kwcdm\" (UID: \"3d290d52-819f-4ece-bc8e-11ce3dbb4d29\") " pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:11:36.126445 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:36.126110 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 23:11:36.126445 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:36.126184 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs podName:3d290d52-819f-4ece-bc8e-11ce3dbb4d29 nodeName:}" failed. No retries permitted until 2026-07-08 23:13:38.126168017 +0000 UTC m=+374.285451505 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs") pod "network-metrics-daemon-kwcdm" (UID: "3d290d52-819f-4ece-bc8e-11ce3dbb4d29") : secret "metrics-daemon-secret" not found Jul 08 23:11:53.746746 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.746659 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6g2c"] Jul 08 23:11:53.749511 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.749493 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6g2c" Jul 08 23:11:53.752188 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.752170 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 23:11:53.753279 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.753257 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 08 23:11:53.753359 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.753289 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 23:11:53.753359 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.753299 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6dk8j\"" Jul 08 23:11:53.754796 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.754779 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 08 23:11:53.762926 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.762889 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6g2c"] Jul 08 23:11:53.845720 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.845672 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rxx9c"] Jul 08 23:11:53.848603 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.848582 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5fxf4"] Jul 08 23:11:53.848721 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.848701 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rxx9c" Jul 08 23:11:53.850844 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.850817 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 08 23:11:53.851203 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.851185 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 08 23:11:53.851289 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.851219 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 08 23:11:53.851289 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.851222 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-l8fb9\"" Jul 08 23:11:53.851410 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.851314 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5fxf4" Jul 08 23:11:53.851499 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.851483 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 08 23:11:53.853445 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.853425 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 08 23:11:53.853535 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.853482 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9739aa16-33a8-4311-9ba0-a431fad4fc00-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-q6g2c\" (UID: \"9739aa16-33a8-4311-9ba0-a431fad4fc00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6g2c" Jul 08 23:11:53.853594 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.853577 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjcst\" (UniqueName: \"kubernetes.io/projected/9739aa16-33a8-4311-9ba0-a431fad4fc00-kube-api-access-hjcst\") pod \"cluster-monitoring-operator-64786d9cbb-q6g2c\" (UID: \"9739aa16-33a8-4311-9ba0-a431fad4fc00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6g2c" Jul 08 23:11:53.853652 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.853621 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9739aa16-33a8-4311-9ba0-a431fad4fc00-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-q6g2c\" (UID: \"9739aa16-33a8-4311-9ba0-a431fad4fc00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6g2c" Jul 08 23:11:53.854016 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.853996 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 08 23:11:53.854133 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.854022 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 08 23:11:53.854231 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.854134 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vhxp2\"" Jul 08 23:11:53.861484 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.861364 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rxx9c"] Jul 08 23:11:53.862588 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.862565 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5fxf4"] Jul 08 23:11:53.954440 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.954409 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b7e8544c-2b88-4cad-a033-2907bcee4e6d-config\") pod \"service-ca-operator-5d46d9ffd4-rxx9c\" (UID: \"b7e8544c-2b88-4cad-a033-2907bcee4e6d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rxx9c" Jul 08 23:11:53.954613 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.954457 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/124bfc11-93e8-4fec-aadf-492b9dc582d8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5fxf4\" (UID: \"124bfc11-93e8-4fec-aadf-492b9dc582d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5fxf4" Jul 08 23:11:53.954613 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.954482 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9739aa16-33a8-4311-9ba0-a431fad4fc00-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-q6g2c\" (UID: \"9739aa16-33a8-4311-9ba0-a431fad4fc00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6g2c" Jul 08 23:11:53.954613 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:53.954579 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 23:11:53.954721 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.954621 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnlc7\" (UniqueName: \"kubernetes.io/projected/b7e8544c-2b88-4cad-a033-2907bcee4e6d-kube-api-access-bnlc7\") pod \"service-ca-operator-5d46d9ffd4-rxx9c\" (UID: \"b7e8544c-2b88-4cad-a033-2907bcee4e6d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rxx9c" Jul 08 23:11:53.954721 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:53.954657 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9739aa16-33a8-4311-9ba0-a431fad4fc00-cluster-monitoring-operator-tls podName:9739aa16-33a8-4311-9ba0-a431fad4fc00 nodeName:}" failed. No retries permitted until 2026-07-08 23:11:54.454633733 +0000 UTC m=+270.613917237 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9739aa16-33a8-4311-9ba0-a431fad4fc00-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-q6g2c" (UID: "9739aa16-33a8-4311-9ba0-a431fad4fc00") : secret "cluster-monitoring-operator-tls" not found Jul 08 23:11:53.954807 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.954719 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9739aa16-33a8-4311-9ba0-a431fad4fc00-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-q6g2c\" (UID: \"9739aa16-33a8-4311-9ba0-a431fad4fc00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6g2c" Jul 08 23:11:53.954807 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.954736 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b7e8544c-2b88-4cad-a033-2907bcee4e6d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-rxx9c\" (UID: \"b7e8544c-2b88-4cad-a033-2907bcee4e6d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rxx9c" Jul 08 23:11:53.954807 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.954767 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjcst\" (UniqueName: \"kubernetes.io/projected/9739aa16-33a8-4311-9ba0-a431fad4fc00-kube-api-access-hjcst\") pod \"cluster-monitoring-operator-64786d9cbb-q6g2c\" (UID: \"9739aa16-33a8-4311-9ba0-a431fad4fc00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6g2c" Jul 08 23:11:53.954977 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.954862 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn9vd\" (UniqueName: \"kubernetes.io/projected/124bfc11-93e8-4fec-aadf-492b9dc582d8-kube-api-access-bn9vd\") pod \"cluster-samples-operator-56fcf86bf-5fxf4\" (UID: \"124bfc11-93e8-4fec-aadf-492b9dc582d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5fxf4" Jul 08 23:11:53.955421 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.955402 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9739aa16-33a8-4311-9ba0-a431fad4fc00-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-q6g2c\" (UID: \"9739aa16-33a8-4311-9ba0-a431fad4fc00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6g2c" Jul 08 23:11:53.962914 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.962873 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjcst\" (UniqueName: \"kubernetes.io/projected/9739aa16-33a8-4311-9ba0-a431fad4fc00-kube-api-access-hjcst\") pod \"cluster-monitoring-operator-64786d9cbb-q6g2c\" (UID: \"9739aa16-33a8-4311-9ba0-a431fad4fc00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6g2c" Jul 08 23:11:53.970382 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:53.970358 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:11:54.056036 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:54.056005 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn9vd\" (UniqueName: \"kubernetes.io/projected/124bfc11-93e8-4fec-aadf-492b9dc582d8-kube-api-access-bn9vd\") pod \"cluster-samples-operator-56fcf86bf-5fxf4\" (UID: \"124bfc11-93e8-4fec-aadf-492b9dc582d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5fxf4" Jul 08 23:11:54.056182 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:54.056051 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b7e8544c-2b88-4cad-a033-2907bcee4e6d-config\") pod \"service-ca-operator-5d46d9ffd4-rxx9c\" (UID: \"b7e8544c-2b88-4cad-a033-2907bcee4e6d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rxx9c" Jul 08 23:11:54.056182 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:54.056095 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/124bfc11-93e8-4fec-aadf-492b9dc582d8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5fxf4\" (UID: \"124bfc11-93e8-4fec-aadf-492b9dc582d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5fxf4" Jul 08 23:11:54.056182 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:54.056147 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnlc7\" (UniqueName: \"kubernetes.io/projected/b7e8544c-2b88-4cad-a033-2907bcee4e6d-kube-api-access-bnlc7\") pod \"service-ca-operator-5d46d9ffd4-rxx9c\" (UID: \"b7e8544c-2b88-4cad-a033-2907bcee4e6d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rxx9c" Jul 08 23:11:54.056182 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:54.056177 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b7e8544c-2b88-4cad-a033-2907bcee4e6d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-rxx9c\" (UID: \"b7e8544c-2b88-4cad-a033-2907bcee4e6d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rxx9c" Jul 08 23:11:54.056336 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:54.056272 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 23:11:54.056369 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:54.056344 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/124bfc11-93e8-4fec-aadf-492b9dc582d8-samples-operator-tls podName:124bfc11-93e8-4fec-aadf-492b9dc582d8 nodeName:}" failed. No retries permitted until 2026-07-08 23:11:54.556327727 +0000 UTC m=+270.715611225 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/124bfc11-93e8-4fec-aadf-492b9dc582d8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-5fxf4" (UID: "124bfc11-93e8-4fec-aadf-492b9dc582d8") : secret "samples-operator-tls" not found Jul 08 23:11:54.056691 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:54.056674 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b7e8544c-2b88-4cad-a033-2907bcee4e6d-config\") pod \"service-ca-operator-5d46d9ffd4-rxx9c\" (UID: \"b7e8544c-2b88-4cad-a033-2907bcee4e6d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rxx9c" Jul 08 23:11:54.058309 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:54.058293 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b7e8544c-2b88-4cad-a033-2907bcee4e6d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-rxx9c\" (UID: \"b7e8544c-2b88-4cad-a033-2907bcee4e6d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rxx9c" Jul 08 23:11:54.064647 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:54.064623 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnlc7\" (UniqueName: \"kubernetes.io/projected/b7e8544c-2b88-4cad-a033-2907bcee4e6d-kube-api-access-bnlc7\") pod \"service-ca-operator-5d46d9ffd4-rxx9c\" (UID: \"b7e8544c-2b88-4cad-a033-2907bcee4e6d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rxx9c" Jul 08 23:11:54.064748 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:54.064692 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn9vd\" (UniqueName: \"kubernetes.io/projected/124bfc11-93e8-4fec-aadf-492b9dc582d8-kube-api-access-bn9vd\") pod \"cluster-samples-operator-56fcf86bf-5fxf4\" (UID: \"124bfc11-93e8-4fec-aadf-492b9dc582d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5fxf4" Jul 08 23:11:54.072059 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:54.072037 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:11:54.162494 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:54.162453 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rxx9c" Jul 08 23:11:54.282030 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:54.282003 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rxx9c"] Jul 08 23:11:54.284845 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:11:54.284823 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7e8544c_2b88_4cad_a033_2907bcee4e6d.slice/crio-6ac02a9360bfa18e82a16f65ded91a5861da04a63a8b73df9056e015afbf403e WatchSource:0}: Error finding container 6ac02a9360bfa18e82a16f65ded91a5861da04a63a8b73df9056e015afbf403e: Status 404 returned error can't find the container with id 6ac02a9360bfa18e82a16f65ded91a5861da04a63a8b73df9056e015afbf403e Jul 08 23:11:54.459946 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:54.459871 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9739aa16-33a8-4311-9ba0-a431fad4fc00-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-q6g2c\" (UID: \"9739aa16-33a8-4311-9ba0-a431fad4fc00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6g2c" Jul 08 23:11:54.460060 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:54.460010 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 23:11:54.460101 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:54.460077 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9739aa16-33a8-4311-9ba0-a431fad4fc00-cluster-monitoring-operator-tls podName:9739aa16-33a8-4311-9ba0-a431fad4fc00 nodeName:}" failed. No retries permitted until 2026-07-08 23:11:55.460058234 +0000 UTC m=+271.619341725 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9739aa16-33a8-4311-9ba0-a431fad4fc00-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-q6g2c" (UID: "9739aa16-33a8-4311-9ba0-a431fad4fc00") : secret "cluster-monitoring-operator-tls" not found Jul 08 23:11:54.560740 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:54.560710 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/124bfc11-93e8-4fec-aadf-492b9dc582d8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5fxf4\" (UID: \"124bfc11-93e8-4fec-aadf-492b9dc582d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5fxf4" Jul 08 23:11:54.560870 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:54.560852 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 23:11:54.560949 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:54.560933 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/124bfc11-93e8-4fec-aadf-492b9dc582d8-samples-operator-tls podName:124bfc11-93e8-4fec-aadf-492b9dc582d8 nodeName:}" failed. No retries permitted until 2026-07-08 23:11:55.560917822 +0000 UTC m=+271.720201308 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/124bfc11-93e8-4fec-aadf-492b9dc582d8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-5fxf4" (UID: "124bfc11-93e8-4fec-aadf-492b9dc582d8") : secret "samples-operator-tls" not found Jul 08 23:11:55.082672 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:55.082636 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rxx9c" event={"ID":"b7e8544c-2b88-4cad-a033-2907bcee4e6d","Type":"ContainerStarted","Data":"6ac02a9360bfa18e82a16f65ded91a5861da04a63a8b73df9056e015afbf403e"} Jul 08 23:11:55.469140 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:55.469053 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9739aa16-33a8-4311-9ba0-a431fad4fc00-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-q6g2c\" (UID: \"9739aa16-33a8-4311-9ba0-a431fad4fc00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6g2c" Jul 08 23:11:55.469278 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:55.469203 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 23:11:55.469278 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:55.469266 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9739aa16-33a8-4311-9ba0-a431fad4fc00-cluster-monitoring-operator-tls podName:9739aa16-33a8-4311-9ba0-a431fad4fc00 nodeName:}" failed. No retries permitted until 2026-07-08 23:11:57.469250648 +0000 UTC m=+273.628534134 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9739aa16-33a8-4311-9ba0-a431fad4fc00-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-q6g2c" (UID: "9739aa16-33a8-4311-9ba0-a431fad4fc00") : secret "cluster-monitoring-operator-tls" not found Jul 08 23:11:55.569441 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:55.569413 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/124bfc11-93e8-4fec-aadf-492b9dc582d8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5fxf4\" (UID: \"124bfc11-93e8-4fec-aadf-492b9dc582d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5fxf4" Jul 08 23:11:55.569589 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:55.569559 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 23:11:55.569634 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:55.569619 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/124bfc11-93e8-4fec-aadf-492b9dc582d8-samples-operator-tls podName:124bfc11-93e8-4fec-aadf-492b9dc582d8 nodeName:}" failed. No retries permitted until 2026-07-08 23:11:57.569605105 +0000 UTC m=+273.728888592 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/124bfc11-93e8-4fec-aadf-492b9dc582d8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-5fxf4" (UID: "124bfc11-93e8-4fec-aadf-492b9dc582d8") : secret "samples-operator-tls" not found Jul 08 23:11:56.374432 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:56.374396 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:11:56.422686 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:56.422641 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:11:57.090522 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:57.090484 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rxx9c" event={"ID":"b7e8544c-2b88-4cad-a033-2907bcee4e6d","Type":"ContainerStarted","Data":"fb2ebf388d2edf1cbe2e54907954da8e27ff5f743a86de23a2409b18de45f1ac"} Jul 08 23:11:57.107885 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:57.107839 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rxx9c" podStartSLOduration=2.213021477 podStartE2EDuration="4.107822832s" totalImagesPullingTime="1.894801355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:11:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:11:57.104615323 +0000 UTC m=+273.263898831" watchObservedRunningTime="2026-07-08 23:11:57.107822832 +0000 UTC m=+273.267106341" Jul 08 23:11:57.484342 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:57.484254 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9739aa16-33a8-4311-9ba0-a431fad4fc00-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-q6g2c\" (UID: \"9739aa16-33a8-4311-9ba0-a431fad4fc00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6g2c" Jul 08 23:11:57.484779 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:57.484362 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 23:11:57.484779 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:57.484414 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9739aa16-33a8-4311-9ba0-a431fad4fc00-cluster-monitoring-operator-tls podName:9739aa16-33a8-4311-9ba0-a431fad4fc00 nodeName:}" failed. No retries permitted until 2026-07-08 23:12:01.484401366 +0000 UTC m=+277.643684853 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9739aa16-33a8-4311-9ba0-a431fad4fc00-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-q6g2c" (UID: "9739aa16-33a8-4311-9ba0-a431fad4fc00") : secret "cluster-monitoring-operator-tls" not found Jul 08 23:11:57.585233 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:57.585203 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/124bfc11-93e8-4fec-aadf-492b9dc582d8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5fxf4\" (UID: \"124bfc11-93e8-4fec-aadf-492b9dc582d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5fxf4" Jul 08 23:11:57.585410 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:57.585380 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 23:11:57.585477 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:57.585465 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/124bfc11-93e8-4fec-aadf-492b9dc582d8-samples-operator-tls podName:124bfc11-93e8-4fec-aadf-492b9dc582d8 nodeName:}" failed. No retries permitted until 2026-07-08 23:12:01.585443157 +0000 UTC m=+277.744726661 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/124bfc11-93e8-4fec-aadf-492b9dc582d8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-5fxf4" (UID: "124bfc11-93e8-4fec-aadf-492b9dc582d8") : secret "samples-operator-tls" not found Jul 08 23:11:57.721762 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:57.721732 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:11:58.168845 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:58.168813 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-g4c2s"] Jul 08 23:11:58.172079 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:58.172060 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g4c2s" Jul 08 23:11:58.174507 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:58.174485 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 23:11:58.174624 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:58.174598 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 23:11:58.174679 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:58.174641 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 23:11:58.175661 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:58.175638 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 23:11:58.175771 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:58.175751 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f5gd8\"" Jul 08 23:11:58.180812 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:58.180791 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g4c2s"] Jul 08 23:11:58.189716 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:58.189688 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:11:58.245935 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:58.245886 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:11:58.290608 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:58.290585 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-data-volume\") pod \"insights-runtime-extractor-g4c2s\" (UID: \"a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3\") " pod="openshift-insights/insights-runtime-extractor-g4c2s" Jul 08 23:11:58.290683 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:58.290636 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g4c2s\" (UID: \"a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3\") " pod="openshift-insights/insights-runtime-extractor-g4c2s" Jul 08 23:11:58.290683 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:58.290665 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-856sp\" (UniqueName: \"kubernetes.io/projected/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-kube-api-access-856sp\") pod \"insights-runtime-extractor-g4c2s\" (UID: \"a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3\") " pod="openshift-insights/insights-runtime-extractor-g4c2s" Jul 08 23:11:58.290756 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:58.290701 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g4c2s\" (UID: \"a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3\") " pod="openshift-insights/insights-runtime-extractor-g4c2s" Jul 08 23:11:58.290756 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:58.290720 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-crio-socket\") pod \"insights-runtime-extractor-g4c2s\" (UID: \"a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3\") " pod="openshift-insights/insights-runtime-extractor-g4c2s" Jul 08 23:11:58.391482 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:58.391448 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g4c2s\" (UID: \"a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3\") " pod="openshift-insights/insights-runtime-extractor-g4c2s" Jul 08 23:11:58.391639 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:58.391498 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-856sp\" (UniqueName: \"kubernetes.io/projected/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-kube-api-access-856sp\") pod \"insights-runtime-extractor-g4c2s\" (UID: \"a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3\") " pod="openshift-insights/insights-runtime-extractor-g4c2s" Jul 08 23:11:58.391639 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:58.391553 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g4c2s\" (UID: \"a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3\") " pod="openshift-insights/insights-runtime-extractor-g4c2s" Jul 08 23:11:58.391639 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:58.391582 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-crio-socket\") pod \"insights-runtime-extractor-g4c2s\" (UID: \"a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3\") " pod="openshift-insights/insights-runtime-extractor-g4c2s" Jul 08 23:11:58.391639 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:58.391601 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 23:11:58.391852 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:58.391666 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-insights-runtime-extractor-tls podName:a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3 nodeName:}" failed. No retries permitted until 2026-07-08 23:11:58.891647913 +0000 UTC m=+275.050931400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g4c2s" (UID: "a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3") : secret "insights-runtime-extractor-tls" not found Jul 08 23:11:58.391852 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:58.391667 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 23:11:58.391852 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:58.391679 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-crio-socket\") pod \"insights-runtime-extractor-g4c2s\" (UID: \"a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3\") " pod="openshift-insights/insights-runtime-extractor-g4c2s" Jul 08 23:11:58.391852 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:58.391731 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-kube-rbac-proxy-cm podName:a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3 nodeName:}" failed. No retries permitted until 2026-07-08 23:11:58.891714785 +0000 UTC m=+275.050998272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g4c2s" (UID: "a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3") : configmap "kube-rbac-proxy" not found Jul 08 23:11:58.391852 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:58.391776 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-data-volume\") pod \"insights-runtime-extractor-g4c2s\" (UID: \"a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3\") " pod="openshift-insights/insights-runtime-extractor-g4c2s" Jul 08 23:11:58.392170 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:58.392151 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-data-volume\") pod \"insights-runtime-extractor-g4c2s\" (UID: \"a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3\") " pod="openshift-insights/insights-runtime-extractor-g4c2s" Jul 08 23:11:58.405268 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:58.405239 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-856sp\" (UniqueName: \"kubernetes.io/projected/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-kube-api-access-856sp\") pod \"insights-runtime-extractor-g4c2s\" (UID: \"a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3\") " pod="openshift-insights/insights-runtime-extractor-g4c2s" Jul 08 23:11:58.458712 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:58.458638 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:11:58.509000 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:58.508974 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:11:58.895639 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:58.895601 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g4c2s\" (UID: \"a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3\") " pod="openshift-insights/insights-runtime-extractor-g4c2s" Jul 08 23:11:58.895788 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:58.895699 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g4c2s\" (UID: \"a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3\") " pod="openshift-insights/insights-runtime-extractor-g4c2s" Jul 08 23:11:58.895788 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:58.895709 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 23:11:58.895788 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:58.895767 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-kube-rbac-proxy-cm podName:a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3 nodeName:}" failed. No retries permitted until 2026-07-08 23:11:59.89575108 +0000 UTC m=+276.055034572 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g4c2s" (UID: "a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3") : configmap "kube-rbac-proxy" not found Jul 08 23:11:58.895929 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:58.895800 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 23:11:58.895929 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:58.895841 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-insights-runtime-extractor-tls podName:a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3 nodeName:}" failed. No retries permitted until 2026-07-08 23:11:59.895830699 +0000 UTC m=+276.055114186 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g4c2s" (UID: "a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3") : secret "insights-runtime-extractor-tls" not found Jul 08 23:11:59.424326 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:59.424293 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:11:59.434949 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:59.434921 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-rw9l7"] Jul 08 23:11:59.438084 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:59.438070 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-rw9l7" Jul 08 23:11:59.440301 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:59.440273 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 08 23:11:59.440301 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:59.440299 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 08 23:11:59.440426 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:59.440413 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-kfscc\"" Jul 08 23:11:59.447073 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:59.447045 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-rw9l7"] Jul 08 23:11:59.500887 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:59.500858 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44qh6\" (UniqueName: \"kubernetes.io/projected/54c921e6-9f3c-477f-92ca-7c4c49fdf26d-kube-api-access-44qh6\") pod \"migrator-d57d58cc9-rw9l7\" (UID: \"54c921e6-9f3c-477f-92ca-7c4c49fdf26d\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-rw9l7" Jul 08 23:11:59.526624 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:59.526593 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:11:59.602218 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:59.602188 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44qh6\" (UniqueName: \"kubernetes.io/projected/54c921e6-9f3c-477f-92ca-7c4c49fdf26d-kube-api-access-44qh6\") pod \"migrator-d57d58cc9-rw9l7\" (UID: \"54c921e6-9f3c-477f-92ca-7c4c49fdf26d\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-rw9l7" Jul 08 23:11:59.609289 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:59.609263 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44qh6\" (UniqueName: \"kubernetes.io/projected/54c921e6-9f3c-477f-92ca-7c4c49fdf26d-kube-api-access-44qh6\") pod \"migrator-d57d58cc9-rw9l7\" (UID: \"54c921e6-9f3c-477f-92ca-7c4c49fdf26d\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-rw9l7" Jul 08 23:11:59.624679 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:59.624645 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:11:59.747027 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:59.746948 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-rw9l7" Jul 08 23:11:59.863814 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:59.863784 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-rw9l7"] Jul 08 23:11:59.866582 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:11:59.866559 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54c921e6_9f3c_477f_92ca_7c4c49fdf26d.slice/crio-927ef7bca6859818ce28cccc4709e2420f58dfe486f219f473e1d5a290a01c6f WatchSource:0}: Error finding container 927ef7bca6859818ce28cccc4709e2420f58dfe486f219f473e1d5a290a01c6f: Status 404 returned error can't find the container with id 927ef7bca6859818ce28cccc4709e2420f58dfe486f219f473e1d5a290a01c6f Jul 08 23:11:59.905973 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:59.905949 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g4c2s\" (UID: \"a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3\") " pod="openshift-insights/insights-runtime-extractor-g4c2s" Jul 08 23:11:59.906076 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:11:59.906006 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g4c2s\" (UID: \"a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3\") " pod="openshift-insights/insights-runtime-extractor-g4c2s" Jul 08 23:11:59.906125 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:59.906091 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 23:11:59.906125 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:59.906093 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 23:11:59.906201 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:59.906137 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-kube-rbac-proxy-cm podName:a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3 nodeName:}" failed. No retries permitted until 2026-07-08 23:12:01.906123469 +0000 UTC m=+278.065406959 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g4c2s" (UID: "a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3") : configmap "kube-rbac-proxy" not found Jul 08 23:11:59.906201 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:11:59.906149 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-insights-runtime-extractor-tls podName:a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3 nodeName:}" failed. No retries permitted until 2026-07-08 23:12:01.906143037 +0000 UTC m=+278.065426524 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g4c2s" (UID: "a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3") : secret "insights-runtime-extractor-tls" not found Jul 08 23:12:00.056632 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:00.056597 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:00.101975 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:00.101946 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-rw9l7" event={"ID":"54c921e6-9f3c-477f-92ca-7c4c49fdf26d","Type":"ContainerStarted","Data":"927ef7bca6859818ce28cccc4709e2420f58dfe486f219f473e1d5a290a01c6f"} Jul 08 23:12:00.111610 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:00.111581 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:00.151511 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:00.151486 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pfq7d_68fda8d2-5fe9-40a0-8d69-a8ff51d15e23/dns-node-resolver/0.log" Jul 08 23:12:00.806430 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:00.806391 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:00.865133 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:00.865100 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:00.930458 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:00.930423 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:00.952388 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:00.952366 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-42qwx_4f14c98f-3358-494e-bde0-76dd7436a833/node-ca/0.log" Jul 08 23:12:01.520093 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:01.520053 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9739aa16-33a8-4311-9ba0-a431fad4fc00-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-q6g2c\" (UID: \"9739aa16-33a8-4311-9ba0-a431fad4fc00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6g2c" Jul 08 23:12:01.520249 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:12:01.520217 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 23:12:01.520292 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:12:01.520281 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9739aa16-33a8-4311-9ba0-a431fad4fc00-cluster-monitoring-operator-tls podName:9739aa16-33a8-4311-9ba0-a431fad4fc00 nodeName:}" failed. No retries permitted until 2026-07-08 23:12:09.520263494 +0000 UTC m=+285.679546991 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9739aa16-33a8-4311-9ba0-a431fad4fc00-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-q6g2c" (UID: "9739aa16-33a8-4311-9ba0-a431fad4fc00") : secret "cluster-monitoring-operator-tls" not found Jul 08 23:12:01.621314 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:01.621223 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/124bfc11-93e8-4fec-aadf-492b9dc582d8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5fxf4\" (UID: \"124bfc11-93e8-4fec-aadf-492b9dc582d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5fxf4" Jul 08 23:12:01.621475 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:12:01.621373 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 23:12:01.621475 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:12:01.621464 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/124bfc11-93e8-4fec-aadf-492b9dc582d8-samples-operator-tls podName:124bfc11-93e8-4fec-aadf-492b9dc582d8 nodeName:}" failed. No retries permitted until 2026-07-08 23:12:09.621448094 +0000 UTC m=+285.780731580 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/124bfc11-93e8-4fec-aadf-492b9dc582d8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-5fxf4" (UID: "124bfc11-93e8-4fec-aadf-492b9dc582d8") : secret "samples-operator-tls" not found Jul 08 23:12:01.751826 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:01.751798 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l5z9c_8c67c695-4fa0-4d4d-a8c1-2e24e1f3012c/serve-healthcheck-canary/0.log" Jul 08 23:12:01.923863 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:01.923788 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g4c2s\" (UID: \"a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3\") " pod="openshift-insights/insights-runtime-extractor-g4c2s" Jul 08 23:12:01.924212 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:01.923871 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g4c2s\" (UID: \"a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3\") " pod="openshift-insights/insights-runtime-extractor-g4c2s" Jul 08 23:12:01.924212 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:12:01.923924 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 23:12:01.924212 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:12:01.923987 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 23:12:01.924212 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:12:01.923990 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-kube-rbac-proxy-cm podName:a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3 nodeName:}" failed. No retries permitted until 2026-07-08 23:12:05.92397399 +0000 UTC m=+282.083257494 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g4c2s" (UID: "a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3") : configmap "kube-rbac-proxy" not found Jul 08 23:12:01.924212 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:12:01.924033 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-insights-runtime-extractor-tls podName:a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3 nodeName:}" failed. No retries permitted until 2026-07-08 23:12:05.924021986 +0000 UTC m=+282.083305473 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g4c2s" (UID: "a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3") : secret "insights-runtime-extractor-tls" not found Jul 08 23:12:02.111533 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:02.111496 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-rw9l7" event={"ID":"54c921e6-9f3c-477f-92ca-7c4c49fdf26d","Type":"ContainerStarted","Data":"3541d7bc8dbbbe45b85610c17a654ed726866619030d9226b627cd9d3d3ae679"} Jul 08 23:12:02.111729 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:02.111619 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-rw9l7" event={"ID":"54c921e6-9f3c-477f-92ca-7c4c49fdf26d","Type":"ContainerStarted","Data":"078b29a76d8cb38ad46d3b9393a3a10631c2b0ea08625e3a50aa01ac737b89e2"} Jul 08 23:12:02.128044 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:02.127995 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-rw9l7" podStartSLOduration=1.7178336220000001 podStartE2EDuration="3.127979453s" totalImagesPullingTime="1.410145831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:11:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:12:02.126150541 +0000 UTC m=+278.285434050" watchObservedRunningTime="2026-07-08 23:12:02.127979453 +0000 UTC m=+278.287262962" Jul 08 23:12:03.063808 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:03.063771 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:03.561193 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:03.561158 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:03.663078 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:03.663048 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:03.761115 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:03.761084 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:03.862665 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:03.862576 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:03.921646 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:03.921622 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:04.470528 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:04.470501 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:05.255399 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:05.255373 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:05.457930 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:05.457885 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:05.861661 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:05.861630 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:05.956282 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:05.956244 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g4c2s\" (UID: \"a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3\") " pod="openshift-insights/insights-runtime-extractor-g4c2s" Jul 08 23:12:05.956458 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:05.956311 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g4c2s\" (UID: \"a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3\") " pod="openshift-insights/insights-runtime-extractor-g4c2s" Jul 08 23:12:05.956458 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:12:05.956373 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 23:12:05.956458 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:12:05.956411 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 23:12:05.956458 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:12:05.956424 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-kube-rbac-proxy-cm podName:a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3 nodeName:}" failed. No retries permitted until 2026-07-08 23:12:13.956410419 +0000 UTC m=+290.115693905 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g4c2s" (UID: "a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3") : configmap "kube-rbac-proxy" not found Jul 08 23:12:05.956607 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:12:05.956468 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-insights-runtime-extractor-tls podName:a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3 nodeName:}" failed. No retries permitted until 2026-07-08 23:12:13.956451139 +0000 UTC m=+290.115734631 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g4c2s" (UID: "a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3") : secret "insights-runtime-extractor-tls" not found Jul 08 23:12:06.058932 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:06.058883 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:06.454839 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:06.454809 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:07.061399 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:07.061364 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:07.161364 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:07.161337 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:07.390792 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:07.390711 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:07.488696 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:07.488667 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:07.540454 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:07.540425 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:07.860701 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:07.860671 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:08.059708 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:08.059676 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:08.455681 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:08.455647 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:08.821933 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:12:08.821879 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-j7ds6" podUID="5713a5a1-749f-48ca-a02f-dc9579c86957" Jul 08 23:12:08.821933 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:12:08.821879 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" podUID="675b1c56-1f9f-4dec-8a98-07dfb16fece3" Jul 08 23:12:09.134481 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:09.134413 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-j7ds6" Jul 08 23:12:09.134614 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:09.134413 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:12:09.258597 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:09.258540 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:09.584200 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:09.584164 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9739aa16-33a8-4311-9ba0-a431fad4fc00-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-q6g2c\" (UID: \"9739aa16-33a8-4311-9ba0-a431fad4fc00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6g2c" Jul 08 23:12:09.584623 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:12:09.584309 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 23:12:09.584623 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:12:09.584370 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9739aa16-33a8-4311-9ba0-a431fad4fc00-cluster-monitoring-operator-tls podName:9739aa16-33a8-4311-9ba0-a431fad4fc00 nodeName:}" failed. No retries permitted until 2026-07-08 23:12:25.584356405 +0000 UTC m=+301.743639891 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9739aa16-33a8-4311-9ba0-a431fad4fc00-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-q6g2c" (UID: "9739aa16-33a8-4311-9ba0-a431fad4fc00") : secret "cluster-monitoring-operator-tls" not found Jul 08 23:12:09.655456 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:09.655421 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:09.685549 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:09.685519 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/124bfc11-93e8-4fec-aadf-492b9dc582d8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5fxf4\" (UID: \"124bfc11-93e8-4fec-aadf-492b9dc582d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5fxf4" Jul 08 23:12:09.687986 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:09.687963 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/124bfc11-93e8-4fec-aadf-492b9dc582d8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5fxf4\" (UID: \"124bfc11-93e8-4fec-aadf-492b9dc582d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5fxf4" Jul 08 23:12:09.768661 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:09.768622 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5fxf4" Jul 08 23:12:09.858753 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:09.858724 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:09.890883 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:09.890862 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5fxf4"] Jul 08 23:12:10.064233 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:10.064200 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:10.118115 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:10.118039 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:10.138439 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:10.138408 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5fxf4" event={"ID":"124bfc11-93e8-4fec-aadf-492b9dc582d8","Type":"ContainerStarted","Data":"bc911628ef75493386fd99aa5e5099aaa4a67a6e50742796d3c078b454aaf8f0"} Jul 08 23:12:10.258599 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:10.258571 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:11.093478 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:11.093447 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:11.380336 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:11.380259 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:11.662329 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:11.662247 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:11.858713 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:11.858682 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:12.005558 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:12.005484 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-j7ds6\" (UID: \"5713a5a1-749f-48ca-a02f-dc9579c86957\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j7ds6" Jul 08 23:12:12.007805 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:12.007786 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5713a5a1-749f-48ca-a02f-dc9579c86957-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-j7ds6\" (UID: \"5713a5a1-749f-48ca-a02f-dc9579c86957\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j7ds6" Jul 08 23:12:12.106164 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:12.106127 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls\") pod \"dns-default-4zw4w\" (UID: \"0f505b62-231b-46d0-b4f7-214081f12923\") " pod="openshift-dns/dns-default-4zw4w" Jul 08 23:12:12.106164 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:12.106173 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:12:12.108760 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:12.108731 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f505b62-231b-46d0-b4f7-214081f12923-metrics-tls\") pod \"dns-default-4zw4w\" (UID: \"0f505b62-231b-46d0-b4f7-214081f12923\") " pod="openshift-dns/dns-default-4zw4w" Jul 08 23:12:12.108760 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:12.108757 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls\") pod \"image-registry-5bdc54fbb5-9tsk2\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:12:12.120096 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:12.120069 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:12.138117 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:12.138093 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sq6cw\"" Jul 08 23:12:12.138273 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:12.138094 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7bchb\"" Jul 08 23:12:12.145134 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:12.145113 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-j7ds6" Jul 08 23:12:12.145271 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:12.145149 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:12:12.169859 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:12.169818 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:12.227134 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:12.227100 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vhnmb\"" Jul 08 23:12:12.235564 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:12.235535 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4zw4w" Jul 08 23:12:12.260055 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:12.260007 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:12.456025 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:12.455994 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:12.602205 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:12.602176 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bdc54fbb5-9tsk2"] Jul 08 23:12:12.606091 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:12:12.606059 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod675b1c56_1f9f_4dec_8a98_07dfb16fece3.slice/crio-59e2255406bbeab557fc2c52841fa22be4ac1e71f1d073f8f7c05249505d0289 WatchSource:0}: Error finding container 59e2255406bbeab557fc2c52841fa22be4ac1e71f1d073f8f7c05249505d0289: Status 404 returned error can't find the container with id 59e2255406bbeab557fc2c52841fa22be4ac1e71f1d073f8f7c05249505d0289 Jul 08 23:12:12.617776 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:12.617528 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-j7ds6"] Jul 08 23:12:12.622323 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:12:12.622295 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5713a5a1_749f_48ca_a02f_dc9579c86957.slice/crio-fb3be0467b6b18bd9bc3289a6a258cd625d2fa622c5ed7f4b6ea2dcad5dd346f WatchSource:0}: Error finding container fb3be0467b6b18bd9bc3289a6a258cd625d2fa622c5ed7f4b6ea2dcad5dd346f: Status 404 returned error can't find the container with id fb3be0467b6b18bd9bc3289a6a258cd625d2fa622c5ed7f4b6ea2dcad5dd346f Jul 08 23:12:12.639056 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:12.639029 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4zw4w"] Jul 08 23:12:12.643312 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:12:12.643268 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f505b62_231b_46d0_b4f7_214081f12923.slice/crio-7f6f9c91662649f132a6b2188f4bb5fe9232c75aeabe97b6f66f04f8d38003dd WatchSource:0}: Error finding container 7f6f9c91662649f132a6b2188f4bb5fe9232c75aeabe97b6f66f04f8d38003dd: Status 404 returned error can't find the container with id 7f6f9c91662649f132a6b2188f4bb5fe9232c75aeabe97b6f66f04f8d38003dd Jul 08 23:12:12.856994 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:12.856912 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:13.153191 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:13.153107 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-j7ds6" event={"ID":"5713a5a1-749f-48ca-a02f-dc9579c86957","Type":"ContainerStarted","Data":"fb3be0467b6b18bd9bc3289a6a258cd625d2fa622c5ed7f4b6ea2dcad5dd346f"} Jul 08 23:12:13.154920 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:13.154880 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5fxf4" event={"ID":"124bfc11-93e8-4fec-aadf-492b9dc582d8","Type":"ContainerStarted","Data":"7461d6184e9357290292feec19d1e0c61a18b619484b869b8687f3722c9356f4"} Jul 08 23:12:13.155050 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:13.154941 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5fxf4" event={"ID":"124bfc11-93e8-4fec-aadf-492b9dc582d8","Type":"ContainerStarted","Data":"d2fc733155aac53b1918389fc82a5a8a31d725d474c747fdad8217879a353eab"} Jul 08 23:12:13.156071 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:13.156047 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4zw4w" event={"ID":"0f505b62-231b-46d0-b4f7-214081f12923","Type":"ContainerStarted","Data":"7f6f9c91662649f132a6b2188f4bb5fe9232c75aeabe97b6f66f04f8d38003dd"} Jul 08 23:12:13.157384 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:13.157362 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" event={"ID":"675b1c56-1f9f-4dec-8a98-07dfb16fece3","Type":"ContainerStarted","Data":"b68ca0ae167f5c0639ddf8dbe77e7872d7eaa17af99977b6cc00e216b5cedc01"} Jul 08 23:12:13.157467 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:13.157400 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" event={"ID":"675b1c56-1f9f-4dec-8a98-07dfb16fece3","Type":"ContainerStarted","Data":"59e2255406bbeab557fc2c52841fa22be4ac1e71f1d073f8f7c05249505d0289"} Jul 08 23:12:13.157467 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:13.157445 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:12:13.169150 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:13.169115 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5fxf4" podStartSLOduration=17.584400411 podStartE2EDuration="20.169102764s" totalImagesPullingTime="2.584702353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:11:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:12:13.168744649 +0000 UTC m=+289.328028154" watchObservedRunningTime="2026-07-08 23:12:13.169102764 +0000 UTC m=+289.328386317" Jul 08 23:12:13.185029 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:13.184993 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" podStartSLOduration=289.184979653 podStartE2EDuration="4m49.184979653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:07:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:12:13.184360595 +0000 UTC m=+289.343644103" watchObservedRunningTime="2026-07-08 23:12:13.184979653 +0000 UTC m=+289.344263162" Jul 08 23:12:13.257059 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:13.257034 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:13.860385 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:13.860341 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:14.023105 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:14.023076 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g4c2s\" (UID: \"a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3\") " pod="openshift-insights/insights-runtime-extractor-g4c2s" Jul 08 23:12:14.023271 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:14.023144 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g4c2s\" (UID: \"a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3\") " pod="openshift-insights/insights-runtime-extractor-g4c2s" Jul 08 23:12:14.023642 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:14.023618 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g4c2s\" (UID: \"a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3\") " pod="openshift-insights/insights-runtime-extractor-g4c2s" Jul 08 23:12:14.025569 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:14.025543 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g4c2s\" (UID: \"a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3\") " pod="openshift-insights/insights-runtime-extractor-g4c2s" Jul 08 23:12:14.067034 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:14.067002 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:14.080974 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:14.080951 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g4c2s" Jul 08 23:12:14.163821 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:14.163794 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-j7ds6" event={"ID":"5713a5a1-749f-48ca-a02f-dc9579c86957","Type":"ContainerStarted","Data":"376b256a49a9bef2a03a40812e6e0fee92734ea47cdac7f99d3eff1ff4c4f090"} Jul 08 23:12:14.178962 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:14.178841 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-j7ds6" podStartSLOduration=274.932119385 podStartE2EDuration="4m36.178825213s" totalImagesPullingTime="1.246705828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:12:14.177947591 +0000 UTC m=+290.337231100" watchObservedRunningTime="2026-07-08 23:12:14.178825213 +0000 UTC m=+290.338108713" Jul 08 23:12:14.205443 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:14.205416 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g4c2s"] Jul 08 23:12:14.208261 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:12:14.208239 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1bea9e7_7b18_4a97_a6f1_ec3d5eb8e9a3.slice/crio-deb607a575ed7472da9d7013b5ec1c1ab1fd18d5d786fef0f5f4657f6c1625b0 WatchSource:0}: Error finding container deb607a575ed7472da9d7013b5ec1c1ab1fd18d5d786fef0f5f4657f6c1625b0: Status 404 returned error can't find the container with id deb607a575ed7472da9d7013b5ec1c1ab1fd18d5d786fef0f5f4657f6c1625b0 Jul 08 23:12:14.257442 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:14.257410 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:15.170111 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:15.170024 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g4c2s" event={"ID":"a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3","Type":"ContainerStarted","Data":"deb607a575ed7472da9d7013b5ec1c1ab1fd18d5d786fef0f5f4657f6c1625b0"} Jul 08 23:12:16.175606 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:16.175521 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4zw4w" event={"ID":"0f505b62-231b-46d0-b4f7-214081f12923","Type":"ContainerStarted","Data":"8b4dc0a469eb0a3a01046d92fb02fd30c9d86c7d3a318417a95e64a2379368ff"} Jul 08 23:12:16.175606 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:16.175586 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4zw4w" event={"ID":"0f505b62-231b-46d0-b4f7-214081f12923","Type":"ContainerStarted","Data":"80bfe8cd1dde6cd97b51e83d49d9ab7c7e93a727aec4efb6be45e94a33ef08d6"} Jul 08 23:12:16.176115 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:16.175690 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4zw4w" Jul 08 23:12:16.192070 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:16.192016 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4zw4w" podStartSLOduration=251.34308856 podStartE2EDuration="4m14.191993463s" totalImagesPullingTime="2.848904903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:08:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:12:16.190804039 +0000 UTC m=+292.350087549" watchObservedRunningTime="2026-07-08 23:12:16.191993463 +0000 UTC m=+292.351276973" Jul 08 23:12:18.184593 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:18.184536 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g4c2s" event={"ID":"a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3","Type":"ContainerStarted","Data":"2192652496e63b7cf4a8400aa65e1e7e9ef59abdb813af220ba2c837530902a9"} Jul 08 23:12:19.190187 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:19.190149 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g4c2s" event={"ID":"a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3","Type":"ContainerStarted","Data":"aee0efc98a5dd47f43d558ae9e9190480340098456e276116b06649012b68e8d"} Jul 08 23:12:19.289319 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:19.289286 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:19.390627 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:19.390593 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:19.440716 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:19.440568 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:19.797507 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:19.797465 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:19.969515 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:19.969479 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:20.018631 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:20.018599 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:20.177403 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:20.177318 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:20.229375 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:20.229342 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:20.324653 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:12:20.324610 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-kwcdm" podUID="3d290d52-819f-4ece-bc8e-11ce3dbb4d29" Jul 08 23:12:20.775646 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:20.775612 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:21.376117 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:21.376081 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:21.832654 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:21.832620 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:22.036758 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:22.036725 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:22.133940 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:22.133844 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:22.201693 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:22.201660 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g4c2s" event={"ID":"a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3","Type":"ContainerStarted","Data":"a4e5110836bb44430c5a2e7d2e576503679bc685ec190dedec1ca9c752fcf6f3"} Jul 08 23:12:22.203874 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:22.203852 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:22.219737 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:22.219690 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-g4c2s" podStartSLOduration=17.308170892 podStartE2EDuration="24.219674087s" totalImagesPullingTime="6.911503195s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:11:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:12:22.219025382 +0000 UTC m=+298.378308902" watchObservedRunningTime="2026-07-08 23:12:22.219674087 +0000 UTC m=+298.378957637" Jul 08 23:12:22.302216 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:22.302187 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:24.191480 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:24.191457 2572 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 23:12:25.612389 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:25.612338 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9739aa16-33a8-4311-9ba0-a431fad4fc00-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-q6g2c\" (UID: \"9739aa16-33a8-4311-9ba0-a431fad4fc00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6g2c" Jul 08 23:12:25.618029 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:25.614650 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9739aa16-33a8-4311-9ba0-a431fad4fc00-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-q6g2c\" (UID: \"9739aa16-33a8-4311-9ba0-a431fad4fc00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6g2c" Jul 08 23:12:25.860857 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:25.860829 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6dk8j\"" Jul 08 23:12:25.868849 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:25.868788 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6g2c" Jul 08 23:12:25.989346 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:25.989323 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6g2c"] Jul 08 23:12:25.991344 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:12:25.991317 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9739aa16_33a8_4311_9ba0_a431fad4fc00.slice/crio-23071777b72e9819048b4e9bf2de4ae62a754b3026a4af48e2fc1faf95b9183c WatchSource:0}: Error finding container 23071777b72e9819048b4e9bf2de4ae62a754b3026a4af48e2fc1faf95b9183c: Status 404 returned error can't find the container with id 23071777b72e9819048b4e9bf2de4ae62a754b3026a4af48e2fc1faf95b9183c Jul 08 23:12:25.993287 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:25.993269 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 23:12:26.181756 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:26.181672 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4zw4w" Jul 08 23:12:26.215793 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:26.215757 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6g2c" event={"ID":"9739aa16-33a8-4311-9ba0-a431fad4fc00","Type":"ContainerStarted","Data":"23071777b72e9819048b4e9bf2de4ae62a754b3026a4af48e2fc1faf95b9183c"} Jul 08 23:12:28.114490 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:28.114414 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:28.225026 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:28.224988 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6g2c" event={"ID":"9739aa16-33a8-4311-9ba0-a431fad4fc00","Type":"ContainerStarted","Data":"41c8123283a5fe6855b99abe06f096e9e66ea147b7d396016ede32b1082098e7"} Jul 08 23:12:28.241593 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:28.241540 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6g2c" podStartSLOduration=33.438167532 podStartE2EDuration="35.241525447s" totalImagesPullingTime="1.803357915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:11:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:12:28.240233896 +0000 UTC m=+304.399517404" watchObservedRunningTime="2026-07-08 23:12:28.241525447 +0000 UTC m=+304.400808976" Jul 08 23:12:28.276143 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:28.276114 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4zvwz"] Jul 08 23:12:28.279094 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:28.279079 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4zvwz" Jul 08 23:12:28.281265 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:28.281243 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 08 23:12:28.281425 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:28.281407 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-7gwhn\"" Jul 08 23:12:28.286884 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:28.286864 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4zvwz"] Jul 08 23:12:28.336400 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:28.336375 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e54f7ee6-be49-4870-8f06-2ff9131687ea-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-4zvwz\" (UID: \"e54f7ee6-be49-4870-8f06-2ff9131687ea\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4zvwz" Jul 08 23:12:28.437446 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:28.437373 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e54f7ee6-be49-4870-8f06-2ff9131687ea-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-4zvwz\" (UID: \"e54f7ee6-be49-4870-8f06-2ff9131687ea\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4zvwz" Jul 08 23:12:28.439644 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:28.439623 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e54f7ee6-be49-4870-8f06-2ff9131687ea-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-4zvwz\" (UID: \"e54f7ee6-be49-4870-8f06-2ff9131687ea\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4zvwz" Jul 08 23:12:28.588604 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:28.588575 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4zvwz" Jul 08 23:12:28.707223 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:28.707164 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4zvwz"] Jul 08 23:12:28.709256 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:12:28.709226 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode54f7ee6_be49_4870_8f06_2ff9131687ea.slice/crio-3685dd7d4019244eea18ecadac528e1a85f80ddb388199d0fe3906f3c075919a WatchSource:0}: Error finding container 3685dd7d4019244eea18ecadac528e1a85f80ddb388199d0fe3906f3c075919a: Status 404 returned error can't find the container with id 3685dd7d4019244eea18ecadac528e1a85f80ddb388199d0fe3906f3c075919a Jul 08 23:12:29.229108 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:29.229074 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4zvwz" event={"ID":"e54f7ee6-be49-4870-8f06-2ff9131687ea","Type":"ContainerStarted","Data":"3685dd7d4019244eea18ecadac528e1a85f80ddb388199d0fe3906f3c075919a"} Jul 08 23:12:29.620282 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:29.620248 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:29.800375 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:29.800337 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:29.866036 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:29.865989 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:30.234498 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:30.234414 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4zvwz" event={"ID":"e54f7ee6-be49-4870-8f06-2ff9131687ea","Type":"ContainerStarted","Data":"ceb8c7b6a0afed12ecc80abcd1d319c4d9dbb938af0b6af051252edae0d82a83"} Jul 08 23:12:30.234932 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:30.234570 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4zvwz" Jul 08 23:12:30.239997 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:30.239978 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4zvwz" Jul 08 23:12:30.249857 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:30.249818 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4zvwz" podStartSLOduration=0.982755588 podStartE2EDuration="2.249804566s" totalImagesPullingTime="1.267048978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:12:30.248839842 +0000 UTC m=+306.408123352" watchObservedRunningTime="2026-07-08 23:12:30.249804566 +0000 UTC m=+306.409088075" Jul 08 23:12:31.299599 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:31.299555 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:31.361566 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:31.361516 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:31.916921 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:31.916849 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:32.149964 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:32.149927 2572 patch_prober.go:28] interesting pod/image-registry-5bdc54fbb5-9tsk2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 23:12:32.150139 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:32.149997 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" podUID="675b1c56-1f9f-4dec-8a98-07dfb16fece3" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 23:12:34.168389 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:34.168364 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:12:34.340085 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:34.340050 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:34.441823 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:34.441738 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:35.291080 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:35.291041 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:35.324033 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:35.324008 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:12:35.342508 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:35.342479 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:35.950823 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:35.950792 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:36.051628 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:36.051577 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:36.596453 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:36.596424 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:36.644062 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:36.644035 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:39.198706 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:39.198675 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:39.298801 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:39.298769 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:40.619875 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:40.619838 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:40.723719 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:40.723687 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:41.995709 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:41.995675 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:42.096938 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.096890 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:42.422401 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.422368 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:42.609991 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.609961 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:42.674063 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.673970 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-p22db"] Jul 08 23:12:42.682021 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.681993 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:42.704052 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.704023 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ch4vt"] Jul 08 23:12:42.704222 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.704139 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p22db" Jul 08 23:12:42.706820 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.706796 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 23:12:42.706820 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.706801 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 23:12:42.707017 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.706838 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q8zt5\"" Jul 08 23:12:42.707405 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.707389 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ch4vt"] Jul 08 23:12:42.707503 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.707490 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ch4vt" Jul 08 23:12:42.707954 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.707935 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 23:12:42.707954 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.707950 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 23:12:42.709793 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.709772 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 08 23:12:42.710947 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.710929 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 08 23:12:42.711054 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.710949 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-vtqrd\"" Jul 08 23:12:42.711054 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.710998 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 08 23:12:42.742791 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.742762 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0af83348-5df5-4630-8277-608d0a3efbe3-sys\") pod \"node-exporter-p22db\" (UID: \"0af83348-5df5-4630-8277-608d0a3efbe3\") " pod="openshift-monitoring/node-exporter-p22db" Jul 08 23:12:42.742949 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.742839 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87e5c0f3-28ba-402e-b5a9-0a58471e4438-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-ch4vt\" (UID: \"87e5c0f3-28ba-402e-b5a9-0a58471e4438\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ch4vt" Jul 08 23:12:42.742949 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.742871 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0af83348-5df5-4630-8277-608d0a3efbe3-node-exporter-wtmp\") pod \"node-exporter-p22db\" (UID: \"0af83348-5df5-4630-8277-608d0a3efbe3\") " pod="openshift-monitoring/node-exporter-p22db" Jul 08 23:12:42.743080 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.742949 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0af83348-5df5-4630-8277-608d0a3efbe3-metrics-client-ca\") pod \"node-exporter-p22db\" (UID: \"0af83348-5df5-4630-8277-608d0a3efbe3\") " pod="openshift-monitoring/node-exporter-p22db" Jul 08 23:12:42.743080 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.742976 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0af83348-5df5-4630-8277-608d0a3efbe3-node-exporter-accelerators-collector-config\") pod \"node-exporter-p22db\" (UID: \"0af83348-5df5-4630-8277-608d0a3efbe3\") " pod="openshift-monitoring/node-exporter-p22db" Jul 08 23:12:42.743080 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.743055 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0af83348-5df5-4630-8277-608d0a3efbe3-node-exporter-textfile\") pod \"node-exporter-p22db\" (UID: \"0af83348-5df5-4630-8277-608d0a3efbe3\") " pod="openshift-monitoring/node-exporter-p22db" Jul 08 23:12:42.743232 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.743086 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/87e5c0f3-28ba-402e-b5a9-0a58471e4438-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-ch4vt\" (UID: \"87e5c0f3-28ba-402e-b5a9-0a58471e4438\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ch4vt" Jul 08 23:12:42.743232 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.743116 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0af83348-5df5-4630-8277-608d0a3efbe3-node-exporter-tls\") pod \"node-exporter-p22db\" (UID: \"0af83348-5df5-4630-8277-608d0a3efbe3\") " pod="openshift-monitoring/node-exporter-p22db" Jul 08 23:12:42.743232 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.743154 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qbkh\" (UniqueName: \"kubernetes.io/projected/0af83348-5df5-4630-8277-608d0a3efbe3-kube-api-access-2qbkh\") pod \"node-exporter-p22db\" (UID: \"0af83348-5df5-4630-8277-608d0a3efbe3\") " pod="openshift-monitoring/node-exporter-p22db" Jul 08 23:12:42.743232 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.743218 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89cj7\" (UniqueName: \"kubernetes.io/projected/87e5c0f3-28ba-402e-b5a9-0a58471e4438-kube-api-access-89cj7\") pod \"kube-state-metrics-7c9dbb8b7d-ch4vt\" (UID: \"87e5c0f3-28ba-402e-b5a9-0a58471e4438\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ch4vt" Jul 08 23:12:42.743406 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.743267 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0af83348-5df5-4630-8277-608d0a3efbe3-root\") pod \"node-exporter-p22db\" (UID: \"0af83348-5df5-4630-8277-608d0a3efbe3\") " pod="openshift-monitoring/node-exporter-p22db" Jul 08 23:12:42.743406 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.743297 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87e5c0f3-28ba-402e-b5a9-0a58471e4438-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-ch4vt\" (UID: \"87e5c0f3-28ba-402e-b5a9-0a58471e4438\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ch4vt" Jul 08 23:12:42.743406 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.743325 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/87e5c0f3-28ba-402e-b5a9-0a58471e4438-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-ch4vt\" (UID: \"87e5c0f3-28ba-402e-b5a9-0a58471e4438\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ch4vt" Jul 08 23:12:42.743406 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.743352 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0af83348-5df5-4630-8277-608d0a3efbe3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p22db\" (UID: \"0af83348-5df5-4630-8277-608d0a3efbe3\") " pod="openshift-monitoring/node-exporter-p22db" Jul 08 23:12:42.743406 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.743372 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/87e5c0f3-28ba-402e-b5a9-0a58471e4438-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-ch4vt\" (UID: \"87e5c0f3-28ba-402e-b5a9-0a58471e4438\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ch4vt" Jul 08 23:12:42.765640 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.765598 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:42.844583 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.844559 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0af83348-5df5-4630-8277-608d0a3efbe3-sys\") pod \"node-exporter-p22db\" (UID: \"0af83348-5df5-4630-8277-608d0a3efbe3\") " pod="openshift-monitoring/node-exporter-p22db" Jul 08 23:12:42.844745 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.844592 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87e5c0f3-28ba-402e-b5a9-0a58471e4438-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-ch4vt\" (UID: \"87e5c0f3-28ba-402e-b5a9-0a58471e4438\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ch4vt" Jul 08 23:12:42.844745 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.844622 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0af83348-5df5-4630-8277-608d0a3efbe3-node-exporter-wtmp\") pod \"node-exporter-p22db\" (UID: \"0af83348-5df5-4630-8277-608d0a3efbe3\") " pod="openshift-monitoring/node-exporter-p22db" Jul 08 23:12:42.844745 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.844676 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0af83348-5df5-4630-8277-608d0a3efbe3-sys\") pod \"node-exporter-p22db\" (UID: \"0af83348-5df5-4630-8277-608d0a3efbe3\") " pod="openshift-monitoring/node-exporter-p22db" Jul 08 23:12:42.844745 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.844736 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0af83348-5df5-4630-8277-608d0a3efbe3-metrics-client-ca\") pod \"node-exporter-p22db\" (UID: \"0af83348-5df5-4630-8277-608d0a3efbe3\") " pod="openshift-monitoring/node-exporter-p22db" Jul 08 23:12:42.844976 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.844764 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0af83348-5df5-4630-8277-608d0a3efbe3-node-exporter-accelerators-collector-config\") pod \"node-exporter-p22db\" (UID: \"0af83348-5df5-4630-8277-608d0a3efbe3\") " pod="openshift-monitoring/node-exporter-p22db" Jul 08 23:12:42.844976 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.844740 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0af83348-5df5-4630-8277-608d0a3efbe3-node-exporter-wtmp\") pod \"node-exporter-p22db\" (UID: \"0af83348-5df5-4630-8277-608d0a3efbe3\") " pod="openshift-monitoring/node-exporter-p22db" Jul 08 23:12:42.844976 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.844837 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0af83348-5df5-4630-8277-608d0a3efbe3-node-exporter-textfile\") pod \"node-exporter-p22db\" (UID: \"0af83348-5df5-4630-8277-608d0a3efbe3\") " pod="openshift-monitoring/node-exporter-p22db" Jul 08 23:12:42.844976 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.844865 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/87e5c0f3-28ba-402e-b5a9-0a58471e4438-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-ch4vt\" (UID: \"87e5c0f3-28ba-402e-b5a9-0a58471e4438\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ch4vt" Jul 08 23:12:42.844976 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.844915 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0af83348-5df5-4630-8277-608d0a3efbe3-node-exporter-tls\") pod \"node-exporter-p22db\" (UID: \"0af83348-5df5-4630-8277-608d0a3efbe3\") " pod="openshift-monitoring/node-exporter-p22db" Jul 08 23:12:42.844976 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.844956 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qbkh\" (UniqueName: \"kubernetes.io/projected/0af83348-5df5-4630-8277-608d0a3efbe3-kube-api-access-2qbkh\") pod \"node-exporter-p22db\" (UID: \"0af83348-5df5-4630-8277-608d0a3efbe3\") " pod="openshift-monitoring/node-exporter-p22db" Jul 08 23:12:42.845264 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.844986 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89cj7\" (UniqueName: \"kubernetes.io/projected/87e5c0f3-28ba-402e-b5a9-0a58471e4438-kube-api-access-89cj7\") pod \"kube-state-metrics-7c9dbb8b7d-ch4vt\" (UID: \"87e5c0f3-28ba-402e-b5a9-0a58471e4438\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ch4vt" Jul 08 23:12:42.845264 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.845020 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0af83348-5df5-4630-8277-608d0a3efbe3-root\") pod \"node-exporter-p22db\" (UID: \"0af83348-5df5-4630-8277-608d0a3efbe3\") " pod="openshift-monitoring/node-exporter-p22db" Jul 08 23:12:42.845264 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.845047 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87e5c0f3-28ba-402e-b5a9-0a58471e4438-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-ch4vt\" (UID: \"87e5c0f3-28ba-402e-b5a9-0a58471e4438\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ch4vt" Jul 08 23:12:42.845264 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.845074 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/87e5c0f3-28ba-402e-b5a9-0a58471e4438-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-ch4vt\" (UID: \"87e5c0f3-28ba-402e-b5a9-0a58471e4438\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ch4vt" Jul 08 23:12:42.845264 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.845097 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0af83348-5df5-4630-8277-608d0a3efbe3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p22db\" (UID: \"0af83348-5df5-4630-8277-608d0a3efbe3\") " pod="openshift-monitoring/node-exporter-p22db" Jul 08 23:12:42.845264 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.845121 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/87e5c0f3-28ba-402e-b5a9-0a58471e4438-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-ch4vt\" (UID: \"87e5c0f3-28ba-402e-b5a9-0a58471e4438\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ch4vt" Jul 08 23:12:42.845264 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.845135 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0af83348-5df5-4630-8277-608d0a3efbe3-node-exporter-textfile\") pod \"node-exporter-p22db\" (UID: \"0af83348-5df5-4630-8277-608d0a3efbe3\") " pod="openshift-monitoring/node-exporter-p22db" Jul 08 23:12:42.845264 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.845196 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/87e5c0f3-28ba-402e-b5a9-0a58471e4438-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-ch4vt\" (UID: \"87e5c0f3-28ba-402e-b5a9-0a58471e4438\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ch4vt" Jul 08 23:12:42.845619 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:12:42.845278 2572 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 08 23:12:42.845619 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:12:42.845335 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e5c0f3-28ba-402e-b5a9-0a58471e4438-kube-state-metrics-tls podName:87e5c0f3-28ba-402e-b5a9-0a58471e4438 nodeName:}" failed. No retries permitted until 2026-07-08 23:12:43.345318533 +0000 UTC m=+319.504602020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/87e5c0f3-28ba-402e-b5a9-0a58471e4438-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-ch4vt" (UID: "87e5c0f3-28ba-402e-b5a9-0a58471e4438") : secret "kube-state-metrics-tls" not found Jul 08 23:12:42.845619 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.845381 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0af83348-5df5-4630-8277-608d0a3efbe3-metrics-client-ca\") pod \"node-exporter-p22db\" (UID: \"0af83348-5df5-4630-8277-608d0a3efbe3\") " pod="openshift-monitoring/node-exporter-p22db" Jul 08 23:12:42.845619 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.845430 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87e5c0f3-28ba-402e-b5a9-0a58471e4438-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-ch4vt\" (UID: \"87e5c0f3-28ba-402e-b5a9-0a58471e4438\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ch4vt" Jul 08 23:12:42.845619 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.845436 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0af83348-5df5-4630-8277-608d0a3efbe3-node-exporter-accelerators-collector-config\") pod \"node-exporter-p22db\" (UID: \"0af83348-5df5-4630-8277-608d0a3efbe3\") " pod="openshift-monitoring/node-exporter-p22db" Jul 08 23:12:42.845619 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.845553 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0af83348-5df5-4630-8277-608d0a3efbe3-root\") pod \"node-exporter-p22db\" (UID: \"0af83348-5df5-4630-8277-608d0a3efbe3\") " pod="openshift-monitoring/node-exporter-p22db" Jul 08 23:12:42.845995 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.845724 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/87e5c0f3-28ba-402e-b5a9-0a58471e4438-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-ch4vt\" (UID: \"87e5c0f3-28ba-402e-b5a9-0a58471e4438\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ch4vt" Jul 08 23:12:42.847519 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.847497 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0af83348-5df5-4630-8277-608d0a3efbe3-node-exporter-tls\") pod \"node-exporter-p22db\" (UID: \"0af83348-5df5-4630-8277-608d0a3efbe3\") " pod="openshift-monitoring/node-exporter-p22db" Jul 08 23:12:42.847982 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.847963 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0af83348-5df5-4630-8277-608d0a3efbe3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p22db\" (UID: \"0af83348-5df5-4630-8277-608d0a3efbe3\") " pod="openshift-monitoring/node-exporter-p22db" Jul 08 23:12:42.848086 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.848070 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87e5c0f3-28ba-402e-b5a9-0a58471e4438-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-ch4vt\" (UID: \"87e5c0f3-28ba-402e-b5a9-0a58471e4438\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ch4vt" Jul 08 23:12:42.856798 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.856775 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qbkh\" (UniqueName: \"kubernetes.io/projected/0af83348-5df5-4630-8277-608d0a3efbe3-kube-api-access-2qbkh\") pod \"node-exporter-p22db\" (UID: \"0af83348-5df5-4630-8277-608d0a3efbe3\") " pod="openshift-monitoring/node-exporter-p22db" Jul 08 23:12:42.857245 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.857224 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89cj7\" (UniqueName: \"kubernetes.io/projected/87e5c0f3-28ba-402e-b5a9-0a58471e4438-kube-api-access-89cj7\") pod \"kube-state-metrics-7c9dbb8b7d-ch4vt\" (UID: \"87e5c0f3-28ba-402e-b5a9-0a58471e4438\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ch4vt" Jul 08 23:12:42.866247 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.866223 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:42.985787 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:42.985700 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:43.015079 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:43.015041 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p22db" Jul 08 23:12:43.028324 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:12:43.028299 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0af83348_5df5_4630_8277_608d0a3efbe3.slice/crio-a5090fb607107b33cd873ac8c746ae1376f029e2638ff7b363295fd75247074b WatchSource:0}: Error finding container a5090fb607107b33cd873ac8c746ae1376f029e2638ff7b363295fd75247074b: Status 404 returned error can't find the container with id a5090fb607107b33cd873ac8c746ae1376f029e2638ff7b363295fd75247074b Jul 08 23:12:43.082453 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:43.082414 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:43.174317 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:43.174289 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:43.235541 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:43.235497 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:43.276230 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:43.276198 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p22db" event={"ID":"0af83348-5df5-4630-8277-608d0a3efbe3","Type":"ContainerStarted","Data":"a5090fb607107b33cd873ac8c746ae1376f029e2638ff7b363295fd75247074b"} Jul 08 23:12:43.350648 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:43.350620 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/87e5c0f3-28ba-402e-b5a9-0a58471e4438-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-ch4vt\" (UID: \"87e5c0f3-28ba-402e-b5a9-0a58471e4438\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ch4vt" Jul 08 23:12:43.352885 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:43.352855 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/87e5c0f3-28ba-402e-b5a9-0a58471e4438-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-ch4vt\" (UID: \"87e5c0f3-28ba-402e-b5a9-0a58471e4438\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ch4vt" Jul 08 23:12:43.601100 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:43.601021 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:43.620234 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:43.620211 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ch4vt" Jul 08 23:12:43.702722 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:43.702663 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:43.770059 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:43.769818 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ch4vt"] Jul 08 23:12:43.770059 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:43.770009 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:43.772777 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:12:43.772750 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87e5c0f3_28ba_402e_b5a9_0a58471e4438.slice/crio-d4dd164ee6e700db10369d7f47bdd144d6203960c368f369eaec422cd8c374e3 WatchSource:0}: Error finding container d4dd164ee6e700db10369d7f47bdd144d6203960c368f369eaec422cd8c374e3: Status 404 returned error can't find the container with id d4dd164ee6e700db10369d7f47bdd144d6203960c368f369eaec422cd8c374e3 Jul 08 23:12:44.281281 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:44.281245 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ch4vt" event={"ID":"87e5c0f3-28ba-402e-b5a9-0a58471e4438","Type":"ContainerStarted","Data":"d4dd164ee6e700db10369d7f47bdd144d6203960c368f369eaec422cd8c374e3"} Jul 08 23:12:44.282835 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:44.282805 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p22db" event={"ID":"0af83348-5df5-4630-8277-608d0a3efbe3","Type":"ContainerStarted","Data":"9816bd070df7650ef3be0aeda92fe487ed36b36f5bf0d95ecfd317d0409339a3"} Jul 08 23:12:44.304582 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:44.304540 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:44.363040 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:44.363012 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:44.609617 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:44.609570 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:44.632576 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:44.632546 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bdc54fbb5-9tsk2"] Jul 08 23:12:44.743134 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:44.743095 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:44.838394 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:44.838367 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:45.033572 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:45.033524 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:45.135864 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:45.135808 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:45.287460 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:45.287383 2572 generic.go:356] "Generic (PLEG): container finished" podID="0af83348-5df5-4630-8277-608d0a3efbe3" containerID="9816bd070df7650ef3be0aeda92fe487ed36b36f5bf0d95ecfd317d0409339a3" exitCode=0 Jul 08 23:12:45.287460 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:45.287423 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p22db" event={"ID":"0af83348-5df5-4630-8277-608d0a3efbe3","Type":"ContainerDied","Data":"9816bd070df7650ef3be0aeda92fe487ed36b36f5bf0d95ecfd317d0409339a3"} Jul 08 23:12:45.454001 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:45.453978 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:45.529516 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:45.529487 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:45.613740 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:45.613665 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:45.661469 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:45.661434 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:45.836985 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:45.836942 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:46.205091 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:46.205060 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:46.292861 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:46.292822 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ch4vt" event={"ID":"87e5c0f3-28ba-402e-b5a9-0a58471e4438","Type":"ContainerStarted","Data":"21c612f8e08df60f498a891f3db3ca5ac269da8531a706c5fea94bbf2fb76938"} Jul 08 23:12:46.293364 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:46.292891 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ch4vt" event={"ID":"87e5c0f3-28ba-402e-b5a9-0a58471e4438","Type":"ContainerStarted","Data":"57e05a4ffa810488dd16f83f7d1fd7f9c92b2703384ab8d23b2438356b037bf6"} Jul 08 23:12:46.293364 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:46.292942 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ch4vt" event={"ID":"87e5c0f3-28ba-402e-b5a9-0a58471e4438","Type":"ContainerStarted","Data":"e73567adf1c0dd44bfc9b200690e82d4fc2543e050220f1f927763a9a70690ff"} Jul 08 23:12:46.294867 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:46.294843 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p22db" event={"ID":"0af83348-5df5-4630-8277-608d0a3efbe3","Type":"ContainerStarted","Data":"25f104a5420e3cb5156e87c30388ac2cb32ada7f4fdb706d2df7027626b6b0e0"} Jul 08 23:12:46.294995 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:46.294884 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p22db" event={"ID":"0af83348-5df5-4630-8277-608d0a3efbe3","Type":"ContainerStarted","Data":"042d2704174722c7c334ce2c13d058d9bbf1d60a536c600676072fc3f0062383"} Jul 08 23:12:46.314671 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:46.311612 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ch4vt" podStartSLOduration=2.779878495 podStartE2EDuration="4.311595387s" totalImagesPullingTime="1.531716892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:12:46.310760862 +0000 UTC m=+322.470044362" watchObservedRunningTime="2026-07-08 23:12:46.311595387 +0000 UTC m=+322.470878896" Jul 08 23:12:46.328051 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:46.328011 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-p22db" podStartSLOduration=3.127776081 podStartE2EDuration="4.327997181s" totalImagesPullingTime="1.134855625s" totalInitContainerRuntime="65.365475ms" isStatefulPod=true podCreationTimestamp="2026-07-08 23:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:12:46.327095617 +0000 UTC m=+322.486379126" watchObservedRunningTime="2026-07-08 23:12:46.327997181 +0000 UTC m=+322.487280691" Jul 08 23:12:47.087485 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.087455 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-56f85d5559-ptcx5"] Jul 08 23:12:47.090612 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.090594 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" Jul 08 23:12:47.093201 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.093176 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-e2o8alvlsrdqk\"" Jul 08 23:12:47.094117 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.094094 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 08 23:12:47.094117 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.094112 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 08 23:12:47.094262 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.094118 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-z2wc8\"" Jul 08 23:12:47.094262 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.094137 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 08 23:12:47.094262 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.094234 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 08 23:12:47.100230 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.100210 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-56f85d5559-ptcx5"] Jul 08 23:12:47.186431 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.186393 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e0abd9c-ef81-46a9-b89a-07e09dd07a26-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56f85d5559-ptcx5\" (UID: \"0e0abd9c-ef81-46a9-b89a-07e09dd07a26\") " pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" Jul 08 23:12:47.186586 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.186434 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0e0abd9c-ef81-46a9-b89a-07e09dd07a26-secret-metrics-server-client-certs\") pod \"metrics-server-56f85d5559-ptcx5\" (UID: \"0e0abd9c-ef81-46a9-b89a-07e09dd07a26\") " pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" Jul 08 23:12:47.186586 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.186471 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0e0abd9c-ef81-46a9-b89a-07e09dd07a26-secret-metrics-server-tls\") pod \"metrics-server-56f85d5559-ptcx5\" (UID: \"0e0abd9c-ef81-46a9-b89a-07e09dd07a26\") " pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" Jul 08 23:12:47.186586 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.186505 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0e0abd9c-ef81-46a9-b89a-07e09dd07a26-metrics-server-audit-profiles\") pod \"metrics-server-56f85d5559-ptcx5\" (UID: \"0e0abd9c-ef81-46a9-b89a-07e09dd07a26\") " pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" Jul 08 23:12:47.186586 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.186536 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85d28\" (UniqueName: \"kubernetes.io/projected/0e0abd9c-ef81-46a9-b89a-07e09dd07a26-kube-api-access-85d28\") pod \"metrics-server-56f85d5559-ptcx5\" (UID: \"0e0abd9c-ef81-46a9-b89a-07e09dd07a26\") " pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" Jul 08 23:12:47.186709 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.186647 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0e0abd9c-ef81-46a9-b89a-07e09dd07a26-audit-log\") pod \"metrics-server-56f85d5559-ptcx5\" (UID: \"0e0abd9c-ef81-46a9-b89a-07e09dd07a26\") " pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" Jul 08 23:12:47.186709 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.186688 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e0abd9c-ef81-46a9-b89a-07e09dd07a26-client-ca-bundle\") pod \"metrics-server-56f85d5559-ptcx5\" (UID: \"0e0abd9c-ef81-46a9-b89a-07e09dd07a26\") " pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" Jul 08 23:12:47.287696 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.287659 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0e0abd9c-ef81-46a9-b89a-07e09dd07a26-audit-log\") pod \"metrics-server-56f85d5559-ptcx5\" (UID: \"0e0abd9c-ef81-46a9-b89a-07e09dd07a26\") " pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" Jul 08 23:12:47.287867 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.287707 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e0abd9c-ef81-46a9-b89a-07e09dd07a26-client-ca-bundle\") pod \"metrics-server-56f85d5559-ptcx5\" (UID: \"0e0abd9c-ef81-46a9-b89a-07e09dd07a26\") " pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" Jul 08 23:12:47.287867 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.287732 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e0abd9c-ef81-46a9-b89a-07e09dd07a26-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56f85d5559-ptcx5\" (UID: \"0e0abd9c-ef81-46a9-b89a-07e09dd07a26\") " pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" Jul 08 23:12:47.287867 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.287758 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0e0abd9c-ef81-46a9-b89a-07e09dd07a26-secret-metrics-server-client-certs\") pod \"metrics-server-56f85d5559-ptcx5\" (UID: \"0e0abd9c-ef81-46a9-b89a-07e09dd07a26\") " pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" Jul 08 23:12:47.287867 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.287782 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0e0abd9c-ef81-46a9-b89a-07e09dd07a26-secret-metrics-server-tls\") pod \"metrics-server-56f85d5559-ptcx5\" (UID: \"0e0abd9c-ef81-46a9-b89a-07e09dd07a26\") " pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" Jul 08 23:12:47.287867 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.287818 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0e0abd9c-ef81-46a9-b89a-07e09dd07a26-metrics-server-audit-profiles\") pod \"metrics-server-56f85d5559-ptcx5\" (UID: \"0e0abd9c-ef81-46a9-b89a-07e09dd07a26\") " pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" Jul 08 23:12:47.287867 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.287850 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85d28\" (UniqueName: \"kubernetes.io/projected/0e0abd9c-ef81-46a9-b89a-07e09dd07a26-kube-api-access-85d28\") pod \"metrics-server-56f85d5559-ptcx5\" (UID: \"0e0abd9c-ef81-46a9-b89a-07e09dd07a26\") " pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" Jul 08 23:12:47.288178 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.288142 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0e0abd9c-ef81-46a9-b89a-07e09dd07a26-audit-log\") pod \"metrics-server-56f85d5559-ptcx5\" (UID: \"0e0abd9c-ef81-46a9-b89a-07e09dd07a26\") " pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" Jul 08 23:12:47.288523 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.288500 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e0abd9c-ef81-46a9-b89a-07e09dd07a26-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56f85d5559-ptcx5\" (UID: \"0e0abd9c-ef81-46a9-b89a-07e09dd07a26\") " pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" Jul 08 23:12:47.288951 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.288929 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0e0abd9c-ef81-46a9-b89a-07e09dd07a26-metrics-server-audit-profiles\") pod \"metrics-server-56f85d5559-ptcx5\" (UID: \"0e0abd9c-ef81-46a9-b89a-07e09dd07a26\") " pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" Jul 08 23:12:47.290287 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.290260 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0e0abd9c-ef81-46a9-b89a-07e09dd07a26-secret-metrics-server-tls\") pod \"metrics-server-56f85d5559-ptcx5\" (UID: \"0e0abd9c-ef81-46a9-b89a-07e09dd07a26\") " pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" Jul 08 23:12:47.290394 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.290291 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0e0abd9c-ef81-46a9-b89a-07e09dd07a26-secret-metrics-server-client-certs\") pod \"metrics-server-56f85d5559-ptcx5\" (UID: \"0e0abd9c-ef81-46a9-b89a-07e09dd07a26\") " pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" Jul 08 23:12:47.290394 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.290347 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e0abd9c-ef81-46a9-b89a-07e09dd07a26-client-ca-bundle\") pod \"metrics-server-56f85d5559-ptcx5\" (UID: \"0e0abd9c-ef81-46a9-b89a-07e09dd07a26\") " pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" Jul 08 23:12:47.295035 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.295014 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85d28\" (UniqueName: \"kubernetes.io/projected/0e0abd9c-ef81-46a9-b89a-07e09dd07a26-kube-api-access-85d28\") pod \"metrics-server-56f85d5559-ptcx5\" (UID: \"0e0abd9c-ef81-46a9-b89a-07e09dd07a26\") " pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" Jul 08 23:12:47.399804 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.399725 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" Jul 08 23:12:47.439474 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.439447 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:47.532284 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.532255 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-56f85d5559-ptcx5"] Jul 08 23:12:47.535072 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:12:47.535043 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e0abd9c_ef81_46a9_b89a_07e09dd07a26.slice/crio-a91b456eaf97444e99be9095e8700809999b03ac700ce4f3bb9be28af692ae54 WatchSource:0}: Error finding container a91b456eaf97444e99be9095e8700809999b03ac700ce4f3bb9be28af692ae54: Status 404 returned error can't find the container with id a91b456eaf97444e99be9095e8700809999b03ac700ce4f3bb9be28af692ae54 Jul 08 23:12:47.535365 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.535343 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:47.587647 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.587615 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:47.862383 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.862351 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-f7558f49c-5lkwv"] Jul 08 23:12:47.866761 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.866744 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" Jul 08 23:12:47.869155 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.869133 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 08 23:12:47.869155 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.869155 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 08 23:12:47.869340 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.869155 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 08 23:12:47.869340 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.869206 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-c9lbh\"" Jul 08 23:12:47.869340 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.869276 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 08 23:12:47.869475 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.869462 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 08 23:12:47.874332 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.874310 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 08 23:12:47.876718 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.876702 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-f7558f49c-5lkwv"] Jul 08 23:12:47.993617 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.993584 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c030fba1-1d8f-4020-b581-d7cdc53d226a-telemeter-client-tls\") pod \"telemeter-client-f7558f49c-5lkwv\" (UID: \"c030fba1-1d8f-4020-b581-d7cdc53d226a\") " pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" Jul 08 23:12:47.993761 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.993629 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c030fba1-1d8f-4020-b581-d7cdc53d226a-federate-client-tls\") pod \"telemeter-client-f7558f49c-5lkwv\" (UID: \"c030fba1-1d8f-4020-b581-d7cdc53d226a\") " pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" Jul 08 23:12:47.993797 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.993758 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c030fba1-1d8f-4020-b581-d7cdc53d226a-metrics-client-ca\") pod \"telemeter-client-f7558f49c-5lkwv\" (UID: \"c030fba1-1d8f-4020-b581-d7cdc53d226a\") " pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" Jul 08 23:12:47.993797 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.993786 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c030fba1-1d8f-4020-b581-d7cdc53d226a-serving-certs-ca-bundle\") pod \"telemeter-client-f7558f49c-5lkwv\" (UID: \"c030fba1-1d8f-4020-b581-d7cdc53d226a\") " pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" Jul 08 23:12:47.993920 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.993811 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6s6h\" (UniqueName: \"kubernetes.io/projected/c030fba1-1d8f-4020-b581-d7cdc53d226a-kube-api-access-x6s6h\") pod \"telemeter-client-f7558f49c-5lkwv\" (UID: \"c030fba1-1d8f-4020-b581-d7cdc53d226a\") " pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" Jul 08 23:12:47.993920 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.993827 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c030fba1-1d8f-4020-b581-d7cdc53d226a-secret-telemeter-client\") pod \"telemeter-client-f7558f49c-5lkwv\" (UID: \"c030fba1-1d8f-4020-b581-d7cdc53d226a\") " pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" Jul 08 23:12:47.993920 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.993849 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c030fba1-1d8f-4020-b581-d7cdc53d226a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-f7558f49c-5lkwv\" (UID: \"c030fba1-1d8f-4020-b581-d7cdc53d226a\") " pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" Jul 08 23:12:47.994055 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:47.993935 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c030fba1-1d8f-4020-b581-d7cdc53d226a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-f7558f49c-5lkwv\" (UID: \"c030fba1-1d8f-4020-b581-d7cdc53d226a\") " pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" Jul 08 23:12:48.094884 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.094845 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c030fba1-1d8f-4020-b581-d7cdc53d226a-federate-client-tls\") pod \"telemeter-client-f7558f49c-5lkwv\" (UID: \"c030fba1-1d8f-4020-b581-d7cdc53d226a\") " pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" Jul 08 23:12:48.095064 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.094965 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c030fba1-1d8f-4020-b581-d7cdc53d226a-metrics-client-ca\") pod \"telemeter-client-f7558f49c-5lkwv\" (UID: \"c030fba1-1d8f-4020-b581-d7cdc53d226a\") " pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" Jul 08 23:12:48.095064 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.094995 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c030fba1-1d8f-4020-b581-d7cdc53d226a-serving-certs-ca-bundle\") pod \"telemeter-client-f7558f49c-5lkwv\" (UID: \"c030fba1-1d8f-4020-b581-d7cdc53d226a\") " pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" Jul 08 23:12:48.095064 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.095023 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6s6h\" (UniqueName: \"kubernetes.io/projected/c030fba1-1d8f-4020-b581-d7cdc53d226a-kube-api-access-x6s6h\") pod \"telemeter-client-f7558f49c-5lkwv\" (UID: \"c030fba1-1d8f-4020-b581-d7cdc53d226a\") " pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" Jul 08 23:12:48.095064 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.095046 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c030fba1-1d8f-4020-b581-d7cdc53d226a-secret-telemeter-client\") pod \"telemeter-client-f7558f49c-5lkwv\" (UID: \"c030fba1-1d8f-4020-b581-d7cdc53d226a\") " pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" Jul 08 23:12:48.095303 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.095229 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c030fba1-1d8f-4020-b581-d7cdc53d226a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-f7558f49c-5lkwv\" (UID: \"c030fba1-1d8f-4020-b581-d7cdc53d226a\") " pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" Jul 08 23:12:48.095303 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.095294 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c030fba1-1d8f-4020-b581-d7cdc53d226a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-f7558f49c-5lkwv\" (UID: \"c030fba1-1d8f-4020-b581-d7cdc53d226a\") " pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" Jul 08 23:12:48.095410 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.095328 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c030fba1-1d8f-4020-b581-d7cdc53d226a-telemeter-client-tls\") pod \"telemeter-client-f7558f49c-5lkwv\" (UID: \"c030fba1-1d8f-4020-b581-d7cdc53d226a\") " pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" Jul 08 23:12:48.095803 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.095776 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c030fba1-1d8f-4020-b581-d7cdc53d226a-metrics-client-ca\") pod \"telemeter-client-f7558f49c-5lkwv\" (UID: \"c030fba1-1d8f-4020-b581-d7cdc53d226a\") " pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" Jul 08 23:12:48.095925 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.095819 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c030fba1-1d8f-4020-b581-d7cdc53d226a-serving-certs-ca-bundle\") pod \"telemeter-client-f7558f49c-5lkwv\" (UID: \"c030fba1-1d8f-4020-b581-d7cdc53d226a\") " pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" Jul 08 23:12:48.096279 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.096258 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c030fba1-1d8f-4020-b581-d7cdc53d226a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-f7558f49c-5lkwv\" (UID: \"c030fba1-1d8f-4020-b581-d7cdc53d226a\") " pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" Jul 08 23:12:48.097545 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.097518 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c030fba1-1d8f-4020-b581-d7cdc53d226a-federate-client-tls\") pod \"telemeter-client-f7558f49c-5lkwv\" (UID: \"c030fba1-1d8f-4020-b581-d7cdc53d226a\") " pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" Jul 08 23:12:48.097641 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.097626 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c030fba1-1d8f-4020-b581-d7cdc53d226a-telemeter-client-tls\") pod \"telemeter-client-f7558f49c-5lkwv\" (UID: \"c030fba1-1d8f-4020-b581-d7cdc53d226a\") " pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" Jul 08 23:12:48.097756 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.097740 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c030fba1-1d8f-4020-b581-d7cdc53d226a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-f7558f49c-5lkwv\" (UID: \"c030fba1-1d8f-4020-b581-d7cdc53d226a\") " pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" Jul 08 23:12:48.097811 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.097796 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c030fba1-1d8f-4020-b581-d7cdc53d226a-secret-telemeter-client\") pod \"telemeter-client-f7558f49c-5lkwv\" (UID: \"c030fba1-1d8f-4020-b581-d7cdc53d226a\") " pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" Jul 08 23:12:48.103385 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.103361 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6s6h\" (UniqueName: \"kubernetes.io/projected/c030fba1-1d8f-4020-b581-d7cdc53d226a-kube-api-access-x6s6h\") pod \"telemeter-client-f7558f49c-5lkwv\" (UID: \"c030fba1-1d8f-4020-b581-d7cdc53d226a\") " pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" Jul 08 23:12:48.176805 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.176733 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" Jul 08 23:12:48.305736 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.305691 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" event={"ID":"0e0abd9c-ef81-46a9-b89a-07e09dd07a26","Type":"ContainerStarted","Data":"a91b456eaf97444e99be9095e8700809999b03ac700ce4f3bb9be28af692ae54"} Jul 08 23:12:48.323540 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.323513 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-f7558f49c-5lkwv"] Jul 08 23:12:48.326621 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:12:48.326592 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc030fba1_1d8f_4020_b581_d7cdc53d226a.slice/crio-7c81faef3820fbd309a6cee0a0a63a0063352613f5e5c0897f22f1d6b885e348 WatchSource:0}: Error finding container 7c81faef3820fbd309a6cee0a0a63a0063352613f5e5c0897f22f1d6b885e348: Status 404 returned error can't find the container with id 7c81faef3820fbd309a6cee0a0a63a0063352613f5e5c0897f22f1d6b885e348 Jul 08 23:12:48.493583 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.493452 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:48.897619 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.897584 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 23:12:48.904158 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.904131 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:48.904623 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.904351 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:48.906687 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.906655 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gbvk9\"" Jul 08 23:12:48.906687 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.906678 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 08 23:12:48.907006 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.906744 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 08 23:12:48.907006 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.906744 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 08 23:12:48.907006 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.906807 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 08 23:12:48.907006 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.906841 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 08 23:12:48.907249 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.907223 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 08 23:12:48.907627 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.907601 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 08 23:12:48.907627 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.907617 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 08 23:12:48.908049 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.908030 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 08 23:12:48.908384 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.908305 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 08 23:12:48.908384 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.908326 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 08 23:12:48.908565 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.908307 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8n52rf7lale9t\"" Jul 08 23:12:48.908565 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.908329 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 08 23:12:48.908565 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.908307 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 08 23:12:48.910490 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.910465 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 08 23:12:48.919184 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:48.919163 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 23:12:49.005535 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.005508 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/601dde00-b03a-4c2f-b9f0-5c986b49e28b-config-out\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.005634 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.005537 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/601dde00-b03a-4c2f-b9f0-5c986b49e28b-config\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.005634 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.005554 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/601dde00-b03a-4c2f-b9f0-5c986b49e28b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.005634 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.005570 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/601dde00-b03a-4c2f-b9f0-5c986b49e28b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.005634 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.005590 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/601dde00-b03a-4c2f-b9f0-5c986b49e28b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.005796 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.005645 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/601dde00-b03a-4c2f-b9f0-5c986b49e28b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.005796 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.005742 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/601dde00-b03a-4c2f-b9f0-5c986b49e28b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.005796 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.005766 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/601dde00-b03a-4c2f-b9f0-5c986b49e28b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.005796 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.005786 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/601dde00-b03a-4c2f-b9f0-5c986b49e28b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.005971 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.005802 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/601dde00-b03a-4c2f-b9f0-5c986b49e28b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.005971 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.005828 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/601dde00-b03a-4c2f-b9f0-5c986b49e28b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.005971 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.005842 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/601dde00-b03a-4c2f-b9f0-5c986b49e28b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.005971 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.005862 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/601dde00-b03a-4c2f-b9f0-5c986b49e28b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.005971 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.005878 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/601dde00-b03a-4c2f-b9f0-5c986b49e28b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.005971 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.005917 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/601dde00-b03a-4c2f-b9f0-5c986b49e28b-web-config\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.005971 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.005933 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/601dde00-b03a-4c2f-b9f0-5c986b49e28b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.006217 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.005975 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/601dde00-b03a-4c2f-b9f0-5c986b49e28b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.006217 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.005994 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/601dde00-b03a-4c2f-b9f0-5c986b49e28b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.006217 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.006016 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s67xr\" (UniqueName: \"kubernetes.io/projected/601dde00-b03a-4c2f-b9f0-5c986b49e28b-kube-api-access-s67xr\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.006217 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.006044 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/601dde00-b03a-4c2f-b9f0-5c986b49e28b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.106599 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.106566 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/601dde00-b03a-4c2f-b9f0-5c986b49e28b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.106599 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.106611 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/601dde00-b03a-4c2f-b9f0-5c986b49e28b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.106849 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.106636 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/601dde00-b03a-4c2f-b9f0-5c986b49e28b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.106849 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.106657 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/601dde00-b03a-4c2f-b9f0-5c986b49e28b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.106849 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.106684 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/601dde00-b03a-4c2f-b9f0-5c986b49e28b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.106849 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.106707 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/601dde00-b03a-4c2f-b9f0-5c986b49e28b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.106849 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.106738 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/601dde00-b03a-4c2f-b9f0-5c986b49e28b-web-config\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.106849 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.106760 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/601dde00-b03a-4c2f-b9f0-5c986b49e28b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.106849 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.106801 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/601dde00-b03a-4c2f-b9f0-5c986b49e28b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.106849 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.106828 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/601dde00-b03a-4c2f-b9f0-5c986b49e28b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.107265 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.106861 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s67xr\" (UniqueName: \"kubernetes.io/projected/601dde00-b03a-4c2f-b9f0-5c986b49e28b-kube-api-access-s67xr\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.107265 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.106887 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/601dde00-b03a-4c2f-b9f0-5c986b49e28b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.107265 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.106955 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/601dde00-b03a-4c2f-b9f0-5c986b49e28b-config-out\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.107265 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.106977 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/601dde00-b03a-4c2f-b9f0-5c986b49e28b-config\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.107265 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.107007 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/601dde00-b03a-4c2f-b9f0-5c986b49e28b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.107265 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.107030 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/601dde00-b03a-4c2f-b9f0-5c986b49e28b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.107265 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.107065 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/601dde00-b03a-4c2f-b9f0-5c986b49e28b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.107265 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.107100 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/601dde00-b03a-4c2f-b9f0-5c986b49e28b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.107265 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.107158 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/601dde00-b03a-4c2f-b9f0-5c986b49e28b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.107265 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.107198 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/601dde00-b03a-4c2f-b9f0-5c986b49e28b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.107733 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.107334 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/601dde00-b03a-4c2f-b9f0-5c986b49e28b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.107733 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.107406 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/601dde00-b03a-4c2f-b9f0-5c986b49e28b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.108240 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.107949 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/601dde00-b03a-4c2f-b9f0-5c986b49e28b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.108240 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.108181 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/601dde00-b03a-4c2f-b9f0-5c986b49e28b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.109145 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.109119 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/601dde00-b03a-4c2f-b9f0-5c986b49e28b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.111139 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.110087 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/601dde00-b03a-4c2f-b9f0-5c986b49e28b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.111139 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.110253 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/601dde00-b03a-4c2f-b9f0-5c986b49e28b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.111139 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.110566 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/601dde00-b03a-4c2f-b9f0-5c986b49e28b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.111139 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.111090 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/601dde00-b03a-4c2f-b9f0-5c986b49e28b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.111139 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.111100 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/601dde00-b03a-4c2f-b9f0-5c986b49e28b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.111941 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.111916 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/601dde00-b03a-4c2f-b9f0-5c986b49e28b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.112448 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.112406 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/601dde00-b03a-4c2f-b9f0-5c986b49e28b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.113131 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.112750 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/601dde00-b03a-4c2f-b9f0-5c986b49e28b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.113131 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.112751 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/601dde00-b03a-4c2f-b9f0-5c986b49e28b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.113131 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.112990 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/601dde00-b03a-4c2f-b9f0-5c986b49e28b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.113131 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.113112 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/601dde00-b03a-4c2f-b9f0-5c986b49e28b-web-config\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.113403 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.113368 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/601dde00-b03a-4c2f-b9f0-5c986b49e28b-config\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.113834 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.113813 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/601dde00-b03a-4c2f-b9f0-5c986b49e28b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.114169 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.114147 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/601dde00-b03a-4c2f-b9f0-5c986b49e28b-config-out\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.115705 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.115685 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s67xr\" (UniqueName: \"kubernetes.io/projected/601dde00-b03a-4c2f-b9f0-5c986b49e28b-kube-api-access-s67xr\") pod \"prometheus-k8s-0\" (UID: \"601dde00-b03a-4c2f-b9f0-5c986b49e28b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.219514 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.219298 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:12:49.265929 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.265878 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:49.312946 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.312909 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" event={"ID":"0e0abd9c-ef81-46a9-b89a-07e09dd07a26","Type":"ContainerStarted","Data":"5d4f7989d041d7b81aa61b0ef9f6ef5b8c475acb353054cbdd95c5c0893f10aa"} Jul 08 23:12:49.314380 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.314348 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" event={"ID":"c030fba1-1d8f-4020-b581-d7cdc53d226a","Type":"ContainerStarted","Data":"7c81faef3820fbd309a6cee0a0a63a0063352613f5e5c0897f22f1d6b885e348"} Jul 08 23:12:49.317980 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.317950 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:49.329412 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.328759 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" podStartSLOduration=0.890204105 podStartE2EDuration="2.328741304s" totalImagesPullingTime="1.438537199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:12:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:12:49.32743863 +0000 UTC m=+325.486722143" watchObservedRunningTime="2026-07-08 23:12:49.328741304 +0000 UTC m=+325.488024795" Jul 08 23:12:49.366147 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:49.366110 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 23:12:49.370923 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:12:49.370869 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod601dde00_b03a_4c2f_b9f0_5c986b49e28b.slice/crio-93aa7a5e0e190a093b25bc2f6f4cfc32ce4919f594d96bf4ace2a1eeb2fc402a WatchSource:0}: Error finding container 93aa7a5e0e190a093b25bc2f6f4cfc32ce4919f594d96bf4ace2a1eeb2fc402a: Status 404 returned error can't find the container with id 93aa7a5e0e190a093b25bc2f6f4cfc32ce4919f594d96bf4ace2a1eeb2fc402a Jul 08 23:12:50.321924 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:50.321869 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"601dde00-b03a-4c2f-b9f0-5c986b49e28b","Type":"ContainerStarted","Data":"93aa7a5e0e190a093b25bc2f6f4cfc32ce4919f594d96bf4ace2a1eeb2fc402a"} Jul 08 23:12:51.326848 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:51.326812 2572 generic.go:356] "Generic (PLEG): container finished" podID="601dde00-b03a-4c2f-b9f0-5c986b49e28b" containerID="e8f1cc0d2282e0c284e5ca104bb9ad6f0a42c68f9a750c4f899c3a91b8f4401e" exitCode=0 Jul 08 23:12:51.327326 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:51.326915 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"601dde00-b03a-4c2f-b9f0-5c986b49e28b","Type":"ContainerDied","Data":"e8f1cc0d2282e0c284e5ca104bb9ad6f0a42c68f9a750c4f899c3a91b8f4401e"} Jul 08 23:12:51.329093 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:51.329072 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" event={"ID":"c030fba1-1d8f-4020-b581-d7cdc53d226a","Type":"ContainerStarted","Data":"0ce689680d710a3746265e8fa115213edf7486fa399beeaf41886550eedba686"} Jul 08 23:12:51.329185 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:51.329111 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" event={"ID":"c030fba1-1d8f-4020-b581-d7cdc53d226a","Type":"ContainerStarted","Data":"e996b0af54c2ac7925d1a6083e112ef26efe6033ffd08bc7e9f530ae73e2fc70"} Jul 08 23:12:51.329185 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:51.329131 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" event={"ID":"c030fba1-1d8f-4020-b581-d7cdc53d226a","Type":"ContainerStarted","Data":"b764c96a12386d126c81133117710d1fe978aa57016155358d4aedcb12654e09"} Jul 08 23:12:51.369339 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:51.369300 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-f7558f49c-5lkwv" podStartSLOduration=1.8660462180000001 podStartE2EDuration="4.369287497s" totalImagesPullingTime="2.503241279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:12:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:12:51.368555615 +0000 UTC m=+327.527839125" watchObservedRunningTime="2026-07-08 23:12:51.369287497 +0000 UTC m=+327.528571009" Jul 08 23:12:55.345967 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:55.345933 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"601dde00-b03a-4c2f-b9f0-5c986b49e28b","Type":"ContainerStarted","Data":"1ed1bf0001d5085a610900d93ec6e8505b5da4c4663734ed1807762ade432a3e"} Jul 08 23:12:55.346404 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:55.345993 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"601dde00-b03a-4c2f-b9f0-5c986b49e28b","Type":"ContainerStarted","Data":"a8d5f5a65c4c77bf30df154e79e85b4cc74b88e2d8cbec2a5ed023445ae90527"} Jul 08 23:12:57.103951 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:57.103922 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:57.202910 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:57.202873 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:12:57.357005 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:57.356971 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"601dde00-b03a-4c2f-b9f0-5c986b49e28b","Type":"ContainerStarted","Data":"75a405d283ea7c5a47c9535bddbc67d1267036dd34f6b7486323f887fdd2a003"} Jul 08 23:12:57.357178 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:57.357067 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"601dde00-b03a-4c2f-b9f0-5c986b49e28b","Type":"ContainerStarted","Data":"0fb2ec10ee2d824491d89a9196ea549c4d7900d086dc39e556465107d398613a"} Jul 08 23:12:57.357178 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:57.357100 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"601dde00-b03a-4c2f-b9f0-5c986b49e28b","Type":"ContainerStarted","Data":"0c7e67f6bffd9ae916b3be78b18a9aa78162b3acfa61d420a73915b4bca48dd4"} Jul 08 23:12:57.357178 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:57.357125 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"601dde00-b03a-4c2f-b9f0-5c986b49e28b","Type":"ContainerStarted","Data":"6917ee3e0f42456ead30bb42c01d3bedeb09827cca592406676eb8162b13075b"} Jul 08 23:12:57.385205 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:57.385078 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.409737089 podStartE2EDuration="9.385061445s" totalImagesPullingTime="6.955689243s" totalInitContainerRuntime="19.635113ms" isStatefulPod=false podCreationTimestamp="2026-07-08 23:12:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:12:57.383466935 +0000 UTC m=+333.542750473" watchObservedRunningTime="2026-07-08 23:12:57.385061445 +0000 UTC m=+333.544344953" Jul 08 23:12:59.220004 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:12:59.219969 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:13:02.729828 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:02.729794 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:13:02.827441 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:02.827407 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:13:02.876045 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:02.876013 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:13:07.400730 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:07.400700 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" Jul 08 23:13:07.401128 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:07.400746 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" Jul 08 23:13:09.652212 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:09.652173 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" podUID="675b1c56-1f9f-4dec-8a98-07dfb16fece3" containerName="registry" containerID="cri-o://b68ca0ae167f5c0639ddf8dbe77e7872d7eaa17af99977b6cc00e216b5cedc01" gracePeriod=30 Jul 08 23:13:09.896070 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:09.896044 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:13:09.998351 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:09.998271 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/675b1c56-1f9f-4dec-8a98-07dfb16fece3-trusted-ca\") pod \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " Jul 08 23:13:09.998494 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:09.998368 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls\") pod \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " Jul 08 23:13:09.998494 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:09.998420 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rbls\" (UniqueName: \"kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-kube-api-access-9rbls\") pod \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " Jul 08 23:13:09.998494 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:09.998456 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/675b1c56-1f9f-4dec-8a98-07dfb16fece3-ca-trust-extracted\") pod \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " Jul 08 23:13:09.998592 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:09.998544 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-bound-sa-token\") pod \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " Jul 08 23:13:09.998592 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:09.998573 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/675b1c56-1f9f-4dec-8a98-07dfb16fece3-installation-pull-secrets\") pod \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " Jul 08 23:13:09.998682 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:09.998608 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/675b1c56-1f9f-4dec-8a98-07dfb16fece3-image-registry-private-configuration\") pod \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " Jul 08 23:13:09.998682 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:09.998637 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-certificates\") pod \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\" (UID: \"675b1c56-1f9f-4dec-8a98-07dfb16fece3\") " Jul 08 23:13:09.998682 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:09.998657 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/675b1c56-1f9f-4dec-8a98-07dfb16fece3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "675b1c56-1f9f-4dec-8a98-07dfb16fece3" (UID: "675b1c56-1f9f-4dec-8a98-07dfb16fece3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 23:13:09.999333 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:09.998964 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/675b1c56-1f9f-4dec-8a98-07dfb16fece3-trusted-ca\") on node \"ip-10-0-133-37.ec2.internal\" DevicePath \"\"" Jul 08 23:13:09.999333 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:09.999267 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "675b1c56-1f9f-4dec-8a98-07dfb16fece3" (UID: "675b1c56-1f9f-4dec-8a98-07dfb16fece3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 23:13:10.000945 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:10.000915 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/675b1c56-1f9f-4dec-8a98-07dfb16fece3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "675b1c56-1f9f-4dec-8a98-07dfb16fece3" (UID: "675b1c56-1f9f-4dec-8a98-07dfb16fece3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 23:13:10.001048 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:10.000969 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "675b1c56-1f9f-4dec-8a98-07dfb16fece3" (UID: "675b1c56-1f9f-4dec-8a98-07dfb16fece3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 23:13:10.001048 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:10.000986 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "675b1c56-1f9f-4dec-8a98-07dfb16fece3" (UID: "675b1c56-1f9f-4dec-8a98-07dfb16fece3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 23:13:10.001184 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:10.001167 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-kube-api-access-9rbls" (OuterVolumeSpecName: "kube-api-access-9rbls") pod "675b1c56-1f9f-4dec-8a98-07dfb16fece3" (UID: "675b1c56-1f9f-4dec-8a98-07dfb16fece3"). InnerVolumeSpecName "kube-api-access-9rbls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 23:13:10.001232 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:10.001184 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/675b1c56-1f9f-4dec-8a98-07dfb16fece3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "675b1c56-1f9f-4dec-8a98-07dfb16fece3" (UID: "675b1c56-1f9f-4dec-8a98-07dfb16fece3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 23:13:10.007154 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:10.007132 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/675b1c56-1f9f-4dec-8a98-07dfb16fece3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "675b1c56-1f9f-4dec-8a98-07dfb16fece3" (UID: "675b1c56-1f9f-4dec-8a98-07dfb16fece3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 23:13:10.099699 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:10.099667 2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-tls\") on node \"ip-10-0-133-37.ec2.internal\" DevicePath \"\"" Jul 08 23:13:10.099699 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:10.099692 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rbls\" (UniqueName: \"kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-kube-api-access-9rbls\") on node \"ip-10-0-133-37.ec2.internal\" DevicePath \"\"" Jul 08 23:13:10.099699 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:10.099701 2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/675b1c56-1f9f-4dec-8a98-07dfb16fece3-ca-trust-extracted\") on node \"ip-10-0-133-37.ec2.internal\" DevicePath \"\"" Jul 08 23:13:10.099936 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:10.099711 2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/675b1c56-1f9f-4dec-8a98-07dfb16fece3-bound-sa-token\") on node \"ip-10-0-133-37.ec2.internal\" DevicePath \"\"" Jul 08 23:13:10.099936 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:10.099719 2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/675b1c56-1f9f-4dec-8a98-07dfb16fece3-installation-pull-secrets\") on node \"ip-10-0-133-37.ec2.internal\" DevicePath \"\"" Jul 08 23:13:10.099936 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:10.099727 2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/675b1c56-1f9f-4dec-8a98-07dfb16fece3-image-registry-private-configuration\") on node \"ip-10-0-133-37.ec2.internal\" DevicePath \"\"" Jul 08 23:13:10.099936 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:10.099736 2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/675b1c56-1f9f-4dec-8a98-07dfb16fece3-registry-certificates\") on node \"ip-10-0-133-37.ec2.internal\" DevicePath \"\"" Jul 08 23:13:10.401826 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:10.401794 2572 generic.go:356] "Generic (PLEG): container finished" podID="675b1c56-1f9f-4dec-8a98-07dfb16fece3" containerID="b68ca0ae167f5c0639ddf8dbe77e7872d7eaa17af99977b6cc00e216b5cedc01" exitCode=0 Jul 08 23:13:10.402017 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:10.401859 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" Jul 08 23:13:10.402017 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:10.401886 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" event={"ID":"675b1c56-1f9f-4dec-8a98-07dfb16fece3","Type":"ContainerDied","Data":"b68ca0ae167f5c0639ddf8dbe77e7872d7eaa17af99977b6cc00e216b5cedc01"} Jul 08 23:13:10.402017 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:10.401954 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bdc54fbb5-9tsk2" event={"ID":"675b1c56-1f9f-4dec-8a98-07dfb16fece3","Type":"ContainerDied","Data":"59e2255406bbeab557fc2c52841fa22be4ac1e71f1d073f8f7c05249505d0289"} Jul 08 23:13:10.402950 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:10.402930 2572 scope.go:117] "RemoveContainer" containerID="b68ca0ae167f5c0639ddf8dbe77e7872d7eaa17af99977b6cc00e216b5cedc01" Jul 08 23:13:10.411785 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:10.411765 2572 scope.go:117] "RemoveContainer" containerID="b68ca0ae167f5c0639ddf8dbe77e7872d7eaa17af99977b6cc00e216b5cedc01" Jul 08 23:13:10.412047 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:13:10.412027 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b68ca0ae167f5c0639ddf8dbe77e7872d7eaa17af99977b6cc00e216b5cedc01\": container with ID starting with b68ca0ae167f5c0639ddf8dbe77e7872d7eaa17af99977b6cc00e216b5cedc01 not found: ID does not exist" containerID="b68ca0ae167f5c0639ddf8dbe77e7872d7eaa17af99977b6cc00e216b5cedc01" Jul 08 23:13:10.412113 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:10.412055 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b68ca0ae167f5c0639ddf8dbe77e7872d7eaa17af99977b6cc00e216b5cedc01"} err="failed to get container status \"b68ca0ae167f5c0639ddf8dbe77e7872d7eaa17af99977b6cc00e216b5cedc01\": rpc error: code = NotFound desc = could not find container \"b68ca0ae167f5c0639ddf8dbe77e7872d7eaa17af99977b6cc00e216b5cedc01\": container with ID starting with b68ca0ae167f5c0639ddf8dbe77e7872d7eaa17af99977b6cc00e216b5cedc01 not found: ID does not exist" Jul 08 23:13:10.419031 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:10.419012 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bdc54fbb5-9tsk2"] Jul 08 23:13:10.422795 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:10.422774 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5bdc54fbb5-9tsk2"] Jul 08 23:13:12.117837 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:12.117752 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:13:12.168363 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:12.168324 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:13:12.329313 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:12.329282 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="675b1c56-1f9f-4dec-8a98-07dfb16fece3" path="/var/lib/kubelet/pods/675b1c56-1f9f-4dec-8a98-07dfb16fece3/volumes" Jul 08 23:13:12.412170 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:12.412088 2572 generic.go:356] "Generic (PLEG): container finished" podID="b7e8544c-2b88-4cad-a033-2907bcee4e6d" containerID="fb2ebf388d2edf1cbe2e54907954da8e27ff5f743a86de23a2409b18de45f1ac" exitCode=0 Jul 08 23:13:12.412170 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:12.412140 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rxx9c" event={"ID":"b7e8544c-2b88-4cad-a033-2907bcee4e6d","Type":"ContainerDied","Data":"fb2ebf388d2edf1cbe2e54907954da8e27ff5f743a86de23a2409b18de45f1ac"} Jul 08 23:13:12.412451 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:12.412435 2572 scope.go:117] "RemoveContainer" containerID="fb2ebf388d2edf1cbe2e54907954da8e27ff5f743a86de23a2409b18de45f1ac" Jul 08 23:13:13.417186 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:13.417153 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rxx9c" event={"ID":"b7e8544c-2b88-4cad-a033-2907bcee4e6d","Type":"ContainerStarted","Data":"773d7efda154a0f7fe9399072643be0f748f427e94398a04ed2814e499b059be"} Jul 08 23:13:19.227772 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:19.227740 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:13:19.328172 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:19.328143 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:13:19.378730 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:19.378703 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:13:27.114133 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:27.114100 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:13:27.216450 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:27.216417 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:13:27.405071 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:27.404994 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" Jul 08 23:13:27.409197 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:27.409155 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-56f85d5559-ptcx5" Jul 08 23:13:38.221642 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:38.221593 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs\") pod \"network-metrics-daemon-kwcdm\" (UID: \"3d290d52-819f-4ece-bc8e-11ce3dbb4d29\") " pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:13:38.223861 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:38.223834 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d290d52-819f-4ece-bc8e-11ce3dbb4d29-metrics-certs\") pod \"network-metrics-daemon-kwcdm\" (UID: \"3d290d52-819f-4ece-bc8e-11ce3dbb4d29\") " pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:13:38.327201 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:38.327169 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dwbh8\"" Jul 08 23:13:38.335016 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:38.335000 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwcdm" Jul 08 23:13:38.464457 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:38.464434 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kwcdm"] Jul 08 23:13:38.466987 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:13:38.466961 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d290d52_819f_4ece_bc8e_11ce3dbb4d29.slice/crio-7801e9106a170adeee64895955c714c49e500bcc2f3f871fddee65b2fd3246a3 WatchSource:0}: Error finding container 7801e9106a170adeee64895955c714c49e500bcc2f3f871fddee65b2fd3246a3: Status 404 returned error can't find the container with id 7801e9106a170adeee64895955c714c49e500bcc2f3f871fddee65b2fd3246a3 Jul 08 23:13:38.510838 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:38.510803 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kwcdm" event={"ID":"3d290d52-819f-4ece-bc8e-11ce3dbb4d29","Type":"ContainerStarted","Data":"7801e9106a170adeee64895955c714c49e500bcc2f3f871fddee65b2fd3246a3"} Jul 08 23:13:40.522515 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:40.522479 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kwcdm" event={"ID":"3d290d52-819f-4ece-bc8e-11ce3dbb4d29","Type":"ContainerStarted","Data":"b4f1f88d6d513d65578a857d36b88a2a6776f1a9d5315d0f849eb70720b5b5be"} Jul 08 23:13:40.522890 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:40.522541 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kwcdm" event={"ID":"3d290d52-819f-4ece-bc8e-11ce3dbb4d29","Type":"ContainerStarted","Data":"e4842bf15927b7552cd15b945ed3d6fa63177bb97ba83a02190f27629f1495df"} Jul 08 23:13:40.539161 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:40.539095 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kwcdm" podStartSLOduration=375.075191895 podStartE2EDuration="6m16.539076474s" totalImagesPullingTime="1.463884579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:13:40.537090109 +0000 UTC m=+376.696373619" watchObservedRunningTime="2026-07-08 23:13:40.539076474 +0000 UTC m=+376.698359984" Jul 08 23:13:40.618707 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:40.618677 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:13:40.720476 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:40.720437 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:13:47.008730 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:47.008697 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:13:47.061266 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:47.061233 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:13:48.755315 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:48.755279 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:13:49.220279 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:49.220239 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:13:49.239336 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:49.239310 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:13:49.576003 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:49.575978 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 23:13:52.872330 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:52.872294 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:13:52.929418 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:52.929363 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:13:58.766765 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:58.766725 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:13:58.818864 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:13:58.818836 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:14:01.811585 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:14:01.811541 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:14:01.864186 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:14:01.864153 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:14:01.931624 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:14:01.931592 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:14:02.035409 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:14:02.035376 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:14:02.535311 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:14:02.535276 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:14:02.583517 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:14:02.583489 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:14:10.687756 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:14:10.687721 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:14:10.734088 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:14:10.734057 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:14:13.000048 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:14:13.000014 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:14:13.046038 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:14:13.046008 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:14:13.104143 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:14:13.104109 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:14:13.155280 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:14:13.155251 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:14:27.127504 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:14:27.127452 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:14:27.222985 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:14:27.222953 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:15:11.182417 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:11.182337 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:15:11.283663 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:11.283623 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:15:32.777134 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:32.777102 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:15:33.545173 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:33.545143 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:15:36.376403 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:36.376364 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:15:36.423669 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:36.423624 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:15:38.349498 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:38.349463 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:15:38.453929 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:38.453880 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:15:38.600181 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:38.600099 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:15:38.753827 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:38.753789 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:15:40.369944 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:40.369890 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:15:40.776434 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:40.776404 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:15:43.170513 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:43.170470 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:15:43.225844 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:43.225811 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:15:48.968294 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:48.968260 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:15:49.067649 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:49.067615 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ht7k2"] Jul 08 23:15:49.068000 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:49.067986 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="675b1c56-1f9f-4dec-8a98-07dfb16fece3" containerName="registry" Jul 08 23:15:49.068048 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:49.068002 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="675b1c56-1f9f-4dec-8a98-07dfb16fece3" containerName="registry" Jul 08 23:15:49.068083 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:49.068072 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="675b1c56-1f9f-4dec-8a98-07dfb16fece3" containerName="registry" Jul 08 23:15:49.070905 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:49.070882 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ht7k2" Jul 08 23:15:49.073213 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:49.073191 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 08 23:15:49.073345 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:49.073251 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 08 23:15:49.073345 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:49.073257 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-lp2jg\"" Jul 08 23:15:49.078822 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:49.078801 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ht7k2"] Jul 08 23:15:49.117970 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:49.117945 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56mjm\" (UniqueName: \"kubernetes.io/projected/4032ac42-3452-4995-aaea-e2e8024b5ca9-kube-api-access-56mjm\") pod \"cert-manager-55b4d954d5-ht7k2\" (UID: \"4032ac42-3452-4995-aaea-e2e8024b5ca9\") " pod="cert-manager/cert-manager-55b4d954d5-ht7k2" Jul 08 23:15:49.118069 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:49.118007 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4032ac42-3452-4995-aaea-e2e8024b5ca9-bound-sa-token\") pod \"cert-manager-55b4d954d5-ht7k2\" (UID: \"4032ac42-3452-4995-aaea-e2e8024b5ca9\") " pod="cert-manager/cert-manager-55b4d954d5-ht7k2" Jul 08 23:15:49.219045 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:49.218951 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4032ac42-3452-4995-aaea-e2e8024b5ca9-bound-sa-token\") pod \"cert-manager-55b4d954d5-ht7k2\" (UID: \"4032ac42-3452-4995-aaea-e2e8024b5ca9\") " pod="cert-manager/cert-manager-55b4d954d5-ht7k2" Jul 08 23:15:49.219045 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:49.219006 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56mjm\" (UniqueName: \"kubernetes.io/projected/4032ac42-3452-4995-aaea-e2e8024b5ca9-kube-api-access-56mjm\") pod \"cert-manager-55b4d954d5-ht7k2\" (UID: \"4032ac42-3452-4995-aaea-e2e8024b5ca9\") " pod="cert-manager/cert-manager-55b4d954d5-ht7k2" Jul 08 23:15:49.227573 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:49.227547 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56mjm\" (UniqueName: \"kubernetes.io/projected/4032ac42-3452-4995-aaea-e2e8024b5ca9-kube-api-access-56mjm\") pod \"cert-manager-55b4d954d5-ht7k2\" (UID: \"4032ac42-3452-4995-aaea-e2e8024b5ca9\") " pod="cert-manager/cert-manager-55b4d954d5-ht7k2" Jul 08 23:15:49.227779 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:49.227635 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4032ac42-3452-4995-aaea-e2e8024b5ca9-bound-sa-token\") pod \"cert-manager-55b4d954d5-ht7k2\" (UID: \"4032ac42-3452-4995-aaea-e2e8024b5ca9\") " pod="cert-manager/cert-manager-55b4d954d5-ht7k2" Jul 08 23:15:49.388041 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:49.388007 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ht7k2" Jul 08 23:15:49.511540 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:49.511517 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ht7k2"] Jul 08 23:15:49.516915 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:15:49.516866 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4032ac42_3452_4995_aaea_e2e8024b5ca9.slice/crio-b5558140718c5d0549b3f9e2ad640145224f4862c2f6f4c6d0f1c766aa6114fd WatchSource:0}: Error finding container b5558140718c5d0549b3f9e2ad640145224f4862c2f6f4c6d0f1c766aa6114fd: Status 404 returned error can't find the container with id b5558140718c5d0549b3f9e2ad640145224f4862c2f6f4c6d0f1c766aa6114fd Jul 08 23:15:49.995527 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:49.995452 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ht7k2" event={"ID":"4032ac42-3452-4995-aaea-e2e8024b5ca9","Type":"ContainerStarted","Data":"b5558140718c5d0549b3f9e2ad640145224f4862c2f6f4c6d0f1c766aa6114fd"} Jul 08 23:15:50.856651 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:50.856596 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:15:50.954660 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:50.954625 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:15:52.315517 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:52.315487 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-986wx"] Jul 08 23:15:52.319102 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:52.319077 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-986wx" Jul 08 23:15:52.321659 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:52.321625 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 08 23:15:52.321771 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:52.321714 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-hl2wr\"" Jul 08 23:15:52.322551 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:52.322530 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 08 23:15:52.330810 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:52.330791 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-986wx"] Jul 08 23:15:52.346675 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:52.346646 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkp5v\" (UniqueName: \"kubernetes.io/projected/da380e20-b996-4a17-af36-4dc88dc9dc5c-kube-api-access-wkp5v\") pod \"openshift-lws-operator-fd8ccff4c-986wx\" (UID: \"da380e20-b996-4a17-af36-4dc88dc9dc5c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-986wx" Jul 08 23:15:52.346834 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:52.346718 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da380e20-b996-4a17-af36-4dc88dc9dc5c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-986wx\" (UID: \"da380e20-b996-4a17-af36-4dc88dc9dc5c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-986wx" Jul 08 23:15:52.448113 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:52.448081 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da380e20-b996-4a17-af36-4dc88dc9dc5c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-986wx\" (UID: \"da380e20-b996-4a17-af36-4dc88dc9dc5c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-986wx" Jul 08 23:15:52.448262 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:52.448177 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkp5v\" (UniqueName: \"kubernetes.io/projected/da380e20-b996-4a17-af36-4dc88dc9dc5c-kube-api-access-wkp5v\") pod \"openshift-lws-operator-fd8ccff4c-986wx\" (UID: \"da380e20-b996-4a17-af36-4dc88dc9dc5c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-986wx" Jul 08 23:15:52.448499 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:52.448477 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da380e20-b996-4a17-af36-4dc88dc9dc5c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-986wx\" (UID: \"da380e20-b996-4a17-af36-4dc88dc9dc5c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-986wx" Jul 08 23:15:52.456165 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:52.456145 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkp5v\" (UniqueName: \"kubernetes.io/projected/da380e20-b996-4a17-af36-4dc88dc9dc5c-kube-api-access-wkp5v\") pod \"openshift-lws-operator-fd8ccff4c-986wx\" (UID: \"da380e20-b996-4a17-af36-4dc88dc9dc5c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-986wx" Jul 08 23:15:52.630870 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:52.630789 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-986wx" Jul 08 23:15:52.753723 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:52.753691 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-986wx"] Jul 08 23:15:52.756629 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:15:52.756605 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda380e20_b996_4a17_af36_4dc88dc9dc5c.slice/crio-ab70f114010985451c391c7339bd6ffdfe0579f9e787616c747995733ffe774f WatchSource:0}: Error finding container ab70f114010985451c391c7339bd6ffdfe0579f9e787616c747995733ffe774f: Status 404 returned error can't find the container with id ab70f114010985451c391c7339bd6ffdfe0579f9e787616c747995733ffe774f Jul 08 23:15:53.009851 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:53.009814 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ht7k2" event={"ID":"4032ac42-3452-4995-aaea-e2e8024b5ca9","Type":"ContainerStarted","Data":"3e4371395e64ea832bbbe42ec6e2fd24cb87f8780d964ea40ccb81f05cef0e9b"} Jul 08 23:15:53.011078 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:53.011057 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-986wx" event={"ID":"da380e20-b996-4a17-af36-4dc88dc9dc5c","Type":"ContainerStarted","Data":"ab70f114010985451c391c7339bd6ffdfe0579f9e787616c747995733ffe774f"} Jul 08 23:15:53.026868 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:53.026798 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-ht7k2" podStartSLOduration=1.083619854 podStartE2EDuration="4.026780389s" totalImagesPullingTime="2.943160535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:15:53.02634133 +0000 UTC m=+509.185624840" watchObservedRunningTime="2026-07-08 23:15:53.026780389 +0000 UTC m=+509.186063898" Jul 08 23:15:56.024913 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:56.024865 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-986wx" event={"ID":"da380e20-b996-4a17-af36-4dc88dc9dc5c","Type":"ContainerStarted","Data":"661d649f7af7680bca94638102ab1e74cee34ca6420b97f9aa637b66b222bdbd"} Jul 08 23:15:56.042634 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:56.042587 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-986wx" podStartSLOduration=1.741462088 podStartE2EDuration="4.042571189s" totalImagesPullingTime="2.301109101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:15:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:15:56.041209616 +0000 UTC m=+512.200493149" watchObservedRunningTime="2026-07-08 23:15:56.042571189 +0000 UTC m=+512.201854698" Jul 08 23:15:56.681917 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:56.681861 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:15:56.787719 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:56.787685 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:15:58.751436 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:15:58.751404 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:08.370390 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:08.370356 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:08.459438 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:08.459407 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:14.437035 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:14.437005 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:14.553143 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:14.553111 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:14.832536 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:14.832505 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:15.088448 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.088370 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:15.232673 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.232633 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:15.294849 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.294821 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b86895794-mzzr5"] Jul 08 23:16:15.304434 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.304412 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-mzzr5" Jul 08 23:16:15.309054 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.309028 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 08 23:16:15.309259 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.309241 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-k6v7k\"" Jul 08 23:16:15.309346 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.309289 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 23:16:15.309346 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.309330 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 23:16:15.309494 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.309475 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 08 23:16:15.318580 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.318556 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b86895794-mzzr5"] Jul 08 23:16:15.442092 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.442006 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e-manifests\") pod \"opendatahub-operator-controller-manager-7b86895794-mzzr5\" (UID: \"1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-mzzr5" Jul 08 23:16:15.442092 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.442053 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b86895794-mzzr5\" (UID: \"1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-mzzr5" Jul 08 23:16:15.442092 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.442092 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e-tmp\") pod \"opendatahub-operator-controller-manager-7b86895794-mzzr5\" (UID: \"1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-mzzr5" Jul 08 23:16:15.442628 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.442115 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zzqt\" (UniqueName: \"kubernetes.io/projected/1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e-kube-api-access-6zzqt\") pod \"opendatahub-operator-controller-manager-7b86895794-mzzr5\" (UID: \"1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-mzzr5" Jul 08 23:16:15.442628 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.442198 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b86895794-mzzr5\" (UID: \"1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-mzzr5" Jul 08 23:16:15.444520 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.444480 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:15.542923 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.542877 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b86895794-mzzr5\" (UID: \"1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-mzzr5" Jul 08 23:16:15.543180 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.543156 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e-manifests\") pod \"opendatahub-operator-controller-manager-7b86895794-mzzr5\" (UID: \"1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-mzzr5" Jul 08 23:16:15.543274 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.543213 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b86895794-mzzr5\" (UID: \"1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-mzzr5" Jul 08 23:16:15.543274 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.543269 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e-tmp\") pod \"opendatahub-operator-controller-manager-7b86895794-mzzr5\" (UID: \"1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-mzzr5" Jul 08 23:16:15.543378 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.543296 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zzqt\" (UniqueName: \"kubernetes.io/projected/1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e-kube-api-access-6zzqt\") pod \"opendatahub-operator-controller-manager-7b86895794-mzzr5\" (UID: \"1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-mzzr5" Jul 08 23:16:15.543607 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.543580 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e-manifests\") pod \"opendatahub-operator-controller-manager-7b86895794-mzzr5\" (UID: \"1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-mzzr5" Jul 08 23:16:15.545843 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.545818 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e-tmp\") pod \"opendatahub-operator-controller-manager-7b86895794-mzzr5\" (UID: \"1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-mzzr5" Jul 08 23:16:15.546028 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.546001 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b86895794-mzzr5\" (UID: \"1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-mzzr5" Jul 08 23:16:15.546263 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.546238 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b86895794-mzzr5\" (UID: \"1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-mzzr5" Jul 08 23:16:15.553295 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.553267 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:15.555540 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.555516 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zzqt\" (UniqueName: \"kubernetes.io/projected/1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e-kube-api-access-6zzqt\") pod \"opendatahub-operator-controller-manager-7b86895794-mzzr5\" (UID: \"1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e\") " pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-mzzr5" Jul 08 23:16:15.614462 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.614440 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-mzzr5" Jul 08 23:16:15.655183 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.655151 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:15.742576 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.742545 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:15.758384 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.758340 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b86895794-mzzr5"] Jul 08 23:16:15.844131 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.844099 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:15.952732 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:15.952640 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:16.060010 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:16.059975 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:16.102335 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:16.102304 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-mzzr5" event={"ID":"1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e","Type":"ContainerStarted","Data":"6519c925fc0bc5b22d6a7a97cc575107a00760beea8a98469ec66ddf8c842916"} Jul 08 23:16:19.120226 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:19.120134 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-mzzr5" event={"ID":"1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e","Type":"ContainerStarted","Data":"b005a6baa4a753aaa596d04ad37066e2a7d3e82c6bd58e4906802c59d62a300d"} Jul 08 23:16:20.126168 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:20.126139 2572 generic.go:356] "Generic (PLEG): container finished" podID="1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e" containerID="b005a6baa4a753aaa596d04ad37066e2a7d3e82c6bd58e4906802c59d62a300d" exitCode=0 Jul 08 23:16:20.126608 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:20.126211 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-mzzr5" event={"ID":"1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e","Type":"ContainerDied","Data":"b005a6baa4a753aaa596d04ad37066e2a7d3e82c6bd58e4906802c59d62a300d"} Jul 08 23:16:21.132416 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:21.132378 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-mzzr5" event={"ID":"1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e","Type":"ContainerStarted","Data":"8d5e76048d693009f1eefd0c1129734e09e96e4031ded787b312edea57a322f1"} Jul 08 23:16:21.132782 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:21.132467 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-mzzr5" Jul 08 23:16:21.194079 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:21.194030 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-mzzr5" podStartSLOduration=1.735679271 podStartE2EDuration="6.194015033s" totalImagesPullingTime="3.37896136s" totalInitContainerRuntime="1.079374402s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:16:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:16:21.192872306 +0000 UTC m=+537.352155817" watchObservedRunningTime="2026-07-08 23:16:21.194015033 +0000 UTC m=+537.353298541" Jul 08 23:16:21.673713 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:21.673683 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:21.759000 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:21.758966 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:22.873043 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:22.873011 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:23.032082 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:23.032003 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:28.442607 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:28.442574 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:32.139177 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:32.139148 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7b86895794-mzzr5" Jul 08 23:16:34.541194 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:34.541162 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:34.798713 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:34.798630 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:35.786097 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:35.786058 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:36.007148 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:36.007114 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:36.191721 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:36.191629 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:36.461242 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:36.461129 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:37.467727 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:37.467692 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:37.799037 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:37.799003 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:38.244241 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:38.244162 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:38.762604 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:38.762543 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:40.505171 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:40.505125 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:40.612208 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:40.612175 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:42.092155 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:42.092126 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-56bdb7f565-nm95f"] Jul 08 23:16:42.100865 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:42.100836 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56bdb7f565-nm95f" Jul 08 23:16:42.110282 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:42.110261 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 08 23:16:42.111060 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:42.111044 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6tvpb\"" Jul 08 23:16:42.113014 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:42.112995 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 08 23:16:42.114008 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:42.113994 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 08 23:16:42.121886 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:42.121861 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56bdb7f565-nm95f"] Jul 08 23:16:42.201612 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:42.201576 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2fee4259-b52a-474e-ac1f-8fe0b8eb1615-manager-config\") pod \"lws-controller-manager-56bdb7f565-nm95f\" (UID: \"2fee4259-b52a-474e-ac1f-8fe0b8eb1615\") " pod="openshift-lws-operator/lws-controller-manager-56bdb7f565-nm95f" Jul 08 23:16:42.201612 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:42.201619 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jn48\" (UniqueName: \"kubernetes.io/projected/2fee4259-b52a-474e-ac1f-8fe0b8eb1615-kube-api-access-4jn48\") pod \"lws-controller-manager-56bdb7f565-nm95f\" (UID: \"2fee4259-b52a-474e-ac1f-8fe0b8eb1615\") " pod="openshift-lws-operator/lws-controller-manager-56bdb7f565-nm95f" Jul 08 23:16:42.201857 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:42.201679 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2fee4259-b52a-474e-ac1f-8fe0b8eb1615-cert\") pod \"lws-controller-manager-56bdb7f565-nm95f\" (UID: \"2fee4259-b52a-474e-ac1f-8fe0b8eb1615\") " pod="openshift-lws-operator/lws-controller-manager-56bdb7f565-nm95f" Jul 08 23:16:42.201857 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:42.201737 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2fee4259-b52a-474e-ac1f-8fe0b8eb1615-metrics-cert\") pod \"lws-controller-manager-56bdb7f565-nm95f\" (UID: \"2fee4259-b52a-474e-ac1f-8fe0b8eb1615\") " pod="openshift-lws-operator/lws-controller-manager-56bdb7f565-nm95f" Jul 08 23:16:42.257173 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:42.257108 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:42.302561 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:42.302529 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2fee4259-b52a-474e-ac1f-8fe0b8eb1615-manager-config\") pod \"lws-controller-manager-56bdb7f565-nm95f\" (UID: \"2fee4259-b52a-474e-ac1f-8fe0b8eb1615\") " pod="openshift-lws-operator/lws-controller-manager-56bdb7f565-nm95f" Jul 08 23:16:42.302750 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:42.302578 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jn48\" (UniqueName: \"kubernetes.io/projected/2fee4259-b52a-474e-ac1f-8fe0b8eb1615-kube-api-access-4jn48\") pod \"lws-controller-manager-56bdb7f565-nm95f\" (UID: \"2fee4259-b52a-474e-ac1f-8fe0b8eb1615\") " pod="openshift-lws-operator/lws-controller-manager-56bdb7f565-nm95f" Jul 08 23:16:42.302750 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:42.302615 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2fee4259-b52a-474e-ac1f-8fe0b8eb1615-cert\") pod \"lws-controller-manager-56bdb7f565-nm95f\" (UID: \"2fee4259-b52a-474e-ac1f-8fe0b8eb1615\") " pod="openshift-lws-operator/lws-controller-manager-56bdb7f565-nm95f" Jul 08 23:16:42.302750 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:42.302655 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2fee4259-b52a-474e-ac1f-8fe0b8eb1615-metrics-cert\") pod \"lws-controller-manager-56bdb7f565-nm95f\" (UID: \"2fee4259-b52a-474e-ac1f-8fe0b8eb1615\") " pod="openshift-lws-operator/lws-controller-manager-56bdb7f565-nm95f" Jul 08 23:16:42.303358 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:42.303331 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2fee4259-b52a-474e-ac1f-8fe0b8eb1615-manager-config\") pod \"lws-controller-manager-56bdb7f565-nm95f\" (UID: \"2fee4259-b52a-474e-ac1f-8fe0b8eb1615\") " pod="openshift-lws-operator/lws-controller-manager-56bdb7f565-nm95f" Jul 08 23:16:42.305283 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:42.305263 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2fee4259-b52a-474e-ac1f-8fe0b8eb1615-metrics-cert\") pod \"lws-controller-manager-56bdb7f565-nm95f\" (UID: \"2fee4259-b52a-474e-ac1f-8fe0b8eb1615\") " pod="openshift-lws-operator/lws-controller-manager-56bdb7f565-nm95f" Jul 08 23:16:42.305283 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:42.305276 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2fee4259-b52a-474e-ac1f-8fe0b8eb1615-cert\") pod \"lws-controller-manager-56bdb7f565-nm95f\" (UID: \"2fee4259-b52a-474e-ac1f-8fe0b8eb1615\") " pod="openshift-lws-operator/lws-controller-manager-56bdb7f565-nm95f" Jul 08 23:16:42.345378 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:42.345319 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jn48\" (UniqueName: \"kubernetes.io/projected/2fee4259-b52a-474e-ac1f-8fe0b8eb1615-kube-api-access-4jn48\") pod \"lws-controller-manager-56bdb7f565-nm95f\" (UID: \"2fee4259-b52a-474e-ac1f-8fe0b8eb1615\") " pod="openshift-lws-operator/lws-controller-manager-56bdb7f565-nm95f" Jul 08 23:16:42.410420 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:42.410393 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56bdb7f565-nm95f" Jul 08 23:16:42.501392 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:42.501342 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:42.583486 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:42.583462 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56bdb7f565-nm95f"] Jul 08 23:16:42.586333 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:16:42.586300 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fee4259_b52a_474e_ac1f_8fe0b8eb1615.slice/crio-202752d7f099e17c45af99e0e65780a82b9f8777d1d09afeb5ba2046071cd9ea WatchSource:0}: Error finding container 202752d7f099e17c45af99e0e65780a82b9f8777d1d09afeb5ba2046071cd9ea: Status 404 returned error can't find the container with id 202752d7f099e17c45af99e0e65780a82b9f8777d1d09afeb5ba2046071cd9ea Jul 08 23:16:43.177361 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:43.177332 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:43.226323 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:43.226291 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56bdb7f565-nm95f" event={"ID":"2fee4259-b52a-474e-ac1f-8fe0b8eb1615","Type":"ContainerStarted","Data":"202752d7f099e17c45af99e0e65780a82b9f8777d1d09afeb5ba2046071cd9ea"} Jul 08 23:16:44.661051 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:44.660952 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:44.766624 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:44.766583 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:45.518958 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:45.518873 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:45.668634 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:45.668605 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:46.224987 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.224957 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx"] Jul 08 23:16:46.227760 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.227736 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:46.228338 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.228323 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx" Jul 08 23:16:46.234725 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.234688 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 23:16:46.234855 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.234688 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 08 23:16:46.234855 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.234738 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 08 23:16:46.234855 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.234755 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 08 23:16:46.235630 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.235605 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-lj5mn\"" Jul 08 23:16:46.235724 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.235639 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 08 23:16:46.235724 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.235669 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 23:16:46.273006 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.272966 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx"] Jul 08 23:16:46.336243 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.336217 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8fsz\" (UniqueName: \"kubernetes.io/projected/469a1a3e-3527-4624-9a7b-85236d2db4c7-kube-api-access-v8fsz\") pod \"istiod-openshift-gateway-94bb8fbfd-mswnx\" (UID: \"469a1a3e-3527-4624-9a7b-85236d2db4c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx" Jul 08 23:16:46.336243 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.336251 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/469a1a3e-3527-4624-9a7b-85236d2db4c7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-mswnx\" (UID: \"469a1a3e-3527-4624-9a7b-85236d2db4c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx" Jul 08 23:16:46.336474 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.336270 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/469a1a3e-3527-4624-9a7b-85236d2db4c7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-mswnx\" (UID: \"469a1a3e-3527-4624-9a7b-85236d2db4c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx" Jul 08 23:16:46.336474 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.336294 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/469a1a3e-3527-4624-9a7b-85236d2db4c7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-mswnx\" (UID: \"469a1a3e-3527-4624-9a7b-85236d2db4c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx" Jul 08 23:16:46.336474 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.336422 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/469a1a3e-3527-4624-9a7b-85236d2db4c7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-mswnx\" (UID: \"469a1a3e-3527-4624-9a7b-85236d2db4c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx" Jul 08 23:16:46.336587 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.336538 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/469a1a3e-3527-4624-9a7b-85236d2db4c7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-mswnx\" (UID: \"469a1a3e-3527-4624-9a7b-85236d2db4c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx" Jul 08 23:16:46.336587 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.336569 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/469a1a3e-3527-4624-9a7b-85236d2db4c7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-mswnx\" (UID: \"469a1a3e-3527-4624-9a7b-85236d2db4c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx" Jul 08 23:16:46.437662 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.437630 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/469a1a3e-3527-4624-9a7b-85236d2db4c7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-mswnx\" (UID: \"469a1a3e-3527-4624-9a7b-85236d2db4c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx" Jul 08 23:16:46.437802 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.437705 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/469a1a3e-3527-4624-9a7b-85236d2db4c7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-mswnx\" (UID: \"469a1a3e-3527-4624-9a7b-85236d2db4c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx" Jul 08 23:16:46.437802 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.437725 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/469a1a3e-3527-4624-9a7b-85236d2db4c7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-mswnx\" (UID: \"469a1a3e-3527-4624-9a7b-85236d2db4c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx" Jul 08 23:16:46.437802 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.437744 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8fsz\" (UniqueName: \"kubernetes.io/projected/469a1a3e-3527-4624-9a7b-85236d2db4c7-kube-api-access-v8fsz\") pod \"istiod-openshift-gateway-94bb8fbfd-mswnx\" (UID: \"469a1a3e-3527-4624-9a7b-85236d2db4c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx" Jul 08 23:16:46.437802 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.437764 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/469a1a3e-3527-4624-9a7b-85236d2db4c7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-mswnx\" (UID: \"469a1a3e-3527-4624-9a7b-85236d2db4c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx" Jul 08 23:16:46.437802 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.437786 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/469a1a3e-3527-4624-9a7b-85236d2db4c7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-mswnx\" (UID: \"469a1a3e-3527-4624-9a7b-85236d2db4c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx" Jul 08 23:16:46.438107 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.437883 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/469a1a3e-3527-4624-9a7b-85236d2db4c7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-mswnx\" (UID: \"469a1a3e-3527-4624-9a7b-85236d2db4c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx" Jul 08 23:16:46.438651 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.438623 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/469a1a3e-3527-4624-9a7b-85236d2db4c7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-mswnx\" (UID: \"469a1a3e-3527-4624-9a7b-85236d2db4c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx" Jul 08 23:16:46.440155 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.440137 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/469a1a3e-3527-4624-9a7b-85236d2db4c7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-mswnx\" (UID: \"469a1a3e-3527-4624-9a7b-85236d2db4c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx" Jul 08 23:16:46.440219 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.440183 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/469a1a3e-3527-4624-9a7b-85236d2db4c7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-mswnx\" (UID: \"469a1a3e-3527-4624-9a7b-85236d2db4c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx" Jul 08 23:16:46.440262 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.440228 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/469a1a3e-3527-4624-9a7b-85236d2db4c7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-mswnx\" (UID: \"469a1a3e-3527-4624-9a7b-85236d2db4c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx" Jul 08 23:16:46.440262 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.440247 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/469a1a3e-3527-4624-9a7b-85236d2db4c7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-mswnx\" (UID: \"469a1a3e-3527-4624-9a7b-85236d2db4c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx" Jul 08 23:16:46.475935 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.475865 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8fsz\" (UniqueName: \"kubernetes.io/projected/469a1a3e-3527-4624-9a7b-85236d2db4c7-kube-api-access-v8fsz\") pod \"istiod-openshift-gateway-94bb8fbfd-mswnx\" (UID: \"469a1a3e-3527-4624-9a7b-85236d2db4c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx" Jul 08 23:16:46.480475 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.480457 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/469a1a3e-3527-4624-9a7b-85236d2db4c7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-mswnx\" (UID: \"469a1a3e-3527-4624-9a7b-85236d2db4c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx" Jul 08 23:16:46.494234 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.494191 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:46.537981 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.537957 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx" Jul 08 23:16:46.693510 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.693477 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx"] Jul 08 23:16:46.698455 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:16:46.698432 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod469a1a3e_3527_4624_9a7b_85236d2db4c7.slice/crio-d644be306c9e398a73baabe93d70ee484acd1f5c3ab73ba6087b8f4b9a2a5e72 WatchSource:0}: Error finding container d644be306c9e398a73baabe93d70ee484acd1f5c3ab73ba6087b8f4b9a2a5e72: Status 404 returned error can't find the container with id d644be306c9e398a73baabe93d70ee484acd1f5c3ab73ba6087b8f4b9a2a5e72 Jul 08 23:16:46.739884 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:46.739821 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:47.246467 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:47.246426 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx" event={"ID":"469a1a3e-3527-4624-9a7b-85236d2db4c7","Type":"ContainerStarted","Data":"d644be306c9e398a73baabe93d70ee484acd1f5c3ab73ba6087b8f4b9a2a5e72"} Jul 08 23:16:48.768191 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:48.768154 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:48.965947 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:48.965915 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:49.107397 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:49.107307 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:50.237706 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:50.237663 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:50.445411 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:50.445381 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:54.105331 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:54.105290 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 23:16:54.105692 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:54.105371 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 23:16:54.283668 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:54.283635 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx" event={"ID":"469a1a3e-3527-4624-9a7b-85236d2db4c7","Type":"ContainerStarted","Data":"7f958cf41922d4405c8a280995a6afd98abe85f9160acf7e97582b5537e24942"} Jul 08 23:16:54.283838 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:54.283761 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx" Jul 08 23:16:54.334929 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:54.334873 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx" podStartSLOduration=0.930406509 podStartE2EDuration="8.334858219s" totalImagesPullingTime="7.40445171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:16:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:16:54.333226175 +0000 UTC m=+570.492509683" watchObservedRunningTime="2026-07-08 23:16:54.334858219 +0000 UTC m=+570.494141728" Jul 08 23:16:55.289545 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:55.289516 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mswnx" Jul 08 23:16:55.709351 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:55.709268 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:55.804521 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:55.804482 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:16:57.298314 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:57.298273 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56bdb7f565-nm95f" event={"ID":"2fee4259-b52a-474e-ac1f-8fe0b8eb1615","Type":"ContainerStarted","Data":"c0857e53669d41c4140e8156c7a2ec66471d037027e27d3c494d46a24a7e6c09"} Jul 08 23:16:57.298785 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:57.298393 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-56bdb7f565-nm95f" Jul 08 23:16:57.328807 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:16:57.328763 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-56bdb7f565-nm95f" podStartSLOduration=0.765746236 podStartE2EDuration="15.32875058s" totalImagesPullingTime="14.563004344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:16:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:16:57.328587272 +0000 UTC m=+573.487870782" watchObservedRunningTime="2026-07-08 23:16:57.32875058 +0000 UTC m=+573.488034088" Jul 08 23:17:08.305217 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:17:08.305190 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-56bdb7f565-nm95f" Jul 08 23:17:15.596976 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:17:15.596940 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:17:15.698481 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:17:15.698447 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:17:17.386217 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:17:17.386184 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:17:28.964000 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:17:28.963959 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:17:35.527801 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:17:35.527761 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:17:36.904513 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:17:36.904482 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:05.425922 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:05.425825 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:08.855554 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:08.855516 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:10.839209 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:10.839172 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:12.498958 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:12.498918 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:12.734120 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:12.734077 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:12.836183 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:12.836157 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:16.044056 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:16.044021 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:16.307381 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:16.307350 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:19.275590 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:19.275548 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:20.383483 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:20.383448 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:20.495795 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:20.495760 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:20.576264 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:20.576237 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:20.711437 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:20.711332 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:22.630609 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:22.630577 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:28.228217 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:28.228180 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:28.341276 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:28.341247 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:30.364775 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:30.364741 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kxvbr"] Jul 08 23:18:30.368165 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:30.368146 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kxvbr" Jul 08 23:18:30.370827 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:30.370808 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-p8ghq\"" Jul 08 23:18:30.371131 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:30.371119 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 23:18:30.371195 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:30.371139 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 23:18:30.386394 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:30.386313 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kxvbr"] Jul 08 23:18:30.469863 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:30.469821 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52nvn\" (UniqueName: \"kubernetes.io/projected/ba8bdbb8-d890-4f54-aca1-13d401b00f17-kube-api-access-52nvn\") pod \"kuadrant-operator-controller-manager-55467d9f7-kxvbr\" (UID: \"ba8bdbb8-d890-4f54-aca1-13d401b00f17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kxvbr" Jul 08 23:18:30.470059 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:30.469889 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba8bdbb8-d890-4f54-aca1-13d401b00f17-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-kxvbr\" (UID: \"ba8bdbb8-d890-4f54-aca1-13d401b00f17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kxvbr" Jul 08 23:18:30.571033 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:30.570985 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba8bdbb8-d890-4f54-aca1-13d401b00f17-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-kxvbr\" (UID: \"ba8bdbb8-d890-4f54-aca1-13d401b00f17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kxvbr" Jul 08 23:18:30.571206 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:30.571079 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52nvn\" (UniqueName: \"kubernetes.io/projected/ba8bdbb8-d890-4f54-aca1-13d401b00f17-kube-api-access-52nvn\") pod \"kuadrant-operator-controller-manager-55467d9f7-kxvbr\" (UID: \"ba8bdbb8-d890-4f54-aca1-13d401b00f17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kxvbr" Jul 08 23:18:30.571396 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:30.571375 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba8bdbb8-d890-4f54-aca1-13d401b00f17-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-kxvbr\" (UID: \"ba8bdbb8-d890-4f54-aca1-13d401b00f17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kxvbr" Jul 08 23:18:30.582421 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:30.582400 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52nvn\" (UniqueName: \"kubernetes.io/projected/ba8bdbb8-d890-4f54-aca1-13d401b00f17-kube-api-access-52nvn\") pod \"kuadrant-operator-controller-manager-55467d9f7-kxvbr\" (UID: \"ba8bdbb8-d890-4f54-aca1-13d401b00f17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kxvbr" Jul 08 23:18:30.678151 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:30.678076 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kxvbr" Jul 08 23:18:30.778983 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:30.778950 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kxvbr"] Jul 08 23:18:30.791747 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:30.791720 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kxvbr"] Jul 08 23:18:30.867509 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:30.867481 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z48d9"] Jul 08 23:18:30.871971 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:30.871949 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z48d9" Jul 08 23:18:30.889872 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:30.889843 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z48d9"] Jul 08 23:18:30.916292 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:18:30.916258 2572 log.go:32] "RunPodSandbox from runtime service failed" err=< Jul 08 23:18:30.916292 ip-10-0-133-37 kubenswrapper[2572]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-kxvbr_kuadrant-system_ba8bdbb8-d890-4f54-aca1-13d401b00f17_0(f92b76e6db201a68fecb412f95382e0e5b22ee8df4e67d7fefb12d9039c82277): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-kxvbr to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"f92b76e6db201a68fecb412f95382e0e5b22ee8df4e67d7fefb12d9039c82277" Netns:"/var/run/netns/add14712-f544-4463-a8e8-5fdd214fbeba" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-kxvbr;K8S_POD_INFRA_CONTAINER_ID=f92b76e6db201a68fecb412f95382e0e5b22ee8df4e67d7fefb12d9039c82277;K8S_POD_UID=ba8bdbb8-d890-4f54-aca1-13d401b00f17" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kxvbr] networking: Multus: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kxvbr/ba8bdbb8-d890-4f54-aca1-13d401b00f17]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-kxvbr in out of cluster comm: SetNetworkStatus: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-kxvbr in out of cluster comm: status update failed for pod /: pods "kuadrant-operator-controller-manager-55467d9f7-kxvbr" not found Jul 08 23:18:30.916292 ip-10-0-133-37 kubenswrapper[2572]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jul 08 23:18:30.916292 ip-10-0-133-37 kubenswrapper[2572]: > Jul 08 23:18:30.916532 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:18:30.916318 2572 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Jul 08 23:18:30.916532 ip-10-0-133-37 kubenswrapper[2572]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-kxvbr_kuadrant-system_ba8bdbb8-d890-4f54-aca1-13d401b00f17_0(f92b76e6db201a68fecb412f95382e0e5b22ee8df4e67d7fefb12d9039c82277): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-kxvbr to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"f92b76e6db201a68fecb412f95382e0e5b22ee8df4e67d7fefb12d9039c82277" Netns:"/var/run/netns/add14712-f544-4463-a8e8-5fdd214fbeba" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-kxvbr;K8S_POD_INFRA_CONTAINER_ID=f92b76e6db201a68fecb412f95382e0e5b22ee8df4e67d7fefb12d9039c82277;K8S_POD_UID=ba8bdbb8-d890-4f54-aca1-13d401b00f17" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kxvbr] networking: Multus: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kxvbr/ba8bdbb8-d890-4f54-aca1-13d401b00f17]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-kxvbr in out of cluster comm: SetNetworkStatus: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-kxvbr in out of cluster comm: status update failed for pod /: pods "kuadrant-operator-controller-manager-55467d9f7-kxvbr" not found Jul 08 23:18:30.916532 ip-10-0-133-37 kubenswrapper[2572]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jul 08 23:18:30.916532 ip-10-0-133-37 kubenswrapper[2572]: > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kxvbr" Jul 08 23:18:30.974885 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:30.974783 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z48d9\" (UID: \"8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z48d9" Jul 08 23:18:30.975057 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:30.974922 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq44h\" (UniqueName: \"kubernetes.io/projected/8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6-kube-api-access-fq44h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z48d9\" (UID: \"8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z48d9" Jul 08 23:18:31.075814 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:31.075780 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq44h\" (UniqueName: \"kubernetes.io/projected/8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6-kube-api-access-fq44h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z48d9\" (UID: \"8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z48d9" Jul 08 23:18:31.076022 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:31.075827 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z48d9\" (UID: \"8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z48d9" Jul 08 23:18:31.076237 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:31.076218 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z48d9\" (UID: \"8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z48d9" Jul 08 23:18:31.084452 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:31.084429 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq44h\" (UniqueName: \"kubernetes.io/projected/8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6-kube-api-access-fq44h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z48d9\" (UID: \"8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z48d9" Jul 08 23:18:31.185969 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:31.185940 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z48d9" Jul 08 23:18:31.317448 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:31.317396 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:31.327914 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:31.327871 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z48d9"] Jul 08 23:18:31.330113 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:18:31.330086 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d91c248_9e3f_43e2_b4bd_9c9cc5ac1ac6.slice/crio-e7a3efa7031541d5408a365a8bb60bb5619e8f4425dff4bb4cf8919ad748cb74 WatchSource:0}: Error finding container e7a3efa7031541d5408a365a8bb60bb5619e8f4425dff4bb4cf8919ad748cb74: Status 404 returned error can't find the container with id e7a3efa7031541d5408a365a8bb60bb5619e8f4425dff4bb4cf8919ad748cb74 Jul 08 23:18:31.332533 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:31.332514 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 23:18:31.416013 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:31.415981 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:31.525136 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:31.525110 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:31.708555 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:31.708528 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kxvbr" Jul 08 23:18:31.708555 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:31.708549 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z48d9" event={"ID":"8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6","Type":"ContainerStarted","Data":"e7a3efa7031541d5408a365a8bb60bb5619e8f4425dff4bb4cf8919ad748cb74"} Jul 08 23:18:31.710981 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:18:31.710955 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-kxvbr\" is forbidden: User \"system:node:ip-10-0-133-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-37.ec2.internal' and this object" podUID="ba8bdbb8-d890-4f54-aca1-13d401b00f17" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kxvbr" Jul 08 23:18:31.716604 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:31.716587 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kxvbr" Jul 08 23:18:31.718882 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:18:31.718859 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-kxvbr\" is forbidden: User \"system:node:ip-10-0-133-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-37.ec2.internal' and this object" podUID="ba8bdbb8-d890-4f54-aca1-13d401b00f17" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kxvbr" Jul 08 23:18:31.883113 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:31.883036 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba8bdbb8-d890-4f54-aca1-13d401b00f17-extensions-socket-volume\") pod \"ba8bdbb8-d890-4f54-aca1-13d401b00f17\" (UID: \"ba8bdbb8-d890-4f54-aca1-13d401b00f17\") " Jul 08 23:18:31.883113 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:31.883099 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52nvn\" (UniqueName: \"kubernetes.io/projected/ba8bdbb8-d890-4f54-aca1-13d401b00f17-kube-api-access-52nvn\") pod \"ba8bdbb8-d890-4f54-aca1-13d401b00f17\" (UID: \"ba8bdbb8-d890-4f54-aca1-13d401b00f17\") " Jul 08 23:18:31.883371 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:31.883347 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba8bdbb8-d890-4f54-aca1-13d401b00f17-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ba8bdbb8-d890-4f54-aca1-13d401b00f17" (UID: "ba8bdbb8-d890-4f54-aca1-13d401b00f17"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 23:18:31.885138 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:31.885112 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba8bdbb8-d890-4f54-aca1-13d401b00f17-kube-api-access-52nvn" (OuterVolumeSpecName: "kube-api-access-52nvn") pod "ba8bdbb8-d890-4f54-aca1-13d401b00f17" (UID: "ba8bdbb8-d890-4f54-aca1-13d401b00f17"). InnerVolumeSpecName "kube-api-access-52nvn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 23:18:31.984369 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:31.984333 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52nvn\" (UniqueName: \"kubernetes.io/projected/ba8bdbb8-d890-4f54-aca1-13d401b00f17-kube-api-access-52nvn\") on node \"ip-10-0-133-37.ec2.internal\" DevicePath \"\"" Jul 08 23:18:31.984369 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:31.984371 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba8bdbb8-d890-4f54-aca1-13d401b00f17-extensions-socket-volume\") on node \"ip-10-0-133-37.ec2.internal\" DevicePath \"\"" Jul 08 23:18:32.329866 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:32.329837 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba8bdbb8-d890-4f54-aca1-13d401b00f17" path="/var/lib/kubelet/pods/ba8bdbb8-d890-4f54-aca1-13d401b00f17/volumes" Jul 08 23:18:32.716440 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:32.716357 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kxvbr" Jul 08 23:18:32.721384 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:18:32.721349 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-kxvbr\" is forbidden: User \"system:node:ip-10-0-133-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-37.ec2.internal' and this object" podUID="ba8bdbb8-d890-4f54-aca1-13d401b00f17" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kxvbr" Jul 08 23:18:34.046771 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:34.046737 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:34.151960 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:34.151930 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:34.329823 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:18:34.329733 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-kxvbr\" is forbidden: User \"system:node:ip-10-0-133-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-37.ec2.internal' and this object" podUID="ba8bdbb8-d890-4f54-aca1-13d401b00f17" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kxvbr" Jul 08 23:18:36.738129 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:36.738087 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z48d9" event={"ID":"8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6","Type":"ContainerStarted","Data":"802b9c6b7608fffea3768a1f1de4943c1063964ee844f9426ff16dc9971adc91"} Jul 08 23:18:36.738582 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:36.738227 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z48d9" Jul 08 23:18:36.759131 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:36.759056 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z48d9" podStartSLOduration=1.8464662710000002 podStartE2EDuration="6.759039651s" totalImagesPullingTime="4.91257338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:18:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:18:36.756289042 +0000 UTC m=+672.915572551" watchObservedRunningTime="2026-07-08 23:18:36.759039651 +0000 UTC m=+672.918323159" Jul 08 23:18:37.033100 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:37.033066 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:37.136452 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:37.136413 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:40.843765 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:40.843725 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:40.912696 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:40.912661 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:47.172787 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:47.172754 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:47.243401 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:47.243369 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:47.745137 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:47.745107 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z48d9" Jul 08 23:18:53.725321 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:53.725288 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:53.826229 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:53.826193 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:56.300923 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:56.300878 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z48d9"] Jul 08 23:18:56.301344 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:56.301095 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z48d9" podUID="8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6" containerName="manager" containerID="cri-o://802b9c6b7608fffea3768a1f1de4943c1063964ee844f9426ff16dc9971adc91" gracePeriod=10 Jul 08 23:18:56.551261 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:56.551189 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z48d9" Jul 08 23:18:56.593338 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:56.593305 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6-extensions-socket-volume\") pod \"8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6\" (UID: \"8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6\") " Jul 08 23:18:56.593490 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:56.593348 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fq44h\" (UniqueName: \"kubernetes.io/projected/8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6-kube-api-access-fq44h\") pod \"8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6\" (UID: \"8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6\") " Jul 08 23:18:56.593786 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:56.593765 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6" (UID: "8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 23:18:56.595589 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:56.595560 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6-kube-api-access-fq44h" (OuterVolumeSpecName: "kube-api-access-fq44h") pod "8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6" (UID: "8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6"). InnerVolumeSpecName "kube-api-access-fq44h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 23:18:56.694778 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:56.694749 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6-extensions-socket-volume\") on node \"ip-10-0-133-37.ec2.internal\" DevicePath \"\"" Jul 08 23:18:56.694778 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:56.694772 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fq44h\" (UniqueName: \"kubernetes.io/projected/8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6-kube-api-access-fq44h\") on node \"ip-10-0-133-37.ec2.internal\" DevicePath \"\"" Jul 08 23:18:56.768430 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:56.768395 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:56.830822 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:56.830731 2572 generic.go:356] "Generic (PLEG): container finished" podID="8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6" containerID="802b9c6b7608fffea3768a1f1de4943c1063964ee844f9426ff16dc9971adc91" exitCode=0 Jul 08 23:18:56.830822 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:56.830791 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z48d9" event={"ID":"8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6","Type":"ContainerDied","Data":"802b9c6b7608fffea3768a1f1de4943c1063964ee844f9426ff16dc9971adc91"} Jul 08 23:18:56.831085 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:56.830868 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z48d9" event={"ID":"8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6","Type":"ContainerDied","Data":"e7a3efa7031541d5408a365a8bb60bb5619e8f4425dff4bb4cf8919ad748cb74"} Jul 08 23:18:56.831085 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:56.830795 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z48d9" Jul 08 23:18:56.831085 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:56.830923 2572 scope.go:117] "RemoveContainer" containerID="802b9c6b7608fffea3768a1f1de4943c1063964ee844f9426ff16dc9971adc91" Jul 08 23:18:56.840586 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:56.840570 2572 scope.go:117] "RemoveContainer" containerID="802b9c6b7608fffea3768a1f1de4943c1063964ee844f9426ff16dc9971adc91" Jul 08 23:18:56.840825 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:18:56.840807 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"802b9c6b7608fffea3768a1f1de4943c1063964ee844f9426ff16dc9971adc91\": container with ID starting with 802b9c6b7608fffea3768a1f1de4943c1063964ee844f9426ff16dc9971adc91 not found: ID does not exist" containerID="802b9c6b7608fffea3768a1f1de4943c1063964ee844f9426ff16dc9971adc91" Jul 08 23:18:56.840867 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:56.840832 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"802b9c6b7608fffea3768a1f1de4943c1063964ee844f9426ff16dc9971adc91"} err="failed to get container status \"802b9c6b7608fffea3768a1f1de4943c1063964ee844f9426ff16dc9971adc91\": rpc error: code = NotFound desc = could not find container \"802b9c6b7608fffea3768a1f1de4943c1063964ee844f9426ff16dc9971adc91\": container with ID starting with 802b9c6b7608fffea3768a1f1de4943c1063964ee844f9426ff16dc9971adc91 not found: ID does not exist" Jul 08 23:18:56.867363 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:56.867342 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z48d9"] Jul 08 23:18:56.876836 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:56.876808 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:18:56.878562 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:56.878545 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z48d9"] Jul 08 23:18:58.330306 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:18:58.330273 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6" path="/var/lib/kubelet/pods/8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6/volumes" Jul 08 23:19:00.737016 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:00.736986 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:19:00.837846 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:00.837815 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:19:03.978510 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:03.978473 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:19:04.077714 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:04.077679 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:19:08.530527 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:08.530494 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:19:08.631043 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:08.631015 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:19:12.725521 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:12.725490 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:19:12.836477 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:12.836447 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:19:14.148268 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:14.148237 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:19:14.247026 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:14.246990 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:19:15.464928 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:15.464877 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:19:15.465391 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:15.465371 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7glm8"] Jul 08 23:19:15.465694 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:15.465682 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6" containerName="manager" Jul 08 23:19:15.465734 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:15.465696 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6" containerName="manager" Jul 08 23:19:15.465771 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:15.465759 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d91c248-9e3f-43e2-b4bd-9c9cc5ac1ac6" containerName="manager" Jul 08 23:19:15.470003 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:15.469987 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7glm8" Jul 08 23:19:15.472362 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:15.472342 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 23:19:15.472362 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:15.472359 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 08 23:19:15.473231 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:15.473212 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 23:19:15.473337 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:15.473230 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2p9z9\"" Jul 08 23:19:15.475715 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:15.475696 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7glm8"] Jul 08 23:19:15.564285 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:15.564258 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/195b2b7e-cd1d-4e94-9062-e712c71b296a-config-file\") pod \"limitador-limitador-64c94fd64f-7glm8\" (UID: \"195b2b7e-cd1d-4e94-9062-e712c71b296a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7glm8" Jul 08 23:19:15.564441 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:15.564291 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwzsq\" (UniqueName: \"kubernetes.io/projected/195b2b7e-cd1d-4e94-9062-e712c71b296a-kube-api-access-hwzsq\") pod \"limitador-limitador-64c94fd64f-7glm8\" (UID: \"195b2b7e-cd1d-4e94-9062-e712c71b296a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7glm8" Jul 08 23:19:15.564591 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:15.564570 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7glm8"] Jul 08 23:19:15.580612 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:15.580563 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:19:15.664877 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:15.664851 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/195b2b7e-cd1d-4e94-9062-e712c71b296a-config-file\") pod \"limitador-limitador-64c94fd64f-7glm8\" (UID: \"195b2b7e-cd1d-4e94-9062-e712c71b296a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7glm8" Jul 08 23:19:15.665015 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:15.664883 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwzsq\" (UniqueName: \"kubernetes.io/projected/195b2b7e-cd1d-4e94-9062-e712c71b296a-kube-api-access-hwzsq\") pod \"limitador-limitador-64c94fd64f-7glm8\" (UID: \"195b2b7e-cd1d-4e94-9062-e712c71b296a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7glm8" Jul 08 23:19:15.665536 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:15.665518 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/195b2b7e-cd1d-4e94-9062-e712c71b296a-config-file\") pod \"limitador-limitador-64c94fd64f-7glm8\" (UID: \"195b2b7e-cd1d-4e94-9062-e712c71b296a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7glm8" Jul 08 23:19:15.674664 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:15.674642 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwzsq\" (UniqueName: \"kubernetes.io/projected/195b2b7e-cd1d-4e94-9062-e712c71b296a-kube-api-access-hwzsq\") pod \"limitador-limitador-64c94fd64f-7glm8\" (UID: \"195b2b7e-cd1d-4e94-9062-e712c71b296a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7glm8" Jul 08 23:19:15.682608 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:15.682583 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:19:15.782056 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:15.782027 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7glm8" Jul 08 23:19:15.918783 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:15.918751 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7glm8"] Jul 08 23:19:15.921754 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:19:15.921729 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod195b2b7e_cd1d_4e94_9062_e712c71b296a.slice/crio-d40c2cf9082f189d5f85c2c01528a9963bc4b6d5c6127a3370329c59fb657eeb WatchSource:0}: Error finding container d40c2cf9082f189d5f85c2c01528a9963bc4b6d5c6127a3370329c59fb657eeb: Status 404 returned error can't find the container with id d40c2cf9082f189d5f85c2c01528a9963bc4b6d5c6127a3370329c59fb657eeb Jul 08 23:19:16.311592 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:16.311561 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:19:16.366806 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:16.366776 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:19:16.924089 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:16.924050 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7glm8" event={"ID":"195b2b7e-cd1d-4e94-9062-e712c71b296a","Type":"ContainerStarted","Data":"d40c2cf9082f189d5f85c2c01528a9963bc4b6d5c6127a3370329c59fb657eeb"} Jul 08 23:19:17.143033 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:17.142987 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:19:17.246072 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:17.245989 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:19:18.935037 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:18.934944 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7glm8" event={"ID":"195b2b7e-cd1d-4e94-9062-e712c71b296a","Type":"ContainerStarted","Data":"2c661abf82efa241112cd8da7a166021c053798a5beb6b91c49aa0d969e5a3bd"} Jul 08 23:19:18.935419 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:18.935070 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-7glm8" Jul 08 23:19:18.950677 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:18.950631 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-7glm8" podStartSLOduration=1.310349488 podStartE2EDuration="3.950618094s" totalImagesPullingTime="2.640268606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:19:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:19:18.949138401 +0000 UTC m=+715.108421935" watchObservedRunningTime="2026-07-08 23:19:18.950618094 +0000 UTC m=+715.109901603" Jul 08 23:19:29.940441 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:29.940407 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-7glm8" Jul 08 23:19:30.497903 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:30.497872 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7glm8"] Jul 08 23:19:30.498099 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:30.498054 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-7glm8" podUID="195b2b7e-cd1d-4e94-9062-e712c71b296a" containerName="limitador" containerID="cri-o://2c661abf82efa241112cd8da7a166021c053798a5beb6b91c49aa0d969e5a3bd" gracePeriod=30 Jul 08 23:19:30.989406 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:30.989367 2572 generic.go:356] "Generic (PLEG): container finished" podID="195b2b7e-cd1d-4e94-9062-e712c71b296a" containerID="2c661abf82efa241112cd8da7a166021c053798a5beb6b91c49aa0d969e5a3bd" exitCode=0 Jul 08 23:19:30.989846 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:30.989417 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7glm8" event={"ID":"195b2b7e-cd1d-4e94-9062-e712c71b296a","Type":"ContainerDied","Data":"2c661abf82efa241112cd8da7a166021c053798a5beb6b91c49aa0d969e5a3bd"} Jul 08 23:19:31.036765 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:31.036743 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7glm8" Jul 08 23:19:31.203217 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:31.203121 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/195b2b7e-cd1d-4e94-9062-e712c71b296a-config-file\") pod \"195b2b7e-cd1d-4e94-9062-e712c71b296a\" (UID: \"195b2b7e-cd1d-4e94-9062-e712c71b296a\") " Jul 08 23:19:31.203217 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:31.203222 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwzsq\" (UniqueName: \"kubernetes.io/projected/195b2b7e-cd1d-4e94-9062-e712c71b296a-kube-api-access-hwzsq\") pod \"195b2b7e-cd1d-4e94-9062-e712c71b296a\" (UID: \"195b2b7e-cd1d-4e94-9062-e712c71b296a\") " Jul 08 23:19:31.203496 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:31.203466 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/195b2b7e-cd1d-4e94-9062-e712c71b296a-config-file" (OuterVolumeSpecName: "config-file") pod "195b2b7e-cd1d-4e94-9062-e712c71b296a" (UID: "195b2b7e-cd1d-4e94-9062-e712c71b296a"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 23:19:31.205245 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:31.205220 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/195b2b7e-cd1d-4e94-9062-e712c71b296a-kube-api-access-hwzsq" (OuterVolumeSpecName: "kube-api-access-hwzsq") pod "195b2b7e-cd1d-4e94-9062-e712c71b296a" (UID: "195b2b7e-cd1d-4e94-9062-e712c71b296a"). InnerVolumeSpecName "kube-api-access-hwzsq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 23:19:31.304743 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:31.304707 2572 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/195b2b7e-cd1d-4e94-9062-e712c71b296a-config-file\") on node \"ip-10-0-133-37.ec2.internal\" DevicePath \"\"" Jul 08 23:19:31.304743 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:31.304737 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwzsq\" (UniqueName: \"kubernetes.io/projected/195b2b7e-cd1d-4e94-9062-e712c71b296a-kube-api-access-hwzsq\") on node \"ip-10-0-133-37.ec2.internal\" DevicePath \"\"" Jul 08 23:19:31.995530 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:31.995500 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7glm8" Jul 08 23:19:31.995988 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:31.995534 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7glm8" event={"ID":"195b2b7e-cd1d-4e94-9062-e712c71b296a","Type":"ContainerDied","Data":"d40c2cf9082f189d5f85c2c01528a9963bc4b6d5c6127a3370329c59fb657eeb"} Jul 08 23:19:31.995988 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:31.995595 2572 scope.go:117] "RemoveContainer" containerID="2c661abf82efa241112cd8da7a166021c053798a5beb6b91c49aa0d969e5a3bd" Jul 08 23:19:32.016059 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:32.016031 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7glm8"] Jul 08 23:19:32.019767 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:32.019743 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7glm8"] Jul 08 23:19:32.329764 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:32.329724 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="195b2b7e-cd1d-4e94-9062-e712c71b296a" path="/var/lib/kubelet/pods/195b2b7e-cd1d-4e94-9062-e712c71b296a/volumes" Jul 08 23:19:35.661744 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:35.661708 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:19:35.760433 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:35.760404 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:19:36.086064 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:36.086034 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jqcrt"] Jul 08 23:19:36.086542 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:36.086527 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="195b2b7e-cd1d-4e94-9062-e712c71b296a" containerName="limitador" Jul 08 23:19:36.086589 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:36.086545 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="195b2b7e-cd1d-4e94-9062-e712c71b296a" containerName="limitador" Jul 08 23:19:36.086635 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:36.086624 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="195b2b7e-cd1d-4e94-9062-e712c71b296a" containerName="limitador" Jul 08 23:19:36.091292 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:36.091260 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jqcrt" Jul 08 23:19:36.094265 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:36.094245 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 08 23:19:36.094380 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:36.094271 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 08 23:19:36.095148 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:36.095130 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-w7p9k\"" Jul 08 23:19:36.095257 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:36.095130 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 08 23:19:36.099472 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:36.099444 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jqcrt"] Jul 08 23:19:36.118842 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:36.118809 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:19:36.248453 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:36.248413 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4844d03d-1697-4f50-a4ba-83388e15c809-data\") pod \"postgres-69fb4594cf-jqcrt\" (UID: \"4844d03d-1697-4f50-a4ba-83388e15c809\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jqcrt" Jul 08 23:19:36.248668 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:36.248513 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjwrl\" (UniqueName: \"kubernetes.io/projected/4844d03d-1697-4f50-a4ba-83388e15c809-kube-api-access-pjwrl\") pod \"postgres-69fb4594cf-jqcrt\" (UID: \"4844d03d-1697-4f50-a4ba-83388e15c809\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jqcrt" Jul 08 23:19:36.349394 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:36.349313 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjwrl\" (UniqueName: \"kubernetes.io/projected/4844d03d-1697-4f50-a4ba-83388e15c809-kube-api-access-pjwrl\") pod \"postgres-69fb4594cf-jqcrt\" (UID: \"4844d03d-1697-4f50-a4ba-83388e15c809\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jqcrt" Jul 08 23:19:36.349394 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:36.349371 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4844d03d-1697-4f50-a4ba-83388e15c809-data\") pod \"postgres-69fb4594cf-jqcrt\" (UID: \"4844d03d-1697-4f50-a4ba-83388e15c809\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jqcrt" Jul 08 23:19:36.349755 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:36.349738 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4844d03d-1697-4f50-a4ba-83388e15c809-data\") pod \"postgres-69fb4594cf-jqcrt\" (UID: \"4844d03d-1697-4f50-a4ba-83388e15c809\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jqcrt" Jul 08 23:19:36.358134 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:36.358114 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjwrl\" (UniqueName: \"kubernetes.io/projected/4844d03d-1697-4f50-a4ba-83388e15c809-kube-api-access-pjwrl\") pod \"postgres-69fb4594cf-jqcrt\" (UID: \"4844d03d-1697-4f50-a4ba-83388e15c809\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jqcrt" Jul 08 23:19:36.405285 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:36.405252 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jqcrt" Jul 08 23:19:36.529565 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:36.529475 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jqcrt"] Jul 08 23:19:36.532228 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:19:36.532200 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4844d03d_1697_4f50_a4ba_83388e15c809.slice/crio-3b2b6d433b6d1bb4c5aba00e6489dbbf881f17ed4174003adbee6bbc357d458e WatchSource:0}: Error finding container 3b2b6d433b6d1bb4c5aba00e6489dbbf881f17ed4174003adbee6bbc357d458e: Status 404 returned error can't find the container with id 3b2b6d433b6d1bb4c5aba00e6489dbbf881f17ed4174003adbee6bbc357d458e Jul 08 23:19:37.019557 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:37.019523 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jqcrt" event={"ID":"4844d03d-1697-4f50-a4ba-83388e15c809","Type":"ContainerStarted","Data":"3b2b6d433b6d1bb4c5aba00e6489dbbf881f17ed4174003adbee6bbc357d458e"} Jul 08 23:19:43.051878 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:43.051786 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jqcrt" event={"ID":"4844d03d-1697-4f50-a4ba-83388e15c809","Type":"ContainerStarted","Data":"8fbacf8db56cace9e0d66f702cb82cbc39478c3aac6cde79674bdf3809931f77"} Jul 08 23:19:43.052322 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:43.051953 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jqcrt" Jul 08 23:19:43.067654 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:43.067607 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jqcrt" podStartSLOduration=0.836294775 podStartE2EDuration="7.067592677s" totalImagesPullingTime="6.231297902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:19:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:19:43.067174031 +0000 UTC m=+739.226457541" watchObservedRunningTime="2026-07-08 23:19:43.067592677 +0000 UTC m=+739.226876185" Jul 08 23:19:49.086439 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:49.086412 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jqcrt" Jul 08 23:19:49.399541 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:49.399457 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:19:49.530422 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:49.530386 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:19:55.699929 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:55.699878 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:19:55.792918 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:55.792863 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:19:55.868036 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:55.868006 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:19:55.871875 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:55.871854 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7464f4d4d-mzcl4"] Jul 08 23:19:55.876685 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:55.876669 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7464f4d4d-mzcl4" Jul 08 23:19:55.879043 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:55.879012 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 08 23:19:55.879043 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:55.879040 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xs4mv\"" Jul 08 23:19:55.879198 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:55.879105 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 08 23:19:55.883558 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:55.883537 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7464f4d4d-mzcl4"] Jul 08 23:19:55.914887 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:55.914857 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3224bf78-81d7-48eb-a5a3-080d84898a92-webhook-cert\") pod \"maas-controller-7464f4d4d-mzcl4\" (UID: \"3224bf78-81d7-48eb-a5a3-080d84898a92\") " pod="opendatahub/maas-controller-7464f4d4d-mzcl4" Jul 08 23:19:55.915033 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:55.914986 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g97r\" (UniqueName: \"kubernetes.io/projected/3224bf78-81d7-48eb-a5a3-080d84898a92-kube-api-access-5g97r\") pod \"maas-controller-7464f4d4d-mzcl4\" (UID: \"3224bf78-81d7-48eb-a5a3-080d84898a92\") " pod="opendatahub/maas-controller-7464f4d4d-mzcl4" Jul 08 23:19:55.992348 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:55.992266 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:19:56.016269 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:56.016239 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g97r\" (UniqueName: \"kubernetes.io/projected/3224bf78-81d7-48eb-a5a3-080d84898a92-kube-api-access-5g97r\") pod \"maas-controller-7464f4d4d-mzcl4\" (UID: \"3224bf78-81d7-48eb-a5a3-080d84898a92\") " pod="opendatahub/maas-controller-7464f4d4d-mzcl4" Jul 08 23:19:56.016530 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:56.016512 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3224bf78-81d7-48eb-a5a3-080d84898a92-webhook-cert\") pod \"maas-controller-7464f4d4d-mzcl4\" (UID: \"3224bf78-81d7-48eb-a5a3-080d84898a92\") " pod="opendatahub/maas-controller-7464f4d4d-mzcl4" Jul 08 23:19:56.022596 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:56.022565 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3224bf78-81d7-48eb-a5a3-080d84898a92-webhook-cert\") pod \"maas-controller-7464f4d4d-mzcl4\" (UID: \"3224bf78-81d7-48eb-a5a3-080d84898a92\") " pod="opendatahub/maas-controller-7464f4d4d-mzcl4" Jul 08 23:19:56.025707 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:56.025683 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g97r\" (UniqueName: \"kubernetes.io/projected/3224bf78-81d7-48eb-a5a3-080d84898a92-kube-api-access-5g97r\") pod \"maas-controller-7464f4d4d-mzcl4\" (UID: \"3224bf78-81d7-48eb-a5a3-080d84898a92\") " pod="opendatahub/maas-controller-7464f4d4d-mzcl4" Jul 08 23:19:56.189399 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:56.189367 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7464f4d4d-mzcl4" Jul 08 23:19:56.316767 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:56.316742 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7464f4d4d-mzcl4"] Jul 08 23:19:56.318880 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:19:56.318854 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3224bf78_81d7_48eb_a5a3_080d84898a92.slice/crio-509440407ececc8512bc730962378098253453df975410b5aa504d2964ee11d9 WatchSource:0}: Error finding container 509440407ececc8512bc730962378098253453df975410b5aa504d2964ee11d9: Status 404 returned error can't find the container with id 509440407ececc8512bc730962378098253453df975410b5aa504d2964ee11d9 Jul 08 23:19:57.116318 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:57.116206 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7464f4d4d-mzcl4" event={"ID":"3224bf78-81d7-48eb-a5a3-080d84898a92","Type":"ContainerStarted","Data":"509440407ececc8512bc730962378098253453df975410b5aa504d2964ee11d9"} Jul 08 23:19:58.527690 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:58.527660 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:19:58.622888 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:58.622811 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:19:59.128224 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:59.128190 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7464f4d4d-mzcl4" event={"ID":"3224bf78-81d7-48eb-a5a3-080d84898a92","Type":"ContainerStarted","Data":"26c6763b49199cac3c8889eb9d38392c6a6b9c264f33cd739bb157e81e1afdf9"} Jul 08 23:19:59.128393 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:59.128330 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7464f4d4d-mzcl4" Jul 08 23:19:59.146131 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:19:59.146087 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7464f4d4d-mzcl4" podStartSLOduration=2.126550316 podStartE2EDuration="4.14606885s" totalImagesPullingTime="2.019518534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:19:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:19:59.144222514 +0000 UTC m=+755.303506022" watchObservedRunningTime="2026-07-08 23:19:59.14606885 +0000 UTC m=+755.305352414" Jul 08 23:20:10.138843 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:10.138815 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7464f4d4d-mzcl4" Jul 08 23:20:29.931220 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:29.931162 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:20:30.435063 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:30.435027 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:20:30.737558 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:30.737466 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:20:30.873320 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:30.873255 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:20:30.973084 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:30.973051 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:20:31.013950 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:31.013916 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-k7gls"] Jul 08 23:20:31.018405 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:31.018388 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-k7gls" Jul 08 23:20:31.021030 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:31.021008 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-fxj27\"" Jul 08 23:20:31.021190 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:31.021038 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 08 23:20:31.024285 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:31.024243 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09c667b3-8fed-4dc6-9cc7-9269be6e253f-plugins-config-volume\") pod \"payload-processing-58f86c7798-k7gls\" (UID: \"09c667b3-8fed-4dc6-9cc7-9269be6e253f\") " pod="openshift-ingress/payload-processing-58f86c7798-k7gls" Jul 08 23:20:31.024414 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:31.024390 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cmt8\" (UniqueName: \"kubernetes.io/projected/09c667b3-8fed-4dc6-9cc7-9269be6e253f-kube-api-access-4cmt8\") pod \"payload-processing-58f86c7798-k7gls\" (UID: \"09c667b3-8fed-4dc6-9cc7-9269be6e253f\") " pod="openshift-ingress/payload-processing-58f86c7798-k7gls" Jul 08 23:20:31.026384 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:31.026356 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-k7gls"] Jul 08 23:20:31.125050 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:31.125016 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09c667b3-8fed-4dc6-9cc7-9269be6e253f-plugins-config-volume\") pod \"payload-processing-58f86c7798-k7gls\" (UID: \"09c667b3-8fed-4dc6-9cc7-9269be6e253f\") " pod="openshift-ingress/payload-processing-58f86c7798-k7gls" Jul 08 23:20:31.125218 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:31.125193 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cmt8\" (UniqueName: \"kubernetes.io/projected/09c667b3-8fed-4dc6-9cc7-9269be6e253f-kube-api-access-4cmt8\") pod \"payload-processing-58f86c7798-k7gls\" (UID: \"09c667b3-8fed-4dc6-9cc7-9269be6e253f\") " pod="openshift-ingress/payload-processing-58f86c7798-k7gls" Jul 08 23:20:31.125765 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:31.125747 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09c667b3-8fed-4dc6-9cc7-9269be6e253f-plugins-config-volume\") pod \"payload-processing-58f86c7798-k7gls\" (UID: \"09c667b3-8fed-4dc6-9cc7-9269be6e253f\") " pod="openshift-ingress/payload-processing-58f86c7798-k7gls" Jul 08 23:20:31.132550 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:31.132531 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cmt8\" (UniqueName: \"kubernetes.io/projected/09c667b3-8fed-4dc6-9cc7-9269be6e253f-kube-api-access-4cmt8\") pod \"payload-processing-58f86c7798-k7gls\" (UID: \"09c667b3-8fed-4dc6-9cc7-9269be6e253f\") " pod="openshift-ingress/payload-processing-58f86c7798-k7gls" Jul 08 23:20:31.329493 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:31.329409 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-k7gls" Jul 08 23:20:31.460840 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:31.460810 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-k7gls"] Jul 08 23:20:31.463840 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:20:31.463815 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09c667b3_8fed_4dc6_9cc7_9269be6e253f.slice/crio-4cc7bf457e2a6be89fe211ea189590b5cff1a392cf2706ee142320691a9ffa60 WatchSource:0}: Error finding container 4cc7bf457e2a6be89fe211ea189590b5cff1a392cf2706ee142320691a9ffa60: Status 404 returned error can't find the container with id 4cc7bf457e2a6be89fe211ea189590b5cff1a392cf2706ee142320691a9ffa60 Jul 08 23:20:32.280612 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:32.280566 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-k7gls" event={"ID":"09c667b3-8fed-4dc6-9cc7-9269be6e253f","Type":"ContainerStarted","Data":"4cc7bf457e2a6be89fe211ea189590b5cff1a392cf2706ee142320691a9ffa60"} Jul 08 23:20:33.292497 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:33.292465 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-k7gls" event={"ID":"09c667b3-8fed-4dc6-9cc7-9269be6e253f","Type":"ContainerStarted","Data":"d7f07114bc05a201a20f01df00c5a5843a70596ceed9686609256f66e0310dcb"} Jul 08 23:20:33.292870 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:33.292616 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-k7gls" Jul 08 23:20:33.307860 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:33.307811 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-k7gls" podStartSLOduration=1.919903756 podStartE2EDuration="3.307793133s" totalImagesPullingTime="1.387889377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:20:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:20:33.307445944 +0000 UTC m=+789.466729454" watchObservedRunningTime="2026-07-08 23:20:33.307793133 +0000 UTC m=+789.467076643" Jul 08 23:20:33.655802 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:33.655723 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:20:40.577355 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:40.577305 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:20:40.709808 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:40.709775 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:20:44.299586 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:44.299547 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-k7gls" Jul 08 23:20:45.711387 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:45.711355 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79"] Jul 08 23:20:45.714794 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:45.714774 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79" Jul 08 23:20:45.717284 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:45.717263 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 08 23:20:45.718325 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:45.718307 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 08 23:20:45.718391 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:45.718332 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 08 23:20:45.718776 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:45.718757 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nzknt\"" Jul 08 23:20:45.724529 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:45.724507 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79"] Jul 08 23:20:45.735479 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:45.735446 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:20:45.748528 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:45.748508 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4vbp\" (UniqueName: \"kubernetes.io/projected/e065b8e4-2f24-4662-b0b4-a66dfc72fcec-kube-api-access-d4vbp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79\" (UID: \"e065b8e4-2f24-4662-b0b4-a66dfc72fcec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79" Jul 08 23:20:45.748625 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:45.748555 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e065b8e4-2f24-4662-b0b4-a66dfc72fcec-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79\" (UID: \"e065b8e4-2f24-4662-b0b4-a66dfc72fcec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79" Jul 08 23:20:45.748625 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:45.748575 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e065b8e4-2f24-4662-b0b4-a66dfc72fcec-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79\" (UID: \"e065b8e4-2f24-4662-b0b4-a66dfc72fcec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79" Jul 08 23:20:45.748700 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:45.748652 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e065b8e4-2f24-4662-b0b4-a66dfc72fcec-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79\" (UID: \"e065b8e4-2f24-4662-b0b4-a66dfc72fcec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79" Jul 08 23:20:45.748735 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:45.748716 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e065b8e4-2f24-4662-b0b4-a66dfc72fcec-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79\" (UID: \"e065b8e4-2f24-4662-b0b4-a66dfc72fcec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79" Jul 08 23:20:45.748771 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:45.748737 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e065b8e4-2f24-4662-b0b4-a66dfc72fcec-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79\" (UID: \"e065b8e4-2f24-4662-b0b4-a66dfc72fcec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79" Jul 08 23:20:45.850065 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:45.850037 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e065b8e4-2f24-4662-b0b4-a66dfc72fcec-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79\" (UID: \"e065b8e4-2f24-4662-b0b4-a66dfc72fcec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79" Jul 08 23:20:45.850065 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:45.850066 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e065b8e4-2f24-4662-b0b4-a66dfc72fcec-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79\" (UID: \"e065b8e4-2f24-4662-b0b4-a66dfc72fcec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79" Jul 08 23:20:45.850295 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:45.850095 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e065b8e4-2f24-4662-b0b4-a66dfc72fcec-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79\" (UID: \"e065b8e4-2f24-4662-b0b4-a66dfc72fcec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79" Jul 08 23:20:45.850295 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:45.850122 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e065b8e4-2f24-4662-b0b4-a66dfc72fcec-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79\" (UID: \"e065b8e4-2f24-4662-b0b4-a66dfc72fcec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79" Jul 08 23:20:45.850295 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:45.850136 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e065b8e4-2f24-4662-b0b4-a66dfc72fcec-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79\" (UID: \"e065b8e4-2f24-4662-b0b4-a66dfc72fcec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79" Jul 08 23:20:45.850295 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:45.850178 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4vbp\" (UniqueName: \"kubernetes.io/projected/e065b8e4-2f24-4662-b0b4-a66dfc72fcec-kube-api-access-d4vbp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79\" (UID: \"e065b8e4-2f24-4662-b0b4-a66dfc72fcec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79" Jul 08 23:20:45.850503 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:45.850472 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e065b8e4-2f24-4662-b0b4-a66dfc72fcec-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79\" (UID: \"e065b8e4-2f24-4662-b0b4-a66dfc72fcec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79" Jul 08 23:20:45.850560 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:45.850497 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e065b8e4-2f24-4662-b0b4-a66dfc72fcec-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79\" (UID: \"e065b8e4-2f24-4662-b0b4-a66dfc72fcec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79" Jul 08 23:20:45.850614 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:45.850598 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e065b8e4-2f24-4662-b0b4-a66dfc72fcec-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79\" (UID: \"e065b8e4-2f24-4662-b0b4-a66dfc72fcec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79" Jul 08 23:20:45.852328 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:45.852303 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e065b8e4-2f24-4662-b0b4-a66dfc72fcec-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79\" (UID: \"e065b8e4-2f24-4662-b0b4-a66dfc72fcec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79" Jul 08 23:20:45.852646 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:45.852631 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e065b8e4-2f24-4662-b0b4-a66dfc72fcec-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79\" (UID: \"e065b8e4-2f24-4662-b0b4-a66dfc72fcec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79" Jul 08 23:20:45.861168 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:45.861145 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4vbp\" (UniqueName: \"kubernetes.io/projected/e065b8e4-2f24-4662-b0b4-a66dfc72fcec-kube-api-access-d4vbp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79\" (UID: \"e065b8e4-2f24-4662-b0b4-a66dfc72fcec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79" Jul 08 23:20:46.026318 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:46.026281 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79" Jul 08 23:20:46.158909 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:46.158868 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79"] Jul 08 23:20:46.160684 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:20:46.160657 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode065b8e4_2f24_4662_b0b4_a66dfc72fcec.slice/crio-0a052aeafd8c568a019dcfda2e2c5cc61294693f0722f3431465f649d02fc007 WatchSource:0}: Error finding container 0a052aeafd8c568a019dcfda2e2c5cc61294693f0722f3431465f649d02fc007: Status 404 returned error can't find the container with id 0a052aeafd8c568a019dcfda2e2c5cc61294693f0722f3431465f649d02fc007 Jul 08 23:20:46.353599 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:46.353519 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79" event={"ID":"e065b8e4-2f24-4662-b0b4-a66dfc72fcec","Type":"ContainerStarted","Data":"0a052aeafd8c568a019dcfda2e2c5cc61294693f0722f3431465f649d02fc007"} Jul 08 23:20:48.362636 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:48.362599 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79" event={"ID":"e065b8e4-2f24-4662-b0b4-a66dfc72fcec","Type":"ContainerStarted","Data":"dc749875d7a507eb8aaf6ad8552a2ebf8c5c980f53c19c09729660743e0e070c"} Jul 08 23:20:48.380870 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:48.380799 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79" podStartSLOduration=2.200159972 podStartE2EDuration="3.380783762s" totalImagesPullingTime="1.18062379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:20:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:20:48.378732221 +0000 UTC m=+804.538015747" watchObservedRunningTime="2026-07-08 23:20:48.380783762 +0000 UTC m=+804.540067291" Jul 08 23:20:56.026520 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:56.026481 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79" Jul 08 23:20:56.027056 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:56.026548 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79" Jul 08 23:20:56.039921 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:56.039877 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79" Jul 08 23:20:56.413791 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:20:56.413709 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79" Jul 08 23:21:03.692790 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:03.692757 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz"] Jul 08 23:21:03.697518 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:03.697456 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz" Jul 08 23:21:03.701006 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:03.700974 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 08 23:21:03.707209 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:03.707182 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz"] Jul 08 23:21:03.724359 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:03.724302 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:21:03.816694 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:03.816658 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85672aea-1993-4ec8-811b-630be81a0231-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9dwxz\" (UID: \"85672aea-1993-4ec8-811b-630be81a0231\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz" Jul 08 23:21:03.816694 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:03.816694 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prkkm\" (UniqueName: \"kubernetes.io/projected/85672aea-1993-4ec8-811b-630be81a0231-kube-api-access-prkkm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9dwxz\" (UID: \"85672aea-1993-4ec8-811b-630be81a0231\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz" Jul 08 23:21:03.816991 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:03.816720 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85672aea-1993-4ec8-811b-630be81a0231-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9dwxz\" (UID: \"85672aea-1993-4ec8-811b-630be81a0231\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz" Jul 08 23:21:03.816991 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:03.816816 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85672aea-1993-4ec8-811b-630be81a0231-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9dwxz\" (UID: \"85672aea-1993-4ec8-811b-630be81a0231\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz" Jul 08 23:21:03.816991 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:03.816861 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85672aea-1993-4ec8-811b-630be81a0231-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9dwxz\" (UID: \"85672aea-1993-4ec8-811b-630be81a0231\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz" Jul 08 23:21:03.816991 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:03.816963 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85672aea-1993-4ec8-811b-630be81a0231-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9dwxz\" (UID: \"85672aea-1993-4ec8-811b-630be81a0231\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz" Jul 08 23:21:03.917685 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:03.917652 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85672aea-1993-4ec8-811b-630be81a0231-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9dwxz\" (UID: \"85672aea-1993-4ec8-811b-630be81a0231\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz" Jul 08 23:21:03.917850 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:03.917698 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85672aea-1993-4ec8-811b-630be81a0231-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9dwxz\" (UID: \"85672aea-1993-4ec8-811b-630be81a0231\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz" Jul 08 23:21:03.917850 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:03.917723 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85672aea-1993-4ec8-811b-630be81a0231-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9dwxz\" (UID: \"85672aea-1993-4ec8-811b-630be81a0231\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz" Jul 08 23:21:03.917850 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:03.917770 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85672aea-1993-4ec8-811b-630be81a0231-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9dwxz\" (UID: \"85672aea-1993-4ec8-811b-630be81a0231\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz" Jul 08 23:21:03.917850 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:03.917824 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85672aea-1993-4ec8-811b-630be81a0231-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9dwxz\" (UID: \"85672aea-1993-4ec8-811b-630be81a0231\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz" Jul 08 23:21:03.918081 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:03.917851 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prkkm\" (UniqueName: \"kubernetes.io/projected/85672aea-1993-4ec8-811b-630be81a0231-kube-api-access-prkkm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9dwxz\" (UID: \"85672aea-1993-4ec8-811b-630be81a0231\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz" Jul 08 23:21:03.918158 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:03.918134 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85672aea-1993-4ec8-811b-630be81a0231-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9dwxz\" (UID: \"85672aea-1993-4ec8-811b-630be81a0231\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz" Jul 08 23:21:03.918217 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:03.918149 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85672aea-1993-4ec8-811b-630be81a0231-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9dwxz\" (UID: \"85672aea-1993-4ec8-811b-630be81a0231\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz" Jul 08 23:21:03.918286 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:03.918263 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85672aea-1993-4ec8-811b-630be81a0231-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9dwxz\" (UID: \"85672aea-1993-4ec8-811b-630be81a0231\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz" Jul 08 23:21:03.920020 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:03.920000 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85672aea-1993-4ec8-811b-630be81a0231-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9dwxz\" (UID: \"85672aea-1993-4ec8-811b-630be81a0231\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz" Jul 08 23:21:03.920342 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:03.920322 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85672aea-1993-4ec8-811b-630be81a0231-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9dwxz\" (UID: \"85672aea-1993-4ec8-811b-630be81a0231\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz" Jul 08 23:21:03.925570 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:03.925547 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prkkm\" (UniqueName: \"kubernetes.io/projected/85672aea-1993-4ec8-811b-630be81a0231-kube-api-access-prkkm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9dwxz\" (UID: \"85672aea-1993-4ec8-811b-630be81a0231\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz" Jul 08 23:21:04.009208 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:04.009187 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz" Jul 08 23:21:04.142199 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:04.142176 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz"] Jul 08 23:21:04.143679 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:21:04.143656 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85672aea_1993_4ec8_811b_630be81a0231.slice/crio-644a3794a4b5adb909a5442b195c6ae141bba238a08534bd8cc63bd803d7fa9d WatchSource:0}: Error finding container 644a3794a4b5adb909a5442b195c6ae141bba238a08534bd8cc63bd803d7fa9d: Status 404 returned error can't find the container with id 644a3794a4b5adb909a5442b195c6ae141bba238a08534bd8cc63bd803d7fa9d Jul 08 23:21:04.439712 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:04.439669 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz" event={"ID":"85672aea-1993-4ec8-811b-630be81a0231","Type":"ContainerStarted","Data":"e453ada7c93a15a588840ec7974ed31e3007d60c905917dbef82cd88528f3867"} Jul 08 23:21:04.439886 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:04.439732 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz" event={"ID":"85672aea-1993-4ec8-811b-630be81a0231","Type":"ContainerStarted","Data":"644a3794a4b5adb909a5442b195c6ae141bba238a08534bd8cc63bd803d7fa9d"} Jul 08 23:21:04.460446 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:04.460397 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz" podStartSLOduration=1.2727388020000001 podStartE2EDuration="1.460382126s" totalImagesPullingTime="187.643324ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:21:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:21:04.458478936 +0000 UTC m=+820.617762446" watchObservedRunningTime="2026-07-08 23:21:04.460382126 +0000 UTC m=+820.619665634" Jul 08 23:21:13.399166 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:13.399109 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:21:14.009672 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:14.009635 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz" Jul 08 23:21:14.009859 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:14.009692 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz" Jul 08 23:21:14.022042 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:14.022017 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz" Jul 08 23:21:14.500426 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:14.500339 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9dwxz" Jul 08 23:21:14.501195 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:14.501177 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:21:24.657594 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:24.657558 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:21:26.989622 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:26.989582 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:21:33.499813 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:33.499786 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q"] Jul 08 23:21:33.503413 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:33.503396 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q" Jul 08 23:21:33.505859 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:33.505839 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 08 23:21:33.513560 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:33.513538 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q"] Jul 08 23:21:33.532130 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:33.532104 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:21:33.590478 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:33.590450 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecf1d38e-a89c-4bef-b099-1d2241bba798-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckp2q\" (UID: \"ecf1d38e-a89c-4bef-b099-1d2241bba798\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q" Jul 08 23:21:33.590478 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:33.590479 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b42zx\" (UniqueName: \"kubernetes.io/projected/ecf1d38e-a89c-4bef-b099-1d2241bba798-kube-api-access-b42zx\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckp2q\" (UID: \"ecf1d38e-a89c-4bef-b099-1d2241bba798\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q" Jul 08 23:21:33.590632 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:33.590500 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecf1d38e-a89c-4bef-b099-1d2241bba798-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckp2q\" (UID: \"ecf1d38e-a89c-4bef-b099-1d2241bba798\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q" Jul 08 23:21:33.590632 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:33.590576 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecf1d38e-a89c-4bef-b099-1d2241bba798-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckp2q\" (UID: \"ecf1d38e-a89c-4bef-b099-1d2241bba798\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q" Jul 08 23:21:33.590702 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:33.590641 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecf1d38e-a89c-4bef-b099-1d2241bba798-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckp2q\" (UID: \"ecf1d38e-a89c-4bef-b099-1d2241bba798\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q" Jul 08 23:21:33.590702 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:33.590675 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecf1d38e-a89c-4bef-b099-1d2241bba798-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckp2q\" (UID: \"ecf1d38e-a89c-4bef-b099-1d2241bba798\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q" Jul 08 23:21:33.692125 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:33.692091 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecf1d38e-a89c-4bef-b099-1d2241bba798-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckp2q\" (UID: \"ecf1d38e-a89c-4bef-b099-1d2241bba798\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q" Jul 08 23:21:33.692302 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:33.692164 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecf1d38e-a89c-4bef-b099-1d2241bba798-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckp2q\" (UID: \"ecf1d38e-a89c-4bef-b099-1d2241bba798\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q" Jul 08 23:21:33.692302 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:33.692186 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b42zx\" (UniqueName: \"kubernetes.io/projected/ecf1d38e-a89c-4bef-b099-1d2241bba798-kube-api-access-b42zx\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckp2q\" (UID: \"ecf1d38e-a89c-4bef-b099-1d2241bba798\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q" Jul 08 23:21:33.692302 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:33.692204 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecf1d38e-a89c-4bef-b099-1d2241bba798-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckp2q\" (UID: \"ecf1d38e-a89c-4bef-b099-1d2241bba798\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q" Jul 08 23:21:33.692302 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:33.692252 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecf1d38e-a89c-4bef-b099-1d2241bba798-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckp2q\" (UID: \"ecf1d38e-a89c-4bef-b099-1d2241bba798\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q" Jul 08 23:21:33.692497 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:33.692316 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecf1d38e-a89c-4bef-b099-1d2241bba798-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckp2q\" (UID: \"ecf1d38e-a89c-4bef-b099-1d2241bba798\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q" Jul 08 23:21:33.692558 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:33.692536 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecf1d38e-a89c-4bef-b099-1d2241bba798-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckp2q\" (UID: \"ecf1d38e-a89c-4bef-b099-1d2241bba798\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q" Jul 08 23:21:33.692600 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:33.692554 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecf1d38e-a89c-4bef-b099-1d2241bba798-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckp2q\" (UID: \"ecf1d38e-a89c-4bef-b099-1d2241bba798\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q" Jul 08 23:21:33.692634 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:33.692620 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecf1d38e-a89c-4bef-b099-1d2241bba798-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckp2q\" (UID: \"ecf1d38e-a89c-4bef-b099-1d2241bba798\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q" Jul 08 23:21:33.694466 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:33.694444 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecf1d38e-a89c-4bef-b099-1d2241bba798-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckp2q\" (UID: \"ecf1d38e-a89c-4bef-b099-1d2241bba798\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q" Jul 08 23:21:33.694630 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:33.694614 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecf1d38e-a89c-4bef-b099-1d2241bba798-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckp2q\" (UID: \"ecf1d38e-a89c-4bef-b099-1d2241bba798\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q" Jul 08 23:21:33.700248 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:33.700229 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b42zx\" (UniqueName: \"kubernetes.io/projected/ecf1d38e-a89c-4bef-b099-1d2241bba798-kube-api-access-b42zx\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ckp2q\" (UID: \"ecf1d38e-a89c-4bef-b099-1d2241bba798\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q" Jul 08 23:21:33.814060 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:33.814016 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q" Jul 08 23:21:33.941444 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:33.941410 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q"] Jul 08 23:21:33.944534 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:21:33.944508 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecf1d38e_a89c_4bef_b099_1d2241bba798.slice/crio-973070b728ca34755637bbc12c253330cca8a2d29bf09cb5c1515039a275e586 WatchSource:0}: Error finding container 973070b728ca34755637bbc12c253330cca8a2d29bf09cb5c1515039a275e586: Status 404 returned error can't find the container with id 973070b728ca34755637bbc12c253330cca8a2d29bf09cb5c1515039a275e586 Jul 08 23:21:34.585144 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:34.585102 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q" event={"ID":"ecf1d38e-a89c-4bef-b099-1d2241bba798","Type":"ContainerStarted","Data":"95e3d21a18572992293963d5e3b17927506a8e3781f4ef32fea36953041bb9fa"} Jul 08 23:21:34.585547 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:34.585206 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q" event={"ID":"ecf1d38e-a89c-4bef-b099-1d2241bba798","Type":"ContainerStarted","Data":"973070b728ca34755637bbc12c253330cca8a2d29bf09cb5c1515039a275e586"} Jul 08 23:21:34.602394 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:34.602345 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q" podStartSLOduration=1.43789238 podStartE2EDuration="1.602329646s" totalImagesPullingTime="164.437266ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:21:34.60095915 +0000 UTC m=+850.760242659" watchObservedRunningTime="2026-07-08 23:21:34.602329646 +0000 UTC m=+850.761613155" Jul 08 23:21:41.539270 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:41.539234 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:21:43.814322 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:43.814272 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q" Jul 08 23:21:43.814322 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:43.814342 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q" Jul 08 23:21:43.827092 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:43.827063 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q" Jul 08 23:21:44.641904 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:21:44.641862 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ckp2q" Jul 08 23:22:31.126880 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:22:31.126849 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:22:31.227201 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:22:31.227167 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:22:38.468157 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:22:38.468113 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:22:41.388590 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:22:41.388552 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:22:44.595588 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:22:44.595541 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:22:44.691630 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:22:44.691597 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:22:45.723745 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:22:45.723711 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:22:45.816363 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:22:45.816331 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:23:56.063458 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:23:56.063385 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:23:56.175175 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:23:56.175141 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7464f4d4d-mzcl4"] Jul 08 23:23:56.175445 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:23:56.175395 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7464f4d4d-mzcl4" podUID="3224bf78-81d7-48eb-a5a3-080d84898a92" containerName="manager" containerID="cri-o://26c6763b49199cac3c8889eb9d38392c6a6b9c264f33cd739bb157e81e1afdf9" gracePeriod=30 Jul 08 23:23:56.423402 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:23:56.423380 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7464f4d4d-mzcl4" Jul 08 23:23:56.476299 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:23:56.476263 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3224bf78-81d7-48eb-a5a3-080d84898a92-webhook-cert\") pod \"3224bf78-81d7-48eb-a5a3-080d84898a92\" (UID: \"3224bf78-81d7-48eb-a5a3-080d84898a92\") " Jul 08 23:23:56.476492 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:23:56.476310 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5g97r\" (UniqueName: \"kubernetes.io/projected/3224bf78-81d7-48eb-a5a3-080d84898a92-kube-api-access-5g97r\") pod \"3224bf78-81d7-48eb-a5a3-080d84898a92\" (UID: \"3224bf78-81d7-48eb-a5a3-080d84898a92\") " Jul 08 23:23:56.478318 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:23:56.478284 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3224bf78-81d7-48eb-a5a3-080d84898a92-kube-api-access-5g97r" (OuterVolumeSpecName: "kube-api-access-5g97r") pod "3224bf78-81d7-48eb-a5a3-080d84898a92" (UID: "3224bf78-81d7-48eb-a5a3-080d84898a92"). InnerVolumeSpecName "kube-api-access-5g97r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 23:23:56.478445 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:23:56.478319 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3224bf78-81d7-48eb-a5a3-080d84898a92-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3224bf78-81d7-48eb-a5a3-080d84898a92" (UID: "3224bf78-81d7-48eb-a5a3-080d84898a92"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 23:23:56.577254 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:23:56.577224 2572 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3224bf78-81d7-48eb-a5a3-080d84898a92-webhook-cert\") on node \"ip-10-0-133-37.ec2.internal\" DevicePath \"\"" Jul 08 23:23:56.577254 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:23:56.577255 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5g97r\" (UniqueName: \"kubernetes.io/projected/3224bf78-81d7-48eb-a5a3-080d84898a92-kube-api-access-5g97r\") on node \"ip-10-0-133-37.ec2.internal\" DevicePath \"\"" Jul 08 23:23:57.253214 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:23:57.253183 2572 generic.go:356] "Generic (PLEG): container finished" podID="3224bf78-81d7-48eb-a5a3-080d84898a92" containerID="26c6763b49199cac3c8889eb9d38392c6a6b9c264f33cd739bb157e81e1afdf9" exitCode=0 Jul 08 23:23:57.253607 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:23:57.253226 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7464f4d4d-mzcl4" Jul 08 23:23:57.253607 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:23:57.253272 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7464f4d4d-mzcl4" event={"ID":"3224bf78-81d7-48eb-a5a3-080d84898a92","Type":"ContainerDied","Data":"26c6763b49199cac3c8889eb9d38392c6a6b9c264f33cd739bb157e81e1afdf9"} Jul 08 23:23:57.253607 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:23:57.253327 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7464f4d4d-mzcl4" event={"ID":"3224bf78-81d7-48eb-a5a3-080d84898a92","Type":"ContainerDied","Data":"509440407ececc8512bc730962378098253453df975410b5aa504d2964ee11d9"} Jul 08 23:23:57.253607 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:23:57.253354 2572 scope.go:117] "RemoveContainer" containerID="26c6763b49199cac3c8889eb9d38392c6a6b9c264f33cd739bb157e81e1afdf9" Jul 08 23:23:57.264113 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:23:57.264094 2572 scope.go:117] "RemoveContainer" containerID="26c6763b49199cac3c8889eb9d38392c6a6b9c264f33cd739bb157e81e1afdf9" Jul 08 23:23:57.264383 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:23:57.264364 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26c6763b49199cac3c8889eb9d38392c6a6b9c264f33cd739bb157e81e1afdf9\": container with ID starting with 26c6763b49199cac3c8889eb9d38392c6a6b9c264f33cd739bb157e81e1afdf9 not found: ID does not exist" containerID="26c6763b49199cac3c8889eb9d38392c6a6b9c264f33cd739bb157e81e1afdf9" Jul 08 23:23:57.264439 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:23:57.264393 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26c6763b49199cac3c8889eb9d38392c6a6b9c264f33cd739bb157e81e1afdf9"} err="failed to get container status \"26c6763b49199cac3c8889eb9d38392c6a6b9c264f33cd739bb157e81e1afdf9\": rpc error: code = NotFound desc = could not find container \"26c6763b49199cac3c8889eb9d38392c6a6b9c264f33cd739bb157e81e1afdf9\": container with ID starting with 26c6763b49199cac3c8889eb9d38392c6a6b9c264f33cd739bb157e81e1afdf9 not found: ID does not exist" Jul 08 23:23:57.275966 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:23:57.275938 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7464f4d4d-mzcl4"] Jul 08 23:23:57.285276 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:23:57.282061 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7464f4d4d-mzcl4"] Jul 08 23:23:57.928328 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:23:57.928292 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:23:58.329845 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:23:58.329801 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3224bf78-81d7-48eb-a5a3-080d84898a92" path="/var/lib/kubelet/pods/3224bf78-81d7-48eb-a5a3-080d84898a92/volumes" Jul 08 23:24:26.081528 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:24:26.081495 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:24:26.147133 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:24:26.147099 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:24:38.703354 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:24:38.703290 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:24:38.802785 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:24:38.802750 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:24:38.933792 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:24:38.933755 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:24:44.848471 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:24:44.848436 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:24:44.962632 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:24:44.962603 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:24:45.054355 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:24:45.054288 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:24:45.206313 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:24:45.206236 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:24:50.936717 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:24:50.936678 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:24:51.015327 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:24:51.015296 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:25:14.695121 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:25:14.695086 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:26:19.789251 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:26:19.789204 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:26:19.843763 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:26:19.843735 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:27:27.392489 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:27:27.392459 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:30:00.139799 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:30:00.139764 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725890-gk465"] Jul 08 23:30:00.140231 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:30:00.140158 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3224bf78-81d7-48eb-a5a3-080d84898a92" containerName="manager" Jul 08 23:30:00.140231 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:30:00.140169 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3224bf78-81d7-48eb-a5a3-080d84898a92" containerName="manager" Jul 08 23:30:00.140306 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:30:00.140235 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3224bf78-81d7-48eb-a5a3-080d84898a92" containerName="manager" Jul 08 23:30:00.143264 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:30:00.143239 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725890-gk465" Jul 08 23:30:00.149502 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:30:00.149479 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9bs8m\"" Jul 08 23:30:00.150492 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:30:00.149987 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725890-gk465"] Jul 08 23:30:00.305517 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:30:00.305483 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lfnt\" (UniqueName: \"kubernetes.io/projected/d6b4e191-3fbf-4c93-b70c-623d18ffc943-kube-api-access-6lfnt\") pod \"maas-api-key-cleanup-29725890-gk465\" (UID: \"d6b4e191-3fbf-4c93-b70c-623d18ffc943\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725890-gk465" Jul 08 23:30:00.406684 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:30:00.406604 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lfnt\" (UniqueName: \"kubernetes.io/projected/d6b4e191-3fbf-4c93-b70c-623d18ffc943-kube-api-access-6lfnt\") pod \"maas-api-key-cleanup-29725890-gk465\" (UID: \"d6b4e191-3fbf-4c93-b70c-623d18ffc943\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725890-gk465" Jul 08 23:30:00.414943 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:30:00.414888 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lfnt\" (UniqueName: \"kubernetes.io/projected/d6b4e191-3fbf-4c93-b70c-623d18ffc943-kube-api-access-6lfnt\") pod \"maas-api-key-cleanup-29725890-gk465\" (UID: \"d6b4e191-3fbf-4c93-b70c-623d18ffc943\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725890-gk465" Jul 08 23:30:00.455092 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:30:00.455070 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725890-gk465" Jul 08 23:30:00.583182 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:30:00.583156 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725890-gk465"] Jul 08 23:30:00.585322 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:30:00.585295 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6b4e191_3fbf_4c93_b70c_623d18ffc943.slice/crio-12122f52db9637f2aeb43f8855f3c6ef00150ab03f51f31109d1806a82410dff WatchSource:0}: Error finding container 12122f52db9637f2aeb43f8855f3c6ef00150ab03f51f31109d1806a82410dff: Status 404 returned error can't find the container with id 12122f52db9637f2aeb43f8855f3c6ef00150ab03f51f31109d1806a82410dff Jul 08 23:30:00.587269 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:30:00.587237 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 23:30:00.944973 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:30:00.944944 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725890-gk465" event={"ID":"d6b4e191-3fbf-4c93-b70c-623d18ffc943","Type":"ContainerStarted","Data":"12122f52db9637f2aeb43f8855f3c6ef00150ab03f51f31109d1806a82410dff"} Jul 08 23:30:04.966831 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:30:04.966787 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725890-gk465" event={"ID":"d6b4e191-3fbf-4c93-b70c-623d18ffc943","Type":"ContainerStarted","Data":"742771ea9f02321fd5844ba059de13114c7362a8461c5c5dae0d0305d0264c89"} Jul 08 23:30:04.984580 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:30:04.984533 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725890-gk465" podStartSLOduration=1.537045026 podStartE2EDuration="4.984519338s" totalImagesPullingTime="3.447474312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:30:04.982262587 +0000 UTC m=+1361.141546097" watchObservedRunningTime="2026-07-08 23:30:04.984519338 +0000 UTC m=+1361.143802847" Jul 08 23:30:59.372020 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:30:59.371983 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:31:00.011542 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:31:00.011508 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725890-gk465"] Jul 08 23:31:00.011723 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:31:00.011698 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725890-gk465" podUID="d6b4e191-3fbf-4c93-b70c-623d18ffc943" containerName="cleanup" containerID="cri-o://742771ea9f02321fd5844ba059de13114c7362a8461c5c5dae0d0305d0264c89" gracePeriod=30 Jul 08 23:31:00.538101 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:31:00.538072 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:31:30.179182 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:31:30.179157 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725890-gk465" Jul 08 23:31:30.238973 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:31:30.238946 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lfnt\" (UniqueName: \"kubernetes.io/projected/d6b4e191-3fbf-4c93-b70c-623d18ffc943-kube-api-access-6lfnt\") pod \"d6b4e191-3fbf-4c93-b70c-623d18ffc943\" (UID: \"d6b4e191-3fbf-4c93-b70c-623d18ffc943\") " Jul 08 23:31:30.241022 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:31:30.240987 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6b4e191-3fbf-4c93-b70c-623d18ffc943-kube-api-access-6lfnt" (OuterVolumeSpecName: "kube-api-access-6lfnt") pod "d6b4e191-3fbf-4c93-b70c-623d18ffc943" (UID: "d6b4e191-3fbf-4c93-b70c-623d18ffc943"). InnerVolumeSpecName "kube-api-access-6lfnt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 23:31:30.339759 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:31:30.339736 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lfnt\" (UniqueName: \"kubernetes.io/projected/d6b4e191-3fbf-4c93-b70c-623d18ffc943-kube-api-access-6lfnt\") on node \"ip-10-0-133-37.ec2.internal\" DevicePath \"\"" Jul 08 23:31:30.374618 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:31:30.374583 2572 generic.go:356] "Generic (PLEG): container finished" podID="d6b4e191-3fbf-4c93-b70c-623d18ffc943" containerID="742771ea9f02321fd5844ba059de13114c7362a8461c5c5dae0d0305d0264c89" exitCode=137 Jul 08 23:31:30.374755 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:31:30.374623 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725890-gk465" event={"ID":"d6b4e191-3fbf-4c93-b70c-623d18ffc943","Type":"ContainerDied","Data":"742771ea9f02321fd5844ba059de13114c7362a8461c5c5dae0d0305d0264c89"} Jul 08 23:31:30.374755 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:31:30.374634 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725890-gk465" Jul 08 23:31:30.374755 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:31:30.374664 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725890-gk465" event={"ID":"d6b4e191-3fbf-4c93-b70c-623d18ffc943","Type":"ContainerDied","Data":"12122f52db9637f2aeb43f8855f3c6ef00150ab03f51f31109d1806a82410dff"} Jul 08 23:31:30.374755 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:31:30.374688 2572 scope.go:117] "RemoveContainer" containerID="742771ea9f02321fd5844ba059de13114c7362a8461c5c5dae0d0305d0264c89" Jul 08 23:31:30.383037 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:31:30.383012 2572 scope.go:117] "RemoveContainer" containerID="742771ea9f02321fd5844ba059de13114c7362a8461c5c5dae0d0305d0264c89" Jul 08 23:31:30.383320 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:31:30.383301 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"742771ea9f02321fd5844ba059de13114c7362a8461c5c5dae0d0305d0264c89\": container with ID starting with 742771ea9f02321fd5844ba059de13114c7362a8461c5c5dae0d0305d0264c89 not found: ID does not exist" containerID="742771ea9f02321fd5844ba059de13114c7362a8461c5c5dae0d0305d0264c89" Jul 08 23:31:30.383371 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:31:30.383328 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"742771ea9f02321fd5844ba059de13114c7362a8461c5c5dae0d0305d0264c89"} err="failed to get container status \"742771ea9f02321fd5844ba059de13114c7362a8461c5c5dae0d0305d0264c89\": rpc error: code = NotFound desc = could not find container \"742771ea9f02321fd5844ba059de13114c7362a8461c5c5dae0d0305d0264c89\": container with ID starting with 742771ea9f02321fd5844ba059de13114c7362a8461c5c5dae0d0305d0264c89 not found: ID does not exist" Jul 08 23:31:30.390656 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:31:30.390631 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725890-gk465"] Jul 08 23:31:30.394777 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:31:30.394751 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725890-gk465"] Jul 08 23:31:32.332043 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:31:32.332012 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6b4e191-3fbf-4c93-b70c-623d18ffc943" path="/var/lib/kubelet/pods/d6b4e191-3fbf-4c93-b70c-623d18ffc943/volumes" Jul 08 23:31:34.532399 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:31:34.532371 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:31:48.449030 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:31:48.448999 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:31:48.550502 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:31:48.550465 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:32:38.945086 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:32:38.945051 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:32:59.320665 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:32:59.320620 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:35:28.545883 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:35:28.545848 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:35:33.819796 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:35:33.819763 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:35:42.083404 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:35:42.083369 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:35:47.183096 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:35:47.183005 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:35:49.984949 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:35:49.984882 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:35:50.078972 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:35:50.078941 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:35:50.426293 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:35:50.426258 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:35:56.167539 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:35:56.167502 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:35:56.232206 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:35:56.232172 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:35:56.381132 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:35:56.381092 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:35:56.484857 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:35:56.484766 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:35:57.486274 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:35:57.486243 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:35:57.608349 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:35:57.608313 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:35:57.707339 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:35:57.707307 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:35:57.977378 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:35:57.977345 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:35:58.077349 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:35:58.077313 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:35:58.179081 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:35:58.179047 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:00.056295 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:00.056264 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:02.582397 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:02.582370 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:03.777038 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:03.777001 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:06.010100 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:06.010061 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:08.787658 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:08.787619 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:08.888323 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:08.888286 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:08.987529 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:08.987498 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:10.059847 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:10.059812 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:10.163280 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:10.163250 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:10.258127 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:10.258095 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:10.591035 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:10.591004 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:10.692024 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:10.691995 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:10.748800 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:10.748771 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:12.328995 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:12.328962 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:15.156218 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:15.156164 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:15.473810 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:15.473721 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:21.236060 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:21.236020 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:21.333469 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:21.333435 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:23.992384 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:23.992355 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:27.060040 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:27.060007 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:27.119758 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:27.119726 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:27.271826 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:27.271784 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:27.335582 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:27.335505 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:28.374300 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:28.374265 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:28.449179 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:28.449153 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:28.510001 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:28.509972 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:28.708311 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:28.708228 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:29.112756 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:29.112726 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:29.216998 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:29.216966 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:30.501189 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:30.501163 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:32.807723 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:32.807691 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:33.007919 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:33.007868 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:33.104739 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:33.104659 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:33.206330 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:33.206296 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:34.721963 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:34.721936 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:38.656212 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:38.656167 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:38.759653 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:38.759608 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:39.109394 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:39.109359 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:39.208521 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:39.208465 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:39.280232 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:39.280204 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:40.662139 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:40.662103 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:46.352958 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:46.352925 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:46.455508 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:46.455474 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:46.553705 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:46.553670 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:46.654254 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:46.654178 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:36:47.065030 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:36:47.065003 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:37:13.054021 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:37:13.053987 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:37:18.654688 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:37:18.654577 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:37:18.761225 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:37:18.761176 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:37:18.854728 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:37:18.854681 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:37:34.771979 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:37:34.771888 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:37:40.309953 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:37:40.309919 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:37:40.414950 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:37:40.414916 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:37:40.509240 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:37:40.509211 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:37:51.018183 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:37:51.018149 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:37:51.810989 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:37:51.810959 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:37:57.598162 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:37:57.598131 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:37:57.706722 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:37:57.706687 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:37:57.798467 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:37:57.798428 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:37:57.857771 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:37:57.857703 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:37:58.619616 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:37:58.619582 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:37:58.720254 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:37:58.720227 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:37:58.819766 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:37:58.819696 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:00.395259 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:00.395218 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:06.185238 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:06.185204 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:06.251944 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:06.251914 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:06.870766 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:06.870732 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:12.950413 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:12.950380 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:13.051004 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:13.050972 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:13.178820 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:13.178770 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:13.503351 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:13.503320 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:13.777445 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:13.777418 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:16.707179 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:16.707140 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:16.801826 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:16.801794 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:16.916600 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:16.916568 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:17.229987 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:17.229955 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:17.362678 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:17.362649 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:17.463594 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:17.463568 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:21.207533 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:21.207495 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:21.859175 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:21.859139 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:21.959244 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:21.959210 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:22.291606 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:22.291569 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:27.861122 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:27.861069 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:27.962312 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:27.962269 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:28.278092 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:28.278064 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:28.672758 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:28.672683 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:28.773877 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:28.773842 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:34.536430 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:34.536401 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:34.594679 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:34.594651 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:34.789084 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:34.789009 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:35.130785 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:35.130699 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:35.230139 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:35.230104 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:35.360687 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:35.360654 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:41.153006 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:41.152976 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:41.254314 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:41.254283 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:41.352973 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:41.352940 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:41.504368 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:41.504289 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:47.144198 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:47.144121 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:47.244559 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:47.244524 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:54.171040 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:54.171004 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:54.510144 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:54.510119 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:54.762351 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:54.762273 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:56.920147 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:56.920110 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:56.997153 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:56.997120 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:57.071528 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:57.071489 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:57.197136 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:57.197050 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:57.657568 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:57.657533 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:38:57.746065 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:38:57.746035 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:39:01.421493 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:39:01.421462 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:39:06.809650 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:39:06.809620 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:39:20.223875 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:39:20.223825 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:39:20.324473 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:39:20.324435 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:39:28.637076 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:39:28.637036 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:39:29.082968 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:39:29.082941 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:39:29.183961 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:39:29.183928 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:39:29.338824 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:39:29.338746 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:39:34.319843 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:39:34.319811 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:39:34.421174 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:39:34.421143 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:39:34.739239 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:39:34.739161 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:39:39.760427 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:39:39.760393 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:40:16.150340 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:40:16.150261 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:40:16.834039 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:40:16.834004 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:40:22.313953 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:40:22.313889 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:40:22.414182 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:40:22.414155 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:40:22.602665 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:40:22.602581 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:40:23.875075 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:40:23.875041 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:40:23.978343 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:40:23.978312 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:40:24.076048 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:40:24.076018 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:40:24.775240 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:40:24.775202 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:40:24.874597 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:40:24.874563 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:40:24.975351 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:40:24.975320 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:40:26.378216 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:40:26.378182 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:40:32.295025 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:40:32.294994 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:40:32.355910 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:40:32.355852 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:40:32.969558 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:40:32.969528 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:40:38.670454 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:40:38.670420 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:40:38.730788 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:40:38.730762 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:40:38.801340 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:40:38.801283 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:40:38.915943 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:40:38.915853 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:40:49.411347 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:40:49.411309 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:40:49.746709 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:40:49.746625 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:10.693831 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:10.693796 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:12.167717 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:12.167684 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:12.218981 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:12.218945 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:16.467703 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:16.467668 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:16.533288 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:16.533261 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:16.806034 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:16.805999 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:17.149637 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:17.149543 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:17.245083 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:17.245045 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:18.095854 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:18.095823 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:19.806576 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:19.806542 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:19.905547 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:19.905516 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:19.990400 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:19.990371 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:20.081949 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:20.081871 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:20.388276 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:20.388205 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:20.488778 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:20.488748 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:24.306443 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:24.306414 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:24.630825 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:24.630716 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:24.943774 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:24.943685 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:25.313319 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:25.313286 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:27.822179 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:27.822145 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:27.886471 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:27.886445 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:27.956826 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:27.956792 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:28.372207 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:28.372170 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:28.486935 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:28.486878 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:28.589833 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:28.589802 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:28.873877 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:28.873842 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:28.982198 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:28.982165 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:32.312040 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:32.312005 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:39.815139 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:39.815082 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:41.186318 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:41.186283 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:41.288360 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:41.288309 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:49.165449 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:49.165376 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:41:49.261662 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:41:49.261630 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:42:13.392114 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:42:13.392083 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:42:21.420319 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:42:21.420281 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:42:35.929117 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:42:35.929085 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:42:36.865289 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:42:36.865255 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:42:37.012215 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:42:37.012181 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:42:37.442246 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:42:37.442218 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:42:37.524510 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:42:37.524481 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:42:37.666477 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:42:37.666448 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:42:42.495566 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:42:42.495533 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:19.174253 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:19.174219 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:19.444977 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:19.444844 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:19.968237 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:19.968191 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:20.321491 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:20.321426 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:20.419079 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:20.419027 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:20.520145 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:20.520091 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:20.666444 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:20.666339 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:26.240558 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:26.240519 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:26.340186 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:26.340153 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:26.498332 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:26.498254 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:27.052069 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:27.052041 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:27.366793 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:27.366723 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:27.466833 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:27.466802 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:30.575620 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:30.575563 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:30.655427 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:30.655389 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:30.718354 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:30.718321 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:31.212504 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:31.212465 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:31.315116 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:31.315084 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:31.823056 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:31.823026 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:35.082907 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:35.082833 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:35.533355 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:35.533328 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:35.842874 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:35.842789 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:36.103154 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:36.103068 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:38.633052 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:38.633021 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:38.710476 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:38.710398 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:38.784371 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:38.784332 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:39.008130 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:39.008102 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:39.214803 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:39.214765 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:39.322406 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:39.322311 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:43.133585 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:43.133555 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:51.151807 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:51.151763 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:51.556029 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:51.556001 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:51.656021 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:51.655982 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:51.756052 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:51.756003 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:51.834346 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:51.834253 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:57.193133 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:57.193092 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:57.293876 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:57.293842 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:57.455057 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:57.454944 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:57.834405 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:57.834335 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:58.319367 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:58.319322 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:58.420198 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:58.420169 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:58.521104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:58.521065 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:43:58.659102 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:43:58.659005 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:01.807697 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:01.807635 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:01.860967 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:01.860937 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:04.073922 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:04.073865 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:04.185258 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:04.185223 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:04.372370 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:04.372280 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:04.917218 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:04.917188 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:05.235465 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:05.235371 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:05.338352 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:05.338313 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:07.840202 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:07.840175 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:07.918771 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:07.918740 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:08.035742 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:08.035713 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:08.259155 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:08.259124 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:08.418376 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:08.418348 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:08.519168 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:08.519086 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:12.324307 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:12.324272 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:12.651927 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:12.651816 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:12.953545 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:12.953466 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:13.078275 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:13.078241 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:16.023150 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:16.023117 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:16.120653 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:16.120616 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:16.217921 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:16.217866 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:16.330126 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:16.330045 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:16.726702 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:16.726619 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:16.826117 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:16.826083 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:20.465939 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:20.465878 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:20.917858 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:20.917826 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:21.024632 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:21.024599 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:29.425243 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:29.425204 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:29.527233 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:29.527197 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:31.755126 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:31.755092 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:38.458922 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:38.458869 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:38.559527 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:38.559491 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:44:53.106655 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:44:53.106533 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:45:00.133417 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:00.133387 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cd1865-29725905-s64s5"] Jul 08 23:45:00.133811 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:00.133758 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6b4e191-3fbf-4c93-b70c-623d18ffc943" containerName="cleanup" Jul 08 23:45:00.133811 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:00.133770 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6b4e191-3fbf-4c93-b70c-623d18ffc943" containerName="cleanup" Jul 08 23:45:00.133886 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:00.133825 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6b4e191-3fbf-4c93-b70c-623d18ffc943" containerName="cleanup" Jul 08 23:45:00.137072 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:00.137053 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cd1865-29725905-s64s5" Jul 08 23:45:00.137494 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:00.137475 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725905-dttds"] Jul 08 23:45:00.139373 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:00.139355 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9bs8m\"" Jul 08 23:45:00.141075 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:00.141058 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-310c89-29725905-c5g8q"] Jul 08 23:45:00.141166 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:00.141153 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725905-dttds" Jul 08 23:45:00.144144 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:00.144127 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-310c89-29725905-c5g8q" Jul 08 23:45:00.148821 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:00.148657 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cd1865-29725905-s64s5"] Jul 08 23:45:00.151680 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:00.151658 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-310c89-29725905-c5g8q"] Jul 08 23:45:00.153044 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:00.153026 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725905-dttds"] Jul 08 23:45:00.274142 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:00.274106 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj7sv\" (UniqueName: \"kubernetes.io/projected/5967e69e-2aab-44a7-8588-ecc137c8ff7a-kube-api-access-hj7sv\") pod \"maas-api-key-cleanup-e2e-shared-b-cd1865-29725905-s64s5\" (UID: \"5967e69e-2aab-44a7-8588-ecc137c8ff7a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cd1865-29725905-s64s5" Jul 08 23:45:00.274142 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:00.274146 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qswgf\" (UniqueName: \"kubernetes.io/projected/182a7513-785d-41c9-905a-bdcda98313c9-kube-api-access-qswgf\") pod \"maas-api-key-cleanup-e2e-shared-a-310c89-29725905-c5g8q\" (UID: \"182a7513-785d-41c9-905a-bdcda98313c9\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-310c89-29725905-c5g8q" Jul 08 23:45:00.274359 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:00.274209 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6272x\" (UniqueName: \"kubernetes.io/projected/504e4a4c-8302-470e-9646-cdc8eec63679-kube-api-access-6272x\") pod \"maas-api-key-cleanup-29725905-dttds\" (UID: \"504e4a4c-8302-470e-9646-cdc8eec63679\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725905-dttds" Jul 08 23:45:00.375470 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:00.375442 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qswgf\" (UniqueName: \"kubernetes.io/projected/182a7513-785d-41c9-905a-bdcda98313c9-kube-api-access-qswgf\") pod \"maas-api-key-cleanup-e2e-shared-a-310c89-29725905-c5g8q\" (UID: \"182a7513-785d-41c9-905a-bdcda98313c9\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-310c89-29725905-c5g8q" Jul 08 23:45:00.375742 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:00.375492 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6272x\" (UniqueName: \"kubernetes.io/projected/504e4a4c-8302-470e-9646-cdc8eec63679-kube-api-access-6272x\") pod \"maas-api-key-cleanup-29725905-dttds\" (UID: \"504e4a4c-8302-470e-9646-cdc8eec63679\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725905-dttds" Jul 08 23:45:00.375742 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:00.375555 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj7sv\" (UniqueName: \"kubernetes.io/projected/5967e69e-2aab-44a7-8588-ecc137c8ff7a-kube-api-access-hj7sv\") pod \"maas-api-key-cleanup-e2e-shared-b-cd1865-29725905-s64s5\" (UID: \"5967e69e-2aab-44a7-8588-ecc137c8ff7a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cd1865-29725905-s64s5" Jul 08 23:45:00.383277 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:00.383250 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qswgf\" (UniqueName: \"kubernetes.io/projected/182a7513-785d-41c9-905a-bdcda98313c9-kube-api-access-qswgf\") pod \"maas-api-key-cleanup-e2e-shared-a-310c89-29725905-c5g8q\" (UID: \"182a7513-785d-41c9-905a-bdcda98313c9\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-310c89-29725905-c5g8q" Jul 08 23:45:00.383471 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:00.383423 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6272x\" (UniqueName: \"kubernetes.io/projected/504e4a4c-8302-470e-9646-cdc8eec63679-kube-api-access-6272x\") pod \"maas-api-key-cleanup-29725905-dttds\" (UID: \"504e4a4c-8302-470e-9646-cdc8eec63679\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725905-dttds" Jul 08 23:45:00.383471 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:00.383466 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj7sv\" (UniqueName: \"kubernetes.io/projected/5967e69e-2aab-44a7-8588-ecc137c8ff7a-kube-api-access-hj7sv\") pod \"maas-api-key-cleanup-e2e-shared-b-cd1865-29725905-s64s5\" (UID: \"5967e69e-2aab-44a7-8588-ecc137c8ff7a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cd1865-29725905-s64s5" Jul 08 23:45:00.449226 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:00.449200 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cd1865-29725905-s64s5" Jul 08 23:45:00.459266 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:00.459230 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725905-dttds" Jul 08 23:45:00.465174 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:00.465128 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-310c89-29725905-c5g8q" Jul 08 23:45:00.594965 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:00.594927 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cd1865-29725905-s64s5"] Jul 08 23:45:00.598504 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:45:00.598458 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5967e69e_2aab_44a7_8588_ecc137c8ff7a.slice/crio-136e54e043d6a012ba61b2fa31b62dbffac8150cf6ef98863c0af99efbfe6448 WatchSource:0}: Error finding container 136e54e043d6a012ba61b2fa31b62dbffac8150cf6ef98863c0af99efbfe6448: Status 404 returned error can't find the container with id 136e54e043d6a012ba61b2fa31b62dbffac8150cf6ef98863c0af99efbfe6448 Jul 08 23:45:00.653117 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:00.653087 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-310c89-29725905-c5g8q"] Jul 08 23:45:00.653764 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:45:00.653737 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod182a7513_785d_41c9_905a_bdcda98313c9.slice/crio-0ef50b41b1d549c682379129896086df6e6a23106f89992d26509708bd760f52 WatchSource:0}: Error finding container 0ef50b41b1d549c682379129896086df6e6a23106f89992d26509708bd760f52: Status 404 returned error can't find the container with id 0ef50b41b1d549c682379129896086df6e6a23106f89992d26509708bd760f52 Jul 08 23:45:00.833586 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:00.833557 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725905-dttds"] Jul 08 23:45:00.835417 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:45:00.835396 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod504e4a4c_8302_470e_9646_cdc8eec63679.slice/crio-7ff3efc2a3d0cf1576ab56cb7c219129f1a90ac28371aa0390f9e2e53f72ac87 WatchSource:0}: Error finding container 7ff3efc2a3d0cf1576ab56cb7c219129f1a90ac28371aa0390f9e2e53f72ac87: Status 404 returned error can't find the container with id 7ff3efc2a3d0cf1576ab56cb7c219129f1a90ac28371aa0390f9e2e53f72ac87 Jul 08 23:45:01.094074 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:01.094041 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725905-dttds" event={"ID":"504e4a4c-8302-470e-9646-cdc8eec63679","Type":"ContainerStarted","Data":"7ff3efc2a3d0cf1576ab56cb7c219129f1a90ac28371aa0390f9e2e53f72ac87"} Jul 08 23:45:01.095515 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:01.095490 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cd1865-29725905-s64s5" event={"ID":"5967e69e-2aab-44a7-8588-ecc137c8ff7a","Type":"ContainerStarted","Data":"ba2cd15ae04c22fb6d2e65a02eff4fef90a6f7feba71df7b4b0505a1101c6ec8"} Jul 08 23:45:01.095662 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:01.095538 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cd1865-29725905-s64s5" event={"ID":"5967e69e-2aab-44a7-8588-ecc137c8ff7a","Type":"ContainerStarted","Data":"136e54e043d6a012ba61b2fa31b62dbffac8150cf6ef98863c0af99efbfe6448"} Jul 08 23:45:01.097000 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:01.096973 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-310c89-29725905-c5g8q" event={"ID":"182a7513-785d-41c9-905a-bdcda98313c9","Type":"ContainerStarted","Data":"deab8a27d75c559561612e6c00c81df1dd038c0b4a1f9b35a5788b104ddc16aa"} Jul 08 23:45:01.097117 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:01.097012 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-310c89-29725905-c5g8q" event={"ID":"182a7513-785d-41c9-905a-bdcda98313c9","Type":"ContainerStarted","Data":"0ef50b41b1d549c682379129896086df6e6a23106f89992d26509708bd760f52"} Jul 08 23:45:01.110743 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:01.110702 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cd1865-29725905-s64s5" podStartSLOduration=1.11068856 podStartE2EDuration="1.11068856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:45:01.109452676 +0000 UTC m=+2257.268736187" watchObservedRunningTime="2026-07-08 23:45:01.11068856 +0000 UTC m=+2257.269972071" Jul 08 23:45:01.124809 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:01.124774 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-310c89-29725905-c5g8q" podStartSLOduration=1.124762642 podStartE2EDuration="1.124762642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:45:01.123469886 +0000 UTC m=+2257.282753397" watchObservedRunningTime="2026-07-08 23:45:01.124762642 +0000 UTC m=+2257.284046150" Jul 08 23:45:02.103553 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:02.103513 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725905-dttds" event={"ID":"504e4a4c-8302-470e-9646-cdc8eec63679","Type":"ContainerStarted","Data":"39ddeff521423cf79e6a503795a37cae46c8c94815a341862da939b87ba697d1"} Jul 08 23:45:02.117007 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:45:02.116943 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725905-dttds" podStartSLOduration=2.116924105 podStartE2EDuration="2.116924105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:45:02.116816028 +0000 UTC m=+2258.276099537" watchObservedRunningTime="2026-07-08 23:45:02.116924105 +0000 UTC m=+2258.276207615" Jul 08 23:46:00.010457 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:00.010421 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725905-dttds"] Jul 08 23:46:00.013064 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:00.010720 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725905-dttds" podUID="504e4a4c-8302-470e-9646-cdc8eec63679" containerName="cleanup" containerID="cri-o://39ddeff521423cf79e6a503795a37cae46c8c94815a341862da939b87ba697d1" gracePeriod=30 Jul 08 23:46:00.013707 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:00.013676 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cd1865-29725905-s64s5"] Jul 08 23:46:00.013890 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:00.013855 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cd1865-29725905-s64s5" podUID="5967e69e-2aab-44a7-8588-ecc137c8ff7a" containerName="cleanup" containerID="cri-o://ba2cd15ae04c22fb6d2e65a02eff4fef90a6f7feba71df7b4b0505a1101c6ec8" gracePeriod=30 Jul 08 23:46:00.015351 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:00.015334 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-310c89-29725905-c5g8q"] Jul 08 23:46:00.015522 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:00.015490 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-310c89-29725905-c5g8q" podUID="182a7513-785d-41c9-905a-bdcda98313c9" containerName="cleanup" containerID="cri-o://deab8a27d75c559561612e6c00c81df1dd038c0b4a1f9b35a5788b104ddc16aa" gracePeriod=30 Jul 08 23:46:30.207905 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.207867 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725905-dttds" Jul 08 23:46:30.239414 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.239394 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-310c89-29725905-c5g8q" Jul 08 23:46:30.242326 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.242307 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cd1865-29725905-s64s5" Jul 08 23:46:30.279767 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.279703 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6272x\" (UniqueName: \"kubernetes.io/projected/504e4a4c-8302-470e-9646-cdc8eec63679-kube-api-access-6272x\") pod \"504e4a4c-8302-470e-9646-cdc8eec63679\" (UID: \"504e4a4c-8302-470e-9646-cdc8eec63679\") " Jul 08 23:46:30.279930 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.279782 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qswgf\" (UniqueName: \"kubernetes.io/projected/182a7513-785d-41c9-905a-bdcda98313c9-kube-api-access-qswgf\") pod \"182a7513-785d-41c9-905a-bdcda98313c9\" (UID: \"182a7513-785d-41c9-905a-bdcda98313c9\") " Jul 08 23:46:30.279930 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.279837 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hj7sv\" (UniqueName: \"kubernetes.io/projected/5967e69e-2aab-44a7-8588-ecc137c8ff7a-kube-api-access-hj7sv\") pod \"5967e69e-2aab-44a7-8588-ecc137c8ff7a\" (UID: \"5967e69e-2aab-44a7-8588-ecc137c8ff7a\") " Jul 08 23:46:30.282368 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.282339 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/504e4a4c-8302-470e-9646-cdc8eec63679-kube-api-access-6272x" (OuterVolumeSpecName: "kube-api-access-6272x") pod "504e4a4c-8302-470e-9646-cdc8eec63679" (UID: "504e4a4c-8302-470e-9646-cdc8eec63679"). InnerVolumeSpecName "kube-api-access-6272x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 23:46:30.282368 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.282350 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/182a7513-785d-41c9-905a-bdcda98313c9-kube-api-access-qswgf" (OuterVolumeSpecName: "kube-api-access-qswgf") pod "182a7513-785d-41c9-905a-bdcda98313c9" (UID: "182a7513-785d-41c9-905a-bdcda98313c9"). InnerVolumeSpecName "kube-api-access-qswgf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 23:46:30.282519 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.282428 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5967e69e-2aab-44a7-8588-ecc137c8ff7a-kube-api-access-hj7sv" (OuterVolumeSpecName: "kube-api-access-hj7sv") pod "5967e69e-2aab-44a7-8588-ecc137c8ff7a" (UID: "5967e69e-2aab-44a7-8588-ecc137c8ff7a"). InnerVolumeSpecName "kube-api-access-hj7sv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 23:46:30.380973 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.380937 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hj7sv\" (UniqueName: \"kubernetes.io/projected/5967e69e-2aab-44a7-8588-ecc137c8ff7a-kube-api-access-hj7sv\") on node \"ip-10-0-133-37.ec2.internal\" DevicePath \"\"" Jul 08 23:46:30.380973 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.380964 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6272x\" (UniqueName: \"kubernetes.io/projected/504e4a4c-8302-470e-9646-cdc8eec63679-kube-api-access-6272x\") on node \"ip-10-0-133-37.ec2.internal\" DevicePath \"\"" Jul 08 23:46:30.380973 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.380973 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qswgf\" (UniqueName: \"kubernetes.io/projected/182a7513-785d-41c9-905a-bdcda98313c9-kube-api-access-qswgf\") on node \"ip-10-0-133-37.ec2.internal\" DevicePath \"\"" Jul 08 23:46:30.519111 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.519077 2572 generic.go:356] "Generic (PLEG): container finished" podID="182a7513-785d-41c9-905a-bdcda98313c9" containerID="deab8a27d75c559561612e6c00c81df1dd038c0b4a1f9b35a5788b104ddc16aa" exitCode=137 Jul 08 23:46:30.519308 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.519130 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-310c89-29725905-c5g8q" Jul 08 23:46:30.519308 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.519157 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-310c89-29725905-c5g8q" event={"ID":"182a7513-785d-41c9-905a-bdcda98313c9","Type":"ContainerDied","Data":"deab8a27d75c559561612e6c00c81df1dd038c0b4a1f9b35a5788b104ddc16aa"} Jul 08 23:46:30.519308 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.519219 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-310c89-29725905-c5g8q" event={"ID":"182a7513-785d-41c9-905a-bdcda98313c9","Type":"ContainerDied","Data":"0ef50b41b1d549c682379129896086df6e6a23106f89992d26509708bd760f52"} Jul 08 23:46:30.519308 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.519259 2572 scope.go:117] "RemoveContainer" containerID="deab8a27d75c559561612e6c00c81df1dd038c0b4a1f9b35a5788b104ddc16aa" Jul 08 23:46:30.520503 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.520482 2572 generic.go:356] "Generic (PLEG): container finished" podID="504e4a4c-8302-470e-9646-cdc8eec63679" containerID="39ddeff521423cf79e6a503795a37cae46c8c94815a341862da939b87ba697d1" exitCode=137 Jul 08 23:46:30.520602 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.520521 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725905-dttds" Jul 08 23:46:30.520602 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.520563 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725905-dttds" event={"ID":"504e4a4c-8302-470e-9646-cdc8eec63679","Type":"ContainerDied","Data":"39ddeff521423cf79e6a503795a37cae46c8c94815a341862da939b87ba697d1"} Jul 08 23:46:30.520720 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.520623 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725905-dttds" event={"ID":"504e4a4c-8302-470e-9646-cdc8eec63679","Type":"ContainerDied","Data":"7ff3efc2a3d0cf1576ab56cb7c219129f1a90ac28371aa0390f9e2e53f72ac87"} Jul 08 23:46:30.521928 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.521883 2572 generic.go:356] "Generic (PLEG): container finished" podID="5967e69e-2aab-44a7-8588-ecc137c8ff7a" containerID="ba2cd15ae04c22fb6d2e65a02eff4fef90a6f7feba71df7b4b0505a1101c6ec8" exitCode=137 Jul 08 23:46:30.522062 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.521940 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cd1865-29725905-s64s5" Jul 08 23:46:30.522062 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.521937 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cd1865-29725905-s64s5" event={"ID":"5967e69e-2aab-44a7-8588-ecc137c8ff7a","Type":"ContainerDied","Data":"ba2cd15ae04c22fb6d2e65a02eff4fef90a6f7feba71df7b4b0505a1101c6ec8"} Jul 08 23:46:30.522062 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.522054 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cd1865-29725905-s64s5" event={"ID":"5967e69e-2aab-44a7-8588-ecc137c8ff7a","Type":"ContainerDied","Data":"136e54e043d6a012ba61b2fa31b62dbffac8150cf6ef98863c0af99efbfe6448"} Jul 08 23:46:30.529212 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.529197 2572 scope.go:117] "RemoveContainer" containerID="deab8a27d75c559561612e6c00c81df1dd038c0b4a1f9b35a5788b104ddc16aa" Jul 08 23:46:30.529449 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:46:30.529431 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"deab8a27d75c559561612e6c00c81df1dd038c0b4a1f9b35a5788b104ddc16aa\": container with ID starting with deab8a27d75c559561612e6c00c81df1dd038c0b4a1f9b35a5788b104ddc16aa not found: ID does not exist" containerID="deab8a27d75c559561612e6c00c81df1dd038c0b4a1f9b35a5788b104ddc16aa" Jul 08 23:46:30.529494 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.529458 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"deab8a27d75c559561612e6c00c81df1dd038c0b4a1f9b35a5788b104ddc16aa"} err="failed to get container status \"deab8a27d75c559561612e6c00c81df1dd038c0b4a1f9b35a5788b104ddc16aa\": rpc error: code = NotFound desc = could not find container \"deab8a27d75c559561612e6c00c81df1dd038c0b4a1f9b35a5788b104ddc16aa\": container with ID starting with deab8a27d75c559561612e6c00c81df1dd038c0b4a1f9b35a5788b104ddc16aa not found: ID does not exist" Jul 08 23:46:30.529494 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.529474 2572 scope.go:117] "RemoveContainer" containerID="39ddeff521423cf79e6a503795a37cae46c8c94815a341862da939b87ba697d1" Jul 08 23:46:30.536799 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.536780 2572 scope.go:117] "RemoveContainer" containerID="39ddeff521423cf79e6a503795a37cae46c8c94815a341862da939b87ba697d1" Jul 08 23:46:30.537061 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:46:30.537044 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39ddeff521423cf79e6a503795a37cae46c8c94815a341862da939b87ba697d1\": container with ID starting with 39ddeff521423cf79e6a503795a37cae46c8c94815a341862da939b87ba697d1 not found: ID does not exist" containerID="39ddeff521423cf79e6a503795a37cae46c8c94815a341862da939b87ba697d1" Jul 08 23:46:30.537115 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.537069 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39ddeff521423cf79e6a503795a37cae46c8c94815a341862da939b87ba697d1"} err="failed to get container status \"39ddeff521423cf79e6a503795a37cae46c8c94815a341862da939b87ba697d1\": rpc error: code = NotFound desc = could not find container \"39ddeff521423cf79e6a503795a37cae46c8c94815a341862da939b87ba697d1\": container with ID starting with 39ddeff521423cf79e6a503795a37cae46c8c94815a341862da939b87ba697d1 not found: ID does not exist" Jul 08 23:46:30.537115 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.537084 2572 scope.go:117] "RemoveContainer" containerID="ba2cd15ae04c22fb6d2e65a02eff4fef90a6f7feba71df7b4b0505a1101c6ec8" Jul 08 23:46:30.541606 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.541577 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-310c89-29725905-c5g8q"] Jul 08 23:46:30.545235 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.545212 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-310c89-29725905-c5g8q"] Jul 08 23:46:30.546301 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.546280 2572 scope.go:117] "RemoveContainer" containerID="ba2cd15ae04c22fb6d2e65a02eff4fef90a6f7feba71df7b4b0505a1101c6ec8" Jul 08 23:46:30.546608 ip-10-0-133-37 kubenswrapper[2572]: E0708 23:46:30.546582 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba2cd15ae04c22fb6d2e65a02eff4fef90a6f7feba71df7b4b0505a1101c6ec8\": container with ID starting with ba2cd15ae04c22fb6d2e65a02eff4fef90a6f7feba71df7b4b0505a1101c6ec8 not found: ID does not exist" containerID="ba2cd15ae04c22fb6d2e65a02eff4fef90a6f7feba71df7b4b0505a1101c6ec8" Jul 08 23:46:30.546666 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.546614 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba2cd15ae04c22fb6d2e65a02eff4fef90a6f7feba71df7b4b0505a1101c6ec8"} err="failed to get container status \"ba2cd15ae04c22fb6d2e65a02eff4fef90a6f7feba71df7b4b0505a1101c6ec8\": rpc error: code = NotFound desc = could not find container \"ba2cd15ae04c22fb6d2e65a02eff4fef90a6f7feba71df7b4b0505a1101c6ec8\": container with ID starting with ba2cd15ae04c22fb6d2e65a02eff4fef90a6f7feba71df7b4b0505a1101c6ec8 not found: ID does not exist" Jul 08 23:46:30.554327 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.554299 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cd1865-29725905-s64s5"] Jul 08 23:46:30.558454 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.558431 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cd1865-29725905-s64s5"] Jul 08 23:46:30.568675 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.568652 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725905-dttds"] Jul 08 23:46:30.572929 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:30.572888 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725905-dttds"] Jul 08 23:46:32.330247 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:32.330208 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="182a7513-785d-41c9-905a-bdcda98313c9" path="/var/lib/kubelet/pods/182a7513-785d-41c9-905a-bdcda98313c9/volumes" Jul 08 23:46:32.330623 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:32.330586 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="504e4a4c-8302-470e-9646-cdc8eec63679" path="/var/lib/kubelet/pods/504e4a4c-8302-470e-9646-cdc8eec63679/volumes" Jul 08 23:46:32.330919 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:46:32.330887 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5967e69e-2aab-44a7-8588-ecc137c8ff7a" path="/var/lib/kubelet/pods/5967e69e-2aab-44a7-8588-ecc137c8ff7a/volumes" Jul 08 23:47:09.693689 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:47:09.693655 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:47:11.061378 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:47:11.061347 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:47:23.334683 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:47:23.334634 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:47:48.265949 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:47:48.265840 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:47:50.338425 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:47:50.338396 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:48:14.388622 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:48:14.388585 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:48:14.443547 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:48:14.443519 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:48:26.368698 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:48:26.368665 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:48:27.320154 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:48:27.320122 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:48:27.727187 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:48:27.727103 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:48:31.715258 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:48:31.715215 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:49:01.133755 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:49:01.133718 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:49:21.730250 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:49:21.730216 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:49:21.830325 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:49:21.830292 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:49:30.276220 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:49:30.276189 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:49:30.377130 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:49:30.377103 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:49:39.236022 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:49:39.235993 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:49:39.336789 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:49:39.336757 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:49:47.532638 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:49:47.532599 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:49:47.963007 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:49:47.962923 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:49:48.561746 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:49:48.561715 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:50:29.325310 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:50:29.325275 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:50:29.715649 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:50:29.715564 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:50:29.817257 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:50:29.817228 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:50:29.916326 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:50:29.916300 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:50:30.022059 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:50:30.022029 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:50:35.653269 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:50:35.653238 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:50:35.717607 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:50:35.717577 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:50:35.922555 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:50:35.922477 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:50:36.306050 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:50:36.306017 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:50:36.727311 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:50:36.727222 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:50:36.828432 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:50:36.828395 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:50:36.993770 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:50:36.993691 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:50:42.584008 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:50:42.583972 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:50:42.683147 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:50:42.683120 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:50:42.842330 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:50:42.842258 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:50:49.169803 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:50:49.169730 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b86895794-mzzr5_1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e/copy-manifests/0.log" Jul 08 23:50:49.182340 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:50:49.182313 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b86895794-mzzr5_1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e/manager/0.log" Jul 08 23:50:49.651775 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:50:49.651746 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-jqcrt_4844d03d-1697-4f50-a4ba-83388e15c809/postgres/0.log" Jul 08 23:50:50.411131 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:50:50.411099 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:50:50.463311 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:50:50.463280 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:50:52.334651 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:50:52.334622 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mswnx_469a1a3e-3527-4624-9a7b-85236d2db4c7/discovery/0.log" Jul 08 23:50:52.906770 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:50:52.906743 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-k7gls_09c667b3-8fed-4dc6-9cc7-9269be6e253f/payload-processing/0.log" Jul 08 23:50:53.360562 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:50:53.360529 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-4xf79_e065b8e4-2f24-4662-b0b4-a66dfc72fcec/main/0.log" Jul 08 23:50:53.472675 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:50:53.472649 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-9dwxz_85672aea-1993-4ec8-811b-630be81a0231/main/0.log" Jul 08 23:50:53.810091 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:50:53.810064 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-ckp2q_ecf1d38e-a89c-4bef-b099-1d2241bba798/main/0.log" Jul 08 23:50:58.306940 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:50:58.306887 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:50:58.407439 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:50:58.407409 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" limit=1024 Jul 08 23:51:01.014439 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:01.014404 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2p25w_19cfadf2-80c1-49c5-b9ff-29c372a05a7f/global-pull-secret-syncer/0.log" Jul 08 23:51:01.141905 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:01.141876 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2bpwm_1d37c23c-9492-45f3-8e9f-ef3855f05727/konnectivity-agent/0.log" Jul 08 23:51:01.252800 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:01.252774 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-37.ec2.internal_c30d50af267f54e89a2e53ab8e34c4f0/haproxy/0.log" Jul 08 23:51:08.879349 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:08.879318 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-q6g2c_9739aa16-33a8-4311-9ba0-a431fad4fc00/cluster-monitoring-operator/0.log" Jul 08 23:51:08.905780 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:08.905749 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-ch4vt_87e5c0f3-28ba-402e-b5a9-0a58471e4438/kube-state-metrics/0.log" Jul 08 23:51:08.926248 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:08.926224 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-ch4vt_87e5c0f3-28ba-402e-b5a9-0a58471e4438/kube-rbac-proxy-main/0.log" Jul 08 23:51:08.947881 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:08.947844 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-ch4vt_87e5c0f3-28ba-402e-b5a9-0a58471e4438/kube-rbac-proxy-self/0.log" Jul 08 23:51:08.974305 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:08.974281 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-56f85d5559-ptcx5_0e0abd9c-ef81-46a9-b89a-07e09dd07a26/metrics-server/0.log" Jul 08 23:51:09.117407 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:09.117368 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p22db_0af83348-5df5-4630-8277-608d0a3efbe3/node-exporter/0.log" Jul 08 23:51:09.139370 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:09.139291 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p22db_0af83348-5df5-4630-8277-608d0a3efbe3/kube-rbac-proxy/0.log" Jul 08 23:51:09.161623 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:09.161603 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p22db_0af83348-5df5-4630-8277-608d0a3efbe3/init-textfile/0.log" Jul 08 23:51:09.350108 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:09.350084 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_601dde00-b03a-4c2f-b9f0-5c986b49e28b/prometheus/0.log" Jul 08 23:51:09.370105 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:09.370079 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_601dde00-b03a-4c2f-b9f0-5c986b49e28b/config-reloader/0.log" Jul 08 23:51:09.391541 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:09.391463 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_601dde00-b03a-4c2f-b9f0-5c986b49e28b/thanos-sidecar/0.log" Jul 08 23:51:09.412551 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:09.412516 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_601dde00-b03a-4c2f-b9f0-5c986b49e28b/kube-rbac-proxy-web/0.log" Jul 08 23:51:09.433108 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:09.433088 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_601dde00-b03a-4c2f-b9f0-5c986b49e28b/kube-rbac-proxy/0.log" Jul 08 23:51:09.453838 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:09.453800 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_601dde00-b03a-4c2f-b9f0-5c986b49e28b/kube-rbac-proxy-thanos/0.log" Jul 08 23:51:09.476452 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:09.476432 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_601dde00-b03a-4c2f-b9f0-5c986b49e28b/init-config-reloader/0.log" Jul 08 23:51:09.546290 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:09.546264 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-4zvwz_e54f7ee6-be49-4870-8f06-2ff9131687ea/prometheus-operator-admission-webhook/0.log" Jul 08 23:51:09.579960 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:09.579939 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-f7558f49c-5lkwv_c030fba1-1d8f-4020-b581-d7cdc53d226a/telemeter-client/0.log" Jul 08 23:51:09.600740 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:09.600723 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-f7558f49c-5lkwv_c030fba1-1d8f-4020-b581-d7cdc53d226a/reload/0.log" Jul 08 23:51:09.621360 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:09.621321 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-f7558f49c-5lkwv_c030fba1-1d8f-4020-b581-d7cdc53d226a/kube-rbac-proxy/0.log" Jul 08 23:51:10.835904 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:10.835846 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-j7ds6_5713a5a1-749f-48ca-a02f-dc9579c86957/networking-console-plugin/0.log" Jul 08 23:51:11.028835 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.028801 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bcsht/perf-node-gather-daemonset-vvf8j"] Jul 08 23:51:11.029196 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.029183 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="182a7513-785d-41c9-905a-bdcda98313c9" containerName="cleanup" Jul 08 23:51:11.029267 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.029199 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="182a7513-785d-41c9-905a-bdcda98313c9" containerName="cleanup" Jul 08 23:51:11.029267 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.029219 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="504e4a4c-8302-470e-9646-cdc8eec63679" containerName="cleanup" Jul 08 23:51:11.029267 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.029228 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="504e4a4c-8302-470e-9646-cdc8eec63679" containerName="cleanup" Jul 08 23:51:11.029267 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.029251 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5967e69e-2aab-44a7-8588-ecc137c8ff7a" containerName="cleanup" Jul 08 23:51:11.029267 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.029260 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5967e69e-2aab-44a7-8588-ecc137c8ff7a" containerName="cleanup" Jul 08 23:51:11.029508 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.029362 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5967e69e-2aab-44a7-8588-ecc137c8ff7a" containerName="cleanup" Jul 08 23:51:11.029508 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.029380 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="504e4a4c-8302-470e-9646-cdc8eec63679" containerName="cleanup" Jul 08 23:51:11.029508 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.029391 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="182a7513-785d-41c9-905a-bdcda98313c9" containerName="cleanup" Jul 08 23:51:11.032501 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.032487 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-vvf8j" Jul 08 23:51:11.034794 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.034776 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bcsht\"/\"kube-root-ca.crt\"" Jul 08 23:51:11.035607 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.035590 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bcsht\"/\"openshift-service-ca.crt\"" Jul 08 23:51:11.035705 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.035591 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bcsht\"/\"default-dockercfg-twmx9\"" Jul 08 23:51:11.041649 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.041627 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bcsht/perf-node-gather-daemonset-vvf8j"] Jul 08 23:51:11.198935 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.198814 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3aefc9d3-5567-4313-907c-bd9725f86673-lib-modules\") pod \"perf-node-gather-daemonset-vvf8j\" (UID: \"3aefc9d3-5567-4313-907c-bd9725f86673\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-vvf8j" Jul 08 23:51:11.198935 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.198856 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3aefc9d3-5567-4313-907c-bd9725f86673-proc\") pod \"perf-node-gather-daemonset-vvf8j\" (UID: \"3aefc9d3-5567-4313-907c-bd9725f86673\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-vvf8j" Jul 08 23:51:11.199154 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.198971 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3aefc9d3-5567-4313-907c-bd9725f86673-sys\") pod \"perf-node-gather-daemonset-vvf8j\" (UID: \"3aefc9d3-5567-4313-907c-bd9725f86673\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-vvf8j" Jul 08 23:51:11.199154 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.199030 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml875\" (UniqueName: \"kubernetes.io/projected/3aefc9d3-5567-4313-907c-bd9725f86673-kube-api-access-ml875\") pod \"perf-node-gather-daemonset-vvf8j\" (UID: \"3aefc9d3-5567-4313-907c-bd9725f86673\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-vvf8j" Jul 08 23:51:11.199154 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.199070 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3aefc9d3-5567-4313-907c-bd9725f86673-podres\") pod \"perf-node-gather-daemonset-vvf8j\" (UID: \"3aefc9d3-5567-4313-907c-bd9725f86673\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-vvf8j" Jul 08 23:51:11.299491 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.299461 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml875\" (UniqueName: \"kubernetes.io/projected/3aefc9d3-5567-4313-907c-bd9725f86673-kube-api-access-ml875\") pod \"perf-node-gather-daemonset-vvf8j\" (UID: \"3aefc9d3-5567-4313-907c-bd9725f86673\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-vvf8j" Jul 08 23:51:11.299665 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.299500 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3aefc9d3-5567-4313-907c-bd9725f86673-podres\") pod \"perf-node-gather-daemonset-vvf8j\" (UID: \"3aefc9d3-5567-4313-907c-bd9725f86673\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-vvf8j" Jul 08 23:51:11.299665 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.299614 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3aefc9d3-5567-4313-907c-bd9725f86673-podres\") pod \"perf-node-gather-daemonset-vvf8j\" (UID: \"3aefc9d3-5567-4313-907c-bd9725f86673\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-vvf8j" Jul 08 23:51:11.299665 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.299618 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3aefc9d3-5567-4313-907c-bd9725f86673-lib-modules\") pod \"perf-node-gather-daemonset-vvf8j\" (UID: \"3aefc9d3-5567-4313-907c-bd9725f86673\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-vvf8j" Jul 08 23:51:11.299665 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.299650 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3aefc9d3-5567-4313-907c-bd9725f86673-proc\") pod \"perf-node-gather-daemonset-vvf8j\" (UID: \"3aefc9d3-5567-4313-907c-bd9725f86673\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-vvf8j" Jul 08 23:51:11.299867 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.299710 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3aefc9d3-5567-4313-907c-bd9725f86673-sys\") pod \"perf-node-gather-daemonset-vvf8j\" (UID: \"3aefc9d3-5567-4313-907c-bd9725f86673\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-vvf8j" Jul 08 23:51:11.299867 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.299742 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3aefc9d3-5567-4313-907c-bd9725f86673-lib-modules\") pod \"perf-node-gather-daemonset-vvf8j\" (UID: \"3aefc9d3-5567-4313-907c-bd9725f86673\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-vvf8j" Jul 08 23:51:11.299867 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.299778 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3aefc9d3-5567-4313-907c-bd9725f86673-sys\") pod \"perf-node-gather-daemonset-vvf8j\" (UID: \"3aefc9d3-5567-4313-907c-bd9725f86673\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-vvf8j" Jul 08 23:51:11.299867 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.299793 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3aefc9d3-5567-4313-907c-bd9725f86673-proc\") pod \"perf-node-gather-daemonset-vvf8j\" (UID: \"3aefc9d3-5567-4313-907c-bd9725f86673\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-vvf8j" Jul 08 23:51:11.309412 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.309394 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml875\" (UniqueName: \"kubernetes.io/projected/3aefc9d3-5567-4313-907c-bd9725f86673-kube-api-access-ml875\") pod \"perf-node-gather-daemonset-vvf8j\" (UID: \"3aefc9d3-5567-4313-907c-bd9725f86673\") " pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-vvf8j" Jul 08 23:51:11.343837 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.343812 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-vvf8j" Jul 08 23:51:11.471042 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.471015 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bcsht/perf-node-gather-daemonset-vvf8j"] Jul 08 23:51:11.472944 ip-10-0-133-37 kubenswrapper[2572]: W0708 23:51:11.472887 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3aefc9d3_5567_4313_907c_bd9725f86673.slice/crio-250915621c9873bba8bc7c26f8faa71eabea4b834535dc0cb21342aaff198dba WatchSource:0}: Error finding container 250915621c9873bba8bc7c26f8faa71eabea4b834535dc0cb21342aaff198dba: Status 404 returned error can't find the container with id 250915621c9873bba8bc7c26f8faa71eabea4b834535dc0cb21342aaff198dba Jul 08 23:51:11.825035 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.825004 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-vvf8j" event={"ID":"3aefc9d3-5567-4313-907c-bd9725f86673","Type":"ContainerStarted","Data":"c2cec3b81022fe68fcc917ed98adcffb164a7b841a9da74f39b66b75980dcbc5"} Jul 08 23:51:11.825209 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.825050 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-vvf8j" event={"ID":"3aefc9d3-5567-4313-907c-bd9725f86673","Type":"ContainerStarted","Data":"250915621c9873bba8bc7c26f8faa71eabea4b834535dc0cb21342aaff198dba"} Jul 08 23:51:11.825209 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.825122 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-vvf8j" Jul 08 23:51:11.842045 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:11.842001 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-vvf8j" podStartSLOduration=0.841986632 podStartE2EDuration="841.986632ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:51:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:51:11.839825183 +0000 UTC m=+2627.999108692" watchObservedRunningTime="2026-07-08 23:51:11.841986632 +0000 UTC m=+2628.001270140" Jul 08 23:51:13.549387 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:13.549360 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4zw4w_0f505b62-231b-46d0-b4f7-214081f12923/dns/0.log" Jul 08 23:51:13.570751 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:13.570712 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4zw4w_0f505b62-231b-46d0-b4f7-214081f12923/kube-rbac-proxy/0.log" Jul 08 23:51:13.710489 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:13.710461 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pfq7d_68fda8d2-5fe9-40a0-8d69-a8ff51d15e23/dns-node-resolver/0.log" Jul 08 23:51:14.348986 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:14.348957 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-42qwx_4f14c98f-3358-494e-bde0-76dd7436a833/node-ca/0.log" Jul 08 23:51:15.472678 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:15.472649 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mswnx_469a1a3e-3527-4624-9a7b-85236d2db4c7/discovery/0.log" Jul 08 23:51:15.696379 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:15.696351 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-k7gls_09c667b3-8fed-4dc6-9cc7-9269be6e253f/payload-processing/0.log" Jul 08 23:51:16.365877 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:16.365846 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l5z9c_8c67c695-4fa0-4d4d-a8c1-2e24e1f3012c/serve-healthcheck-canary/0.log" Jul 08 23:51:16.885486 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:16.885462 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g4c2s_a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3/kube-rbac-proxy/0.log" Jul 08 23:51:16.907290 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:16.907272 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g4c2s_a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3/exporter/0.log" Jul 08 23:51:16.928087 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:16.928055 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g4c2s_a1bea9e7-7b18-4a97-a6f1-ec3d5eb8e9a3/extractor/0.log" Jul 08 23:51:17.840539 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:17.840512 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bcsht/perf-node-gather-daemonset-vvf8j" Jul 08 23:51:19.746163 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:19.746128 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b86895794-mzzr5_1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e/manager/0.log" Jul 08 23:51:19.764110 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:19.764087 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b86895794-mzzr5_1ccc88a9-f68d-4bd0-a0cb-73ef5b03955e/copy-manifests/0.log" Jul 08 23:51:21.214009 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:21.213985 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-56bdb7f565-nm95f_2fee4259-b52a-474e-ac1f-8fe0b8eb1615/manager/0.log" Jul 08 23:51:21.240283 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:21.240260 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-986wx_da380e20-b996-4a17-af36-4dc88dc9dc5c/openshift-lws-operator/0.log" Jul 08 23:51:21.839146 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:21.839101 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mswnx_469a1a3e-3527-4624-9a7b-85236d2db4c7/discovery/0.log" Jul 08 23:51:22.031585 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:22.031557 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-k7gls_09c667b3-8fed-4dc6-9cc7-9269be6e253f/payload-processing/0.log" Jul 08 23:51:23.291464 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:23.291423 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mswnx_469a1a3e-3527-4624-9a7b-85236d2db4c7/discovery/0.log" Jul 08 23:51:23.486574 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:23.486525 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-k7gls_09c667b3-8fed-4dc6-9cc7-9269be6e253f/payload-processing/0.log" Jul 08 23:51:26.295104 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:26.295077 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-rw9l7_54c921e6-9f3c-477f-92ca-7c4c49fdf26d/migrator/0.log" Jul 08 23:51:26.314099 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:26.314070 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-rw9l7_54c921e6-9f3c-477f-92ca-7c4c49fdf26d/graceful-termination/0.log" Jul 08 23:51:27.894839 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:27.894812 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zwfwd_563c7484-0036-46e3-81fd-e0809d864d8c/kube-multus-additional-cni-plugins/0.log" Jul 08 23:51:27.914611 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:27.914587 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zwfwd_563c7484-0036-46e3-81fd-e0809d864d8c/egress-router-binary-copy/0.log" Jul 08 23:51:27.934443 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:27.934417 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zwfwd_563c7484-0036-46e3-81fd-e0809d864d8c/cni-plugins/0.log" Jul 08 23:51:27.954747 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:27.954726 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zwfwd_563c7484-0036-46e3-81fd-e0809d864d8c/bond-cni-plugin/0.log" Jul 08 23:51:27.974006 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:27.973988 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zwfwd_563c7484-0036-46e3-81fd-e0809d864d8c/routeoverride-cni/0.log" Jul 08 23:51:27.993459 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:27.993435 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zwfwd_563c7484-0036-46e3-81fd-e0809d864d8c/whereabouts-cni-bincopy/0.log" Jul 08 23:51:28.014658 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:28.014636 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zwfwd_563c7484-0036-46e3-81fd-e0809d864d8c/whereabouts-cni/0.log" Jul 08 23:51:28.117160 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:28.117134 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wvtzz_773549fb-9a77-46a7-bc5e-c7d401f89e95/kube-multus/0.log" Jul 08 23:51:28.178469 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:28.178408 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kwcdm_3d290d52-819f-4ece-bc8e-11ce3dbb4d29/network-metrics-daemon/0.log" Jul 08 23:51:28.196693 ip-10-0-133-37 kubenswrapper[2572]: I0708 23:51:28.196673 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kwcdm_3d290d52-819f-4ece-bc8e-11ce3dbb4d29/kube-rbac-proxy/0.log"