Jun 08 12:04:38.549600 ip-10-0-133-35 systemd[1]: Starting Kubernetes Kubelet... Jun 08 12:04:38.968925 ip-10-0-133-35 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 12:04:38.968925 ip-10-0-133-35 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 12:04:38.968925 ip-10-0-133-35 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 12:04:38.968925 ip-10-0-133-35 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 12:04:38.968925 ip-10-0-133-35 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 12:04:38.970063 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.969789 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 12:04:38.974133 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974116 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:04:38.974133 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974132 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:04:38.974197 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974136 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:04:38.974197 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974139 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:04:38.974197 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974142 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:04:38.974197 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974147 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:04:38.974197 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974151 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:04:38.974197 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974154 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:04:38.974197 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974157 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:04:38.974197 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974160 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:04:38.974197 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974163 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:04:38.974197 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974165 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:04:38.974197 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974168 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:04:38.974197 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974171 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:04:38.974197 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974173 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:04:38.974197 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974176 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:04:38.974197 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974178 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:04:38.974197 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974181 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:04:38.974197 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974183 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:04:38.974197 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974186 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:04:38.974197 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974189 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:04:38.974197 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974191 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:04:38.974774 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974194 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:04:38.974774 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974196 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:04:38.974774 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974199 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:04:38.974774 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974202 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:04:38.974774 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974206 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:04:38.974774 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974209 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:04:38.974774 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974211 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:04:38.974774 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974214 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:04:38.974774 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974216 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:04:38.974774 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974219 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:04:38.974774 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974221 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:04:38.974774 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974225 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:04:38.974774 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974227 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:04:38.974774 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974230 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:04:38.974774 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974232 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:04:38.974774 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974234 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:04:38.974774 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974237 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:04:38.974774 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974239 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:04:38.974774 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974242 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:04:38.974774 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974244 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:04:38.975605 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974247 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:04:38.975605 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974249 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:04:38.975605 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974251 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:04:38.975605 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974254 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:04:38.975605 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974257 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:04:38.975605 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974261 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:04:38.975605 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974264 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:04:38.975605 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974267 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:04:38.975605 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974270 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:04:38.975605 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974273 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:04:38.975605 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974277 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:04:38.975605 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974279 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:04:38.975605 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974282 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:04:38.975605 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974284 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:04:38.975605 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974287 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:04:38.975605 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974289 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:04:38.975605 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974292 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:04:38.975605 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974295 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:04:38.975605 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974297 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:04:38.976159 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974300 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:04:38.976159 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974302 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:04:38.976159 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974326 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:04:38.976159 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974329 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:04:38.976159 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974332 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:04:38.976159 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974335 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:04:38.976159 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974338 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:04:38.976159 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974340 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:04:38.976159 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974343 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:04:38.976159 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974346 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:04:38.976159 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974348 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:04:38.976159 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974350 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:04:38.976159 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974353 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:04:38.976159 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974355 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:04:38.976159 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974358 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:04:38.976159 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974360 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:04:38.976159 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974362 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:04:38.976159 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974365 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:04:38.976159 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974367 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:04:38.976159 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974370 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:04:38.976654 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974372 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:04:38.976654 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974376 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:04:38.976654 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974378 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:04:38.976654 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974381 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:04:38.976654 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974384 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:04:38.976654 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974386 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:04:38.976654 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974389 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:04:38.976654 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974392 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:04:38.976654 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974394 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:04:38.976654 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974397 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:04:38.976654 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974400 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:04:38.976654 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974403 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:04:38.976654 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974406 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:04:38.976654 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974409 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:04:38.976654 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974412 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:04:38.976654 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974414 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:04:38.976654 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974417 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:04:38.976654 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.974420 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:04:38.978939 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.978922 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:04:38.978939 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.978937 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:04:38.978939 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.978941 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:04:38.979064 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.978944 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:04:38.979064 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.978948 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:04:38.979064 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.978951 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:04:38.979064 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.978953 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:04:38.979064 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.978956 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:04:38.979064 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.978958 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:04:38.979064 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.978961 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:04:38.979064 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.978964 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:04:38.979064 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.978967 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:04:38.979064 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.978970 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:04:38.979064 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.978972 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:04:38.979064 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.978976 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:04:38.979064 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.978978 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:04:38.979064 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.978980 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:04:38.979064 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.978983 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:04:38.979064 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.978985 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:04:38.979064 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.978988 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:04:38.979064 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.978990 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:04:38.979064 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.978992 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:04:38.979064 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.978995 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:04:38.979563 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.978997 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:04:38.979563 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979000 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:04:38.979563 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979003 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:04:38.979563 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979005 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:04:38.979563 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979008 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:04:38.979563 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979012 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:04:38.979563 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979017 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:04:38.979563 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979020 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:04:38.979563 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979023 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:04:38.979563 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979026 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:04:38.979563 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979028 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:04:38.979563 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979031 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:04:38.979563 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979033 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:04:38.979563 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979037 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:04:38.979563 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979040 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:04:38.979563 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979043 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:04:38.979563 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979047 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:04:38.979563 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979050 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:04:38.979563 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979053 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:04:38.980029 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979055 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:04:38.980029 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979058 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:04:38.980029 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979060 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:04:38.980029 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979063 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:04:38.980029 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979065 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:04:38.980029 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979068 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:04:38.980029 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979071 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:04:38.980029 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979073 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:04:38.980029 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979076 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:04:38.980029 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979079 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:04:38.980029 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979082 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:04:38.980029 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979085 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:04:38.980029 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979087 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:04:38.980029 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979089 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:04:38.980029 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979092 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:04:38.980029 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979094 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:04:38.980029 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979097 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:04:38.980029 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979100 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:04:38.980029 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979102 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:04:38.980029 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979105 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:04:38.980586 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979107 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:04:38.980586 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979109 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:04:38.980586 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979112 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:04:38.980586 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979114 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:04:38.980586 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979117 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:04:38.980586 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979119 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:04:38.980586 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979122 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:04:38.980586 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979126 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:04:38.980586 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979128 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:04:38.980586 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979131 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:04:38.980586 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979133 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:04:38.980586 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979135 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:04:38.980586 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979138 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:04:38.980586 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979141 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:04:38.980586 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979143 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:04:38.980586 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979146 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:04:38.980586 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979148 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:04:38.980586 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979150 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:04:38.980586 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979153 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:04:38.980586 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979155 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:04:38.981095 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979158 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:04:38.981095 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979161 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:04:38.981095 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979163 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:04:38.981095 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979166 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:04:38.981095 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979168 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:04:38.981095 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979171 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:04:38.981095 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979174 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:04:38.981095 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979177 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:04:38.981095 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979179 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:04:38.981095 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979182 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:04:38.981095 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979184 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:04:38.981095 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979187 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:04:38.981095 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979189 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:04:38.981095 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979191 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:04:38.981095 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979194 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:04:38.981095 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979197 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:04:38.981095 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979201 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:04:38.981095 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979564 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:04:38.981095 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979570 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:04:38.981600 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979574 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:04:38.981600 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979578 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:04:38.981600 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979581 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:04:38.981600 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979584 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:04:38.981600 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979587 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:04:38.981600 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979589 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:04:38.981600 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979592 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:04:38.981600 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979594 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:04:38.981600 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979597 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:04:38.981600 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979600 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:04:38.981600 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979602 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:04:38.981600 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979604 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:04:38.981600 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979607 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:04:38.981600 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979610 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:04:38.981600 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979613 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:04:38.981600 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979615 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:04:38.981600 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979619 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:04:38.981600 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979623 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:04:38.981600 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979626 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:04:38.982041 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979629 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:04:38.982041 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979631 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:04:38.982041 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979634 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:04:38.982041 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979637 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:04:38.982041 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979640 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:04:38.982041 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979642 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:04:38.982041 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979645 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:04:38.982041 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979647 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:04:38.982041 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979650 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:04:38.982041 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979653 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:04:38.982041 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979656 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:04:38.982041 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979659 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:04:38.982041 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979661 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:04:38.982041 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979664 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:04:38.982041 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979666 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:04:38.982041 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979669 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:04:38.982041 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979671 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:04:38.982041 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979674 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:04:38.982041 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979676 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:04:38.982041 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979679 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:04:38.982522 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979681 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:04:38.982522 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979684 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:04:38.982522 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979687 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:04:38.982522 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979689 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:04:38.982522 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979692 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:04:38.982522 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979694 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:04:38.982522 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979697 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:04:38.982522 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979699 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:04:38.982522 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979703 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:04:38.982522 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979705 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:04:38.982522 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979709 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:04:38.982522 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979711 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:04:38.982522 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979713 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:04:38.982522 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979716 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:04:38.982522 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979719 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:04:38.982522 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979721 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:04:38.982522 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979723 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:04:38.982522 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979726 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:04:38.982522 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979728 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:04:38.982522 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979731 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:04:38.983023 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979734 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:04:38.983023 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979736 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:04:38.983023 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979739 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:04:38.983023 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979742 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:04:38.983023 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979744 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:04:38.983023 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979747 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:04:38.983023 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979750 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:04:38.983023 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979754 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:04:38.983023 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979757 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:04:38.983023 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979759 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:04:38.983023 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979762 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:04:38.983023 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979766 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:04:38.983023 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979770 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:04:38.983023 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979773 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:04:38.983023 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979775 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:04:38.983023 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979778 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:04:38.983023 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979780 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:04:38.983023 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979783 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:04:38.983023 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979786 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:04:38.983500 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979788 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:04:38.983500 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979791 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:04:38.983500 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979794 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:04:38.983500 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979796 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:04:38.983500 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979799 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:04:38.983500 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979801 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:04:38.983500 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979803 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:04:38.983500 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979806 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:04:38.983500 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979808 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:04:38.983500 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979811 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:04:38.983500 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979814 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:04:38.983500 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979816 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:04:38.983500 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979819 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:04:38.983500 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979821 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:04:38.983500 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979824 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:04:38.983500 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979826 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:04:38.983500 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979829 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:04:38.983500 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979831 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:04:38.983500 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.979834 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:04:38.983500 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.979913 2565 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 12:04:38.983958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.979920 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 12:04:38.983958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.979925 2565 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 12:04:38.983958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.979929 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 12:04:38.983958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.979933 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 12:04:38.983958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.979936 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 12:04:38.983958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.979940 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 12:04:38.983958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.979944 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 12:04:38.983958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.979947 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 12:04:38.983958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.979950 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 12:04:38.983958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.979953 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 12:04:38.983958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.979956 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 12:04:38.983958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.979959 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 12:04:38.983958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.979963 2565 flags.go:64] FLAG: --cgroup-root="" Jun 08 12:04:38.983958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.979966 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 12:04:38.983958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.979968 2565 flags.go:64] FLAG: --client-ca-file="" Jun 08 12:04:38.983958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.979972 2565 flags.go:64] FLAG: --cloud-provider="external" Jun 08 12:04:38.983958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.979975 2565 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 12:04:38.983958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.979979 2565 flags.go:64] FLAG: --cluster-domain="" Jun 08 12:04:38.983958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.979982 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 12:04:38.983958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.979985 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 12:04:38.983958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.979988 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 12:04:38.983958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.979992 2565 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 12:04:38.983958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980000 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 12:04:38.983958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980002 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 12:04:38.984566 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980005 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 12:04:38.984566 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980008 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 12:04:38.984566 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980011 2565 flags.go:64] FLAG: --contention-profiling="false" Jun 08 12:04:38.984566 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980014 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 12:04:38.984566 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980017 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 12:04:38.984566 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980020 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 12:04:38.984566 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980023 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 12:04:38.984566 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980027 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 12:04:38.984566 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980029 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 12:04:38.984566 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980032 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 12:04:38.984566 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980035 2565 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 12:04:38.984566 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980038 2565 flags.go:64] FLAG: --enable-server="true" Jun 08 12:04:38.984566 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980041 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 12:04:38.984566 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980045 2565 flags.go:64] FLAG: --event-burst="100" Jun 08 12:04:38.984566 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980048 2565 flags.go:64] FLAG: --event-qps="50" Jun 08 12:04:38.984566 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980051 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 12:04:38.984566 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980054 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 12:04:38.984566 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980057 2565 flags.go:64] FLAG: --eviction-hard="" Jun 08 12:04:38.984566 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980064 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 12:04:38.984566 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980067 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 12:04:38.984566 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980070 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 12:04:38.984566 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980073 2565 flags.go:64] FLAG: --eviction-soft="" Jun 08 12:04:38.984566 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980075 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 12:04:38.984566 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980078 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 12:04:38.984566 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980082 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 12:04:38.985168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980085 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 12:04:38.985168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980087 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 12:04:38.985168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980090 2565 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 12:04:38.985168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980093 2565 flags.go:64] FLAG: --feature-gates="" Jun 08 12:04:38.985168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980097 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 12:04:38.985168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980100 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 12:04:38.985168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980103 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 12:04:38.985168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980106 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 12:04:38.985168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980109 2565 flags.go:64] FLAG: --healthz-port="10248" Jun 08 12:04:38.985168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980111 2565 flags.go:64] FLAG: --help="false" Jun 08 12:04:38.985168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980114 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-133-35.ec2.internal" Jun 08 12:04:38.985168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980117 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 12:04:38.985168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980120 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 12:04:38.985168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980122 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 12:04:38.985168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980125 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 12:04:38.985168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980129 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 12:04:38.985168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980131 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 12:04:38.985168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980134 2565 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 12:04:38.985168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980137 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 12:04:38.985168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980140 2565 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 12:04:38.985168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980143 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 12:04:38.985168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980146 2565 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 12:04:38.985168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980148 2565 flags.go:64] FLAG: --kube-reserved="" Jun 08 12:04:38.985168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980151 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 12:04:38.985808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980154 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 12:04:38.985808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980157 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 12:04:38.985808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980160 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 12:04:38.985808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980162 2565 flags.go:64] FLAG: --lock-file="" Jun 08 12:04:38.985808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980165 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 12:04:38.985808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980168 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 12:04:38.985808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980171 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 12:04:38.985808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980176 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 12:04:38.985808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980179 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 12:04:38.985808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980182 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 12:04:38.985808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980185 2565 flags.go:64] FLAG: --logging-format="text" Jun 08 12:04:38.985808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980190 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 12:04:38.985808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980193 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 12:04:38.985808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980196 2565 flags.go:64] FLAG: --manifest-url="" Jun 08 12:04:38.985808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980199 2565 flags.go:64] FLAG: --manifest-url-header="" Jun 08 12:04:38.985808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980203 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 12:04:38.985808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980206 2565 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 12:04:38.985808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980210 2565 flags.go:64] FLAG: --max-pods="110" Jun 08 12:04:38.985808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980213 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 12:04:38.985808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980216 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 12:04:38.985808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980218 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 12:04:38.985808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980221 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 12:04:38.985808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980224 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 12:04:38.985808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980227 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 12:04:38.985808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980229 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 12:04:38.986418 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980236 2565 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 12:04:38.986418 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980239 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 12:04:38.986418 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980242 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 12:04:38.986418 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980245 2565 flags.go:64] FLAG: --pod-cidr="" Jun 08 12:04:38.986418 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980247 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 12:04:38.986418 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980252 2565 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 12:04:38.986418 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980255 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 12:04:38.986418 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980261 2565 flags.go:64] FLAG: --pods-per-core="0" Jun 08 12:04:38.986418 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980264 2565 flags.go:64] FLAG: --port="10250" Jun 08 12:04:38.986418 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980267 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 12:04:38.986418 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980270 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0eb23e0fd144b54aa" Jun 08 12:04:38.986418 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980273 2565 flags.go:64] FLAG: --qos-reserved="" Jun 08 12:04:38.986418 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980276 2565 flags.go:64] FLAG: --read-only-port="10255" Jun 08 12:04:38.986418 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980279 2565 flags.go:64] FLAG: --register-node="true" Jun 08 12:04:38.986418 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980281 2565 flags.go:64] FLAG: --register-with-taints="" Jun 08 12:04:38.986418 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980285 2565 flags.go:64] FLAG: --registry-burst="10" Jun 08 12:04:38.986418 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980288 2565 flags.go:64] FLAG: --registry-qps="5" Jun 08 12:04:38.986418 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980291 2565 flags.go:64] FLAG: --reserved-cpus="" Jun 08 12:04:38.986418 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980297 2565 flags.go:64] FLAG: --reserved-memory="" Jun 08 12:04:38.986418 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980301 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 12:04:38.986418 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980320 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 12:04:38.986418 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980323 2565 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 12:04:38.986418 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980326 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 12:04:38.986418 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980329 2565 flags.go:64] FLAG: --runonce="false" Jun 08 12:04:38.986418 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980332 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 12:04:38.987008 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980335 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 12:04:38.987008 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980338 2565 flags.go:64] FLAG: --seccomp-default="false" Jun 08 12:04:38.987008 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980342 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 12:04:38.987008 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980344 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 12:04:38.987008 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980347 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 12:04:38.987008 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980350 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 12:04:38.987008 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980353 2565 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 12:04:38.987008 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980356 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 12:04:38.987008 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980359 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 12:04:38.987008 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980362 2565 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 12:04:38.987008 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980364 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 12:04:38.987008 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980367 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 12:04:38.987008 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980370 2565 flags.go:64] FLAG: --system-cgroups="" Jun 08 12:04:38.987008 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980373 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 12:04:38.987008 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980379 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 12:04:38.987008 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980382 2565 flags.go:64] FLAG: --tls-cert-file="" Jun 08 12:04:38.987008 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980385 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 12:04:38.987008 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980389 2565 flags.go:64] FLAG: --tls-min-version="" Jun 08 12:04:38.987008 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980392 2565 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 12:04:38.987008 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980394 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 12:04:38.987008 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980397 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 12:04:38.987008 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980400 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 12:04:38.987008 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980403 2565 flags.go:64] FLAG: --v="2" Jun 08 12:04:38.987008 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980407 2565 flags.go:64] FLAG: --version="false" Jun 08 12:04:38.987008 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980411 2565 flags.go:64] FLAG: --vmodule="" Jun 08 12:04:38.987645 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980416 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 12:04:38.987645 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980419 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 12:04:38.987645 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980537 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:04:38.987645 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980541 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:04:38.987645 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980545 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:04:38.987645 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980548 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:04:38.987645 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980550 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:04:38.987645 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980553 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:04:38.987645 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980556 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:04:38.987645 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980558 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:04:38.987645 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980561 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:04:38.987645 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980563 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:04:38.987645 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980566 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:04:38.987645 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980572 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:04:38.987645 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980575 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:04:38.987645 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980578 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:04:38.987645 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980583 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:04:38.987645 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980587 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:04:38.987645 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980592 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:04:38.987645 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980597 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:04:38.988120 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980599 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:04:38.988120 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980604 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:04:38.988120 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980607 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:04:38.988120 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980610 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:04:38.988120 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980612 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:04:38.988120 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980615 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:04:38.988120 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980618 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:04:38.988120 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980620 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:04:38.988120 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980623 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:04:38.988120 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980625 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:04:38.988120 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980628 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:04:38.988120 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980630 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:04:38.988120 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980635 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:04:38.988120 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980637 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:04:38.988120 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980641 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:04:38.988120 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980645 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:04:38.988120 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980648 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:04:38.988120 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980651 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:04:38.988120 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980655 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:04:38.988585 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980659 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:04:38.988585 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980661 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:04:38.988585 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980664 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:04:38.988585 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980666 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:04:38.988585 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980669 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:04:38.988585 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980671 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:04:38.988585 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980674 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:04:38.988585 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980676 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:04:38.988585 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980679 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:04:38.988585 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980682 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:04:38.988585 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980684 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:04:38.988585 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980687 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:04:38.988585 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980689 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:04:38.988585 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980692 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:04:38.988585 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980695 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:04:38.988585 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980698 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:04:38.988585 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980700 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:04:38.988585 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980702 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:04:38.988585 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980705 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:04:38.988585 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980707 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:04:38.989051 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980710 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:04:38.989051 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980712 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:04:38.989051 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980715 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:04:38.989051 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980717 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:04:38.989051 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980720 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:04:38.989051 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980723 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:04:38.989051 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980729 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:04:38.989051 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980732 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:04:38.989051 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980735 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:04:38.989051 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980737 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:04:38.989051 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980740 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:04:38.989051 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980742 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:04:38.989051 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980744 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:04:38.989051 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980747 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:04:38.989051 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980749 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:04:38.989051 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980752 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:04:38.989051 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980755 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:04:38.989051 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980759 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:04:38.989051 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980762 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:04:38.989516 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980764 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:04:38.989516 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980768 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:04:38.989516 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980771 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:04:38.989516 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980774 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:04:38.989516 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980776 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:04:38.989516 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980779 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:04:38.989516 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980781 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:04:38.989516 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980785 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:04:38.989516 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980788 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:04:38.989516 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980790 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:04:38.989516 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980793 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:04:38.989516 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980795 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:04:38.989516 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980798 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:04:38.989516 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980800 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:04:38.989516 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980803 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:04:38.989516 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980805 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:04:38.989516 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980808 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:04:38.989516 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980810 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:04:38.989516 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980814 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:04:38.989516 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980816 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:04:38.989986 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980819 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:04:38.989986 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980822 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:04:38.989986 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.980824 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:04:38.989986 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.980830 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 12:04:38.989986 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.988342 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 12:04:38.989986 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.988356 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 12:04:38.989986 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.989384 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 12:04:38.989986 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.989393 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 12:04:38.989986 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989454 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:04:38.989986 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989459 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:04:38.989986 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989462 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:04:38.989986 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989466 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:04:38.989986 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989468 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:04:38.989986 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989471 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:04:38.990350 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989476 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:04:38.990350 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989479 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:04:38.990350 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989483 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:04:38.990350 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989486 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:04:38.990350 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989489 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:04:38.990350 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989492 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:04:38.990350 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989495 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:04:38.990350 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989498 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:04:38.990350 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989501 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:04:38.990350 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989504 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:04:38.990350 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989507 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:04:38.990350 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989510 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:04:38.990350 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989513 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:04:38.990350 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989516 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:04:38.990350 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989519 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:04:38.990350 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989522 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:04:38.990350 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989525 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:04:38.990350 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989528 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:04:38.990350 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989531 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:04:38.990808 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989534 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:04:38.990808 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989537 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:04:38.990808 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989539 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:04:38.990808 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989542 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:04:38.990808 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989545 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:04:38.990808 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989548 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:04:38.990808 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989551 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:04:38.990808 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989553 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:04:38.990808 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989556 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:04:38.990808 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989558 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:04:38.990808 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989561 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:04:38.990808 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989563 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:04:38.990808 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989566 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:04:38.990808 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989569 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:04:38.990808 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989571 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:04:38.990808 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989574 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:04:38.990808 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989576 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:04:38.990808 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989579 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:04:38.990808 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989581 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:04:38.991283 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989584 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:04:38.991283 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989586 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:04:38.991283 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989589 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:04:38.991283 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989592 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:04:38.991283 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989594 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:04:38.991283 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989597 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:04:38.991283 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989599 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:04:38.991283 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989602 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:04:38.991283 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989605 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:04:38.991283 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989607 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:04:38.991283 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989610 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:04:38.991283 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989612 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:04:38.991283 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989615 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:04:38.991283 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989618 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:04:38.991283 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989621 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:04:38.991283 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989623 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:04:38.991283 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989625 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:04:38.991283 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989629 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:04:38.991283 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989632 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:04:38.991283 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989634 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:04:38.991762 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989637 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:04:38.991762 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989639 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:04:38.991762 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989642 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:04:38.991762 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989644 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:04:38.991762 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989647 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:04:38.991762 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989649 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:04:38.991762 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989652 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:04:38.991762 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989654 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:04:38.991762 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989656 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:04:38.991762 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989659 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:04:38.991762 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989663 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:04:38.991762 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989666 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:04:38.991762 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989669 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:04:38.991762 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989672 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:04:38.991762 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989674 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:04:38.991762 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989677 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:04:38.991762 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989679 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:04:38.991762 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989682 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:04:38.991762 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989685 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:04:38.991762 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989688 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:04:38.992234 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989691 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:04:38.992234 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989693 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:04:38.992234 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989696 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:04:38.992234 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989698 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:04:38.992234 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989701 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:04:38.992234 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989703 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:04:38.992234 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989706 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:04:38.992234 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989709 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:04:38.992234 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989711 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:04:38.992234 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989715 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:04:38.992234 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989717 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:04:38.992234 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989720 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:04:38.992234 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989723 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:04:38.992234 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989725 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:04:38.992234 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989728 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:04:38.992616 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.989732 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 12:04:38.992616 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989837 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:04:38.992616 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989841 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:04:38.992616 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989845 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:04:38.992616 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989848 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:04:38.992616 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989851 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:04:38.992616 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989853 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:04:38.992616 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989856 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:04:38.992616 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989873 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:04:38.992616 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989877 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:04:38.992616 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989881 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:04:38.992616 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989884 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:04:38.992616 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989887 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:04:38.992616 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989890 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:04:38.992616 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989893 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:04:38.992968 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989896 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:04:38.992968 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989898 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:04:38.992968 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989901 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:04:38.992968 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989904 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:04:38.992968 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989906 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:04:38.992968 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989910 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:04:38.992968 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989913 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:04:38.992968 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989917 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:04:38.992968 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989919 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:04:38.992968 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989922 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:04:38.992968 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989926 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:04:38.992968 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989929 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:04:38.992968 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989932 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:04:38.992968 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989935 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:04:38.992968 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989938 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:04:38.992968 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989941 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:04:38.992968 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989943 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:04:38.992968 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989946 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:04:38.992968 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989948 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:04:38.993434 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989951 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:04:38.993434 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989953 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:04:38.993434 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989956 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:04:38.993434 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989958 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:04:38.993434 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989961 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:04:38.993434 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989963 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:04:38.993434 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989965 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:04:38.993434 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989968 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:04:38.993434 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989970 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:04:38.993434 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989973 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:04:38.993434 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989975 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:04:38.993434 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989978 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:04:38.993434 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989980 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:04:38.993434 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989982 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:04:38.993434 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989985 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:04:38.993434 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989988 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:04:38.993434 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989991 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:04:38.993434 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989993 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:04:38.993434 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989996 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:04:38.993434 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.989998 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:04:38.993887 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990001 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:04:38.993887 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990003 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:04:38.993887 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990006 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:04:38.993887 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990009 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:04:38.993887 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990012 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:04:38.993887 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990014 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:04:38.993887 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990017 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:04:38.993887 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990019 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:04:38.993887 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990022 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:04:38.993887 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990024 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:04:38.993887 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990027 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:04:38.993887 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990029 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:04:38.993887 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990032 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:04:38.993887 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990035 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:04:38.993887 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990039 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:04:38.993887 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990041 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:04:38.993887 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990044 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:04:38.993887 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990047 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:04:38.993887 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990049 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:04:38.993887 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990052 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:04:38.994360 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990054 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:04:38.994360 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990057 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:04:38.994360 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990059 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:04:38.994360 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990062 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:04:38.994360 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990064 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:04:38.994360 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990067 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:04:38.994360 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990069 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:04:38.994360 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990071 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:04:38.994360 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990073 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:04:38.994360 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990076 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:04:38.994360 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990078 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:04:38.994360 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990082 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:04:38.994360 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990086 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:04:38.994360 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990088 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:04:38.994360 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990091 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:04:38.994360 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990093 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:04:38.994360 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990096 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:04:38.994360 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990099 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:04:38.994360 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990101 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:04:38.994796 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990104 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:04:38.994796 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990106 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:04:38.994796 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990109 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:04:38.994796 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990111 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:04:38.994796 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990114 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:04:38.994796 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990116 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:04:38.994796 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:38.990119 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:04:38.994796 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.990123 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 12:04:38.994796 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.990220 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 12:04:38.994796 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.992376 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 12:04:38.994796 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.993969 2565 server.go:1019] "Starting client certificate rotation" Jun 08 12:04:38.994796 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.994064 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 12:04:38.994796 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.994092 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 12:04:38.996977 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.996964 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 12:04:38.998130 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:38.998112 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 12:04:39.009908 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.009888 2565 log.go:25] "Validated CRI v1 runtime API" Jun 08 12:04:39.012437 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.012422 2565 log.go:25] "Validated CRI v1 image API" Jun 08 12:04:39.013212 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.013193 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 12:04:39.016777 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.016760 2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9f6611bd-a931-46ea-88b0-cee2cd104835:/dev/nvme0n1p3 edf9a987-3e7e-4295-8a5f-44b3c229cfce:/dev/nvme0n1p4] Jun 08 12:04:39.016837 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.016777 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 12:04:39.021615 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.021507 2565 manager.go:216] Machine: {Timestamp:2026-06-08 12:04:39.020330778 +0000 UTC m=+0.348679418 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3200868 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ce9a574bb61130a456e46f65fe5b7 SystemUUID:ec2ce9a5-74bb-6113-0a45-6e46f65fe5b7 BootID:6f226ad5-dd20-448e-afc7-9afd9d9d333c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:28:c5:c0:9d:9b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:28:c5:c0:9d:9b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:87:a6:83:a7:88 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 12:04:39.021615 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.021609 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 12:04:39.021720 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.021682 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 12:04:39.025462 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.025438 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 12:04:39.025582 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.025464 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-35.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 12:04:39.026235 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.026226 2565 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 12:04:39.026264 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.026236 2565 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 12:04:39.026264 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.026244 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 12:04:39.026922 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.026910 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 12:04:39.027947 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.027938 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 12:04:39.031013 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.031001 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 08 12:04:39.031127 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.031118 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 12:04:39.031164 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.031146 2565 kubelet.go:486] "Attempting to sync node with API server" Jun 08 12:04:39.031191 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.031171 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 12:04:39.031191 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.031189 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 12:04:39.031243 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.031201 2565 kubelet.go:398] "Adding apiserver pod source" Jun 08 12:04:39.031243 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.031210 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 12:04:39.031573 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.031561 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 12:04:39.031619 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.031583 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 12:04:39.033613 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.033592 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 12:04:39.034130 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.034116 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 12:04:39.035416 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.035397 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 12:04:39.035512 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.035428 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 12:04:39.037286 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.037273 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 12:04:39.037342 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.037292 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 12:04:39.037342 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.037298 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 12:04:39.037342 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.037318 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 12:04:39.037342 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.037327 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 12:04:39.037342 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.037332 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 12:04:39.037342 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.037340 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 12:04:39.037342 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.037345 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 12:04:39.037527 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.037351 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 12:04:39.037527 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.037357 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 12:04:39.037527 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.037371 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 12:04:39.037527 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.037376 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 12:04:39.038931 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.038917 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 12:04:39.038931 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.038928 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 12:04:39.041894 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.041879 2565 server.go:1268] "Started kubelet" Jun 08 12:04:39.042054 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.042008 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 12:04:39.042167 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.042140 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 12:04:39.042237 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.042190 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 12:04:39.042755 ip-10-0-133-35 systemd[1]: Started Kubernetes Kubelet. Jun 08 12:04:39.043183 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.043072 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-35.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 12:04:39.043286 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:39.043260 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-35.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 12:04:39.046368 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:39.043260 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 12:04:39.046718 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.046687 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 12:04:39.047841 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.047822 2565 server.go:310] "Adding debug handlers to kubelet server" Jun 08 12:04:39.051721 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:39.051694 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 12:04:39.052323 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.052285 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 12:04:39.052323 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.052298 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 12:04:39.052558 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:39.051372 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-35.ec2.internal.18b7198edd944a63 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-35.ec2.internal,UID:ip-10-0-133-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-35.ec2.internal,},FirstTimestamp:2026-06-08 12:04:39.041854051 +0000 UTC m=+0.370202690,LastTimestamp:2026-06-08 12:04:39.041854051 +0000 UTC m=+0.370202690,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-35.ec2.internal,}" Jun 08 12:04:39.052558 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:39.052534 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-35.ec2.internal\" not found" Jun 08 12:04:39.053249 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.053079 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 12:04:39.053249 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.053079 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 12:04:39.053249 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.053103 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 12:04:39.053249 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.053224 2565 reconstruct.go:97] "Volume reconstruction finished" Jun 08 12:04:39.053249 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.053230 2565 reconciler.go:29] "Reconciler: start to sync state" Jun 08 12:04:39.053663 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.053648 2565 factory.go:55] Registering systemd factory Jun 08 12:04:39.053754 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.053687 2565 factory.go:223] Registration of the systemd container factory successfully Jun 08 12:04:39.053906 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.053887 2565 factory.go:153] Registering CRI-O factory Jun 08 12:04:39.053906 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.053906 2565 factory.go:223] Registration of the crio container factory successfully Jun 08 12:04:39.054025 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.053956 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 12:04:39.054025 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.053979 2565 factory.go:103] Registering Raw factory Jun 08 12:04:39.054025 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.053993 2565 manager.go:1196] Started watching for new ooms in manager Jun 08 12:04:39.054381 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.054359 2565 manager.go:349] Starting recovery of all containers Jun 08 12:04:39.060323 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.060279 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 12:04:39.062448 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.062339 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7rwh4" Jun 08 12:04:39.063173 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:39.063090 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-35.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 08 12:04:39.063237 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:39.063172 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 08 12:04:39.063943 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.063925 2565 manager.go:354] Recovery completed Jun 08 12:04:39.067874 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.067860 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:04:39.069609 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.069595 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-35.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:04:39.069675 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.069621 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-35.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:04:39.069675 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.069631 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-35.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:04:39.070028 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.070016 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 12:04:39.070028 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.070024 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:04:39.070102 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.070026 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 12:04:39.070102 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.070096 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 08 12:04:39.070663 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.070650 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-35.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:04:39.070717 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.070672 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-35.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:04:39.070717 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.070681 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-35.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:04:39.071452 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.071439 2565 policy_none.go:49] "None policy: Start" Jun 08 12:04:39.071510 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.071457 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 12:04:39.071510 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.071470 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 12:04:39.072228 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:39.072150 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-35.ec2.internal.18b7198edf3bcaec default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-35.ec2.internal,UID:ip-10-0-133-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-35.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-35.ec2.internal,},FirstTimestamp:2026-06-08 12:04:39.069608684 +0000 UTC m=+0.397957325,LastTimestamp:2026-06-08 12:04:39.069608684 +0000 UTC m=+0.397957325,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-35.ec2.internal,}" Jun 08 12:04:39.072703 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.072690 2565 policy_none.go:47] "Start" Jun 08 12:04:39.075342 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.075325 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7rwh4" Jun 08 12:04:39.122439 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.112846 2565 manager.go:337] "Starting Device Plugin manager" Jun 08 12:04:39.122439 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:39.112897 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 12:04:39.122439 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.112912 2565 server.go:87] "Starting device plugin registration server" Jun 08 12:04:39.122439 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.113168 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 12:04:39.122439 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.113181 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 12:04:39.122439 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.113291 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 12:04:39.122439 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.113388 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 12:04:39.122439 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.113397 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 12:04:39.122439 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:39.113887 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 12:04:39.122439 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:39.113950 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-35.ec2.internal\" not found" Jun 08 12:04:39.122439 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.117922 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 12:04:39.122439 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.117954 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 12:04:39.122439 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.117971 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 12:04:39.122439 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:39.118026 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 12:04:39.122439 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.120532 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:04:39.213416 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.213397 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:04:39.214217 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.214202 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-35.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:04:39.214283 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.214231 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-35.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:04:39.214283 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.214244 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-35.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:04:39.214283 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.214272 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-35.ec2.internal" Jun 08 12:04:39.218247 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.218230 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-35.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-35.ec2.internal"] Jun 08 12:04:39.218324 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.218282 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:04:39.219054 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.218991 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-35.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:04:39.219054 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.219017 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-35.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:04:39.219054 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.219030 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-35.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:04:39.220227 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.220213 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:04:39.220344 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.220330 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-35.ec2.internal" Jun 08 12:04:39.220394 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.220365 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:04:39.220870 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.220847 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-35.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:04:39.220942 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.220878 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-35.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:04:39.220942 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.220888 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-35.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:04:39.220942 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.220850 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-35.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:04:39.221053 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.220951 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-35.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:04:39.221053 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.220965 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-35.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:04:39.222155 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.222136 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-35.ec2.internal" Jun 08 12:04:39.222224 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.222161 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:04:39.222726 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.222711 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-35.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:04:39.222797 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.222739 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-35.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:04:39.222797 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.222750 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-35.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:04:39.223856 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.223843 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-35.ec2.internal" Jun 08 12:04:39.223934 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:39.223862 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-35.ec2.internal\": node \"ip-10-0-133-35.ec2.internal\" not found" Jun 08 12:04:39.253810 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:39.253792 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-35.ec2.internal\" not found" Jun 08 12:04:39.253913 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.253823 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8bdb6261778b7a080713b42923a31a4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-35.ec2.internal\" (UID: \"e8bdb6261778b7a080713b42923a31a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-35.ec2.internal" Jun 08 12:04:39.253913 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.253853 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3f0d14af2a26bde7f58d321a723d5ba5-config\") pod \"kube-apiserver-proxy-ip-10-0-133-35.ec2.internal\" (UID: \"3f0d14af2a26bde7f58d321a723d5ba5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-35.ec2.internal" Jun 08 12:04:39.253913 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.253876 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e8bdb6261778b7a080713b42923a31a4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-35.ec2.internal\" (UID: \"e8bdb6261778b7a080713b42923a31a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-35.ec2.internal" Jun 08 12:04:39.254856 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:39.254843 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-35.ec2.internal\" not found" node="ip-10-0-133-35.ec2.internal" Jun 08 12:04:39.258180 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:39.258167 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-35.ec2.internal\" not found" node="ip-10-0-133-35.ec2.internal" Jun 08 12:04:39.354815 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:39.354801 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-35.ec2.internal\" not found" Jun 08 12:04:39.354888 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.354818 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8bdb6261778b7a080713b42923a31a4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-35.ec2.internal\" (UID: \"e8bdb6261778b7a080713b42923a31a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-35.ec2.internal" Jun 08 12:04:39.354888 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.354844 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3f0d14af2a26bde7f58d321a723d5ba5-config\") pod \"kube-apiserver-proxy-ip-10-0-133-35.ec2.internal\" (UID: \"3f0d14af2a26bde7f58d321a723d5ba5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-35.ec2.internal" Jun 08 12:04:39.354888 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.354858 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e8bdb6261778b7a080713b42923a31a4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-35.ec2.internal\" (UID: \"e8bdb6261778b7a080713b42923a31a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-35.ec2.internal" Jun 08 12:04:39.354987 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.354899 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8bdb6261778b7a080713b42923a31a4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-35.ec2.internal\" (UID: \"e8bdb6261778b7a080713b42923a31a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-35.ec2.internal" Jun 08 12:04:39.354987 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.354902 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e8bdb6261778b7a080713b42923a31a4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-35.ec2.internal\" (UID: \"e8bdb6261778b7a080713b42923a31a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-35.ec2.internal" Jun 08 12:04:39.354987 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.354918 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3f0d14af2a26bde7f58d321a723d5ba5-config\") pod \"kube-apiserver-proxy-ip-10-0-133-35.ec2.internal\" (UID: \"3f0d14af2a26bde7f58d321a723d5ba5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-35.ec2.internal" Jun 08 12:04:39.455073 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:39.455053 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-35.ec2.internal\" not found" Jun 08 12:04:39.555374 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:39.555323 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-35.ec2.internal\" not found" Jun 08 12:04:39.559480 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.559468 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-35.ec2.internal" Jun 08 12:04:39.563154 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.563137 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-35.ec2.internal" Jun 08 12:04:39.656405 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:39.656379 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-35.ec2.internal\" not found" Jun 08 12:04:39.756760 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:39.756737 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-35.ec2.internal\" not found" Jun 08 12:04:39.857183 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:39.857121 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-35.ec2.internal\" not found" Jun 08 12:04:39.941299 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.941272 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:04:39.957489 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:39.957466 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-35.ec2.internal\" not found" Jun 08 12:04:39.993626 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.993602 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 12:04:39.994018 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.993721 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 12:04:39.994018 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:39.993742 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 12:04:40.058301 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:40.058281 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-35.ec2.internal\" not found" Jun 08 12:04:40.077688 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:40.077655 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 11:59:39 +0000 UTC" deadline="2028-02-10 07:21:20.719201574 +0000 UTC" Jun 08 12:04:40.077688 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:40.077686 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14683h16m40.641519105s" Jun 08 12:04:40.141960 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:40.141921 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8bdb6261778b7a080713b42923a31a4.slice/crio-7d0dcafb2a04c7ea32a1c8a4e68850219d95dd0c3a2b5bb4140d8c75a387aa46 WatchSource:0}: Error finding container 7d0dcafb2a04c7ea32a1c8a4e68850219d95dd0c3a2b5bb4140d8c75a387aa46: Status 404 returned error can't find the container with id 7d0dcafb2a04c7ea32a1c8a4e68850219d95dd0c3a2b5bb4140d8c75a387aa46 Jun 08 12:04:40.146434 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:40.146414 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 12:04:40.159292 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:40.159273 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-35.ec2.internal\" not found" Jun 08 12:04:40.235009 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:40.234976 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f0d14af2a26bde7f58d321a723d5ba5.slice/crio-1a13624681406ca511dc5701d5b8bced792bf93f3162e040397d4a9e09c5b640 WatchSource:0}: Error finding container 1a13624681406ca511dc5701d5b8bced792bf93f3162e040397d4a9e09c5b640: Status 404 returned error can't find the container with id 1a13624681406ca511dc5701d5b8bced792bf93f3162e040397d4a9e09c5b640 Jun 08 12:04:40.257453 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:40.257432 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:04:40.353206 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:40.353175 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-35.ec2.internal" Jun 08 12:04:40.364285 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:40.364264 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 12:04:40.365209 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:40.365198 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-35.ec2.internal" Jun 08 12:04:40.374536 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:40.374521 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 12:04:40.628582 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:40.628510 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:04:40.958382 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:40.958293 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:04:41.032513 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.032477 2565 apiserver.go:52] "Watching apiserver" Jun 08 12:04:41.041439 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.041283 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 12:04:41.043104 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.043068 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-xz292","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-35.ec2.internal","openshift-multus/multus-tfqv5","openshift-dns/node-resolver-w4wf6","openshift-multus/multus-additional-cni-plugins-tcm54","openshift-multus/network-metrics-daemon-8tsdl","openshift-network-diagnostics/network-check-target-gdsnk","openshift-network-operator/iptables-alerter-xj98x","openshift-ovn-kubernetes/ovnkube-node-94jtj","kube-system/global-pull-secret-syncer-96gpg","kube-system/konnectivity-agent-7vjm8","kube-system/kube-apiserver-proxy-ip-10-0-133-35.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkp6","openshift-cluster-node-tuning-operator/tuned-tgs2t"] Jun 08 12:04:41.044728 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.044701 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:04:41.044838 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:41.044780 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdsnk" podUID="095c54d8-85fa-477f-a17f-416f9f0fc588" Jun 08 12:04:41.045918 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.045887 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkp6" Jun 08 12:04:41.047068 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.047047 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.048291 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.048256 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w4wf6" Jun 08 12:04:41.049606 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.049586 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ncnp2\"" Jun 08 12:04:41.049809 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.049794 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tcm54" Jun 08 12:04:41.050762 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.050741 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 12:04:41.050850 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.050831 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 12:04:41.050982 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.050964 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qh77g\"" Jun 08 12:04:41.051040 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.050964 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-w5c59\"" Jun 08 12:04:41.051096 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.051058 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 12:04:41.051096 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.051091 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 12:04:41.051257 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.051242 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:04:41.051336 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.051263 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 12:04:41.051517 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:41.051478 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tsdl" podUID="50c05198-1996-4465-97df-8ae929b9410b" Jun 08 12:04:41.051710 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.051692 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 12:04:41.051836 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.051817 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 12:04:41.051896 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.051850 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 12:04:41.052065 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.052047 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 12:04:41.052549 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.052531 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.052952 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.052906 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 12:04:41.054092 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.054068 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xz292" Jun 08 12:04:41.054560 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.054542 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wrqtd\"" Jun 08 12:04:41.054560 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.054549 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 12:04:41.055047 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.055029 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.056095 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.056075 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 12:04:41.056365 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.056346 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:04:41.056441 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:41.056427 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96gpg" podUID="9feeac32-9e54-42d4-85f7-3e4175f9eb08" Jun 08 12:04:41.056676 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.056655 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 12:04:41.057590 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.057572 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 12:04:41.057688 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.057630 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 12:04:41.057945 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.057932 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 12:04:41.058507 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.058442 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7vjm8" Jun 08 12:04:41.058840 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.058821 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 12:04:41.058927 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.058869 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 12:04:41.059351 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.059333 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xj98x" Jun 08 12:04:41.059433 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.059372 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 12:04:41.062226 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.062210 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7wjg4\"" Jun 08 12:04:41.062874 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.062854 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:04:41.063132 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.063111 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 12:04:41.063598 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.063578 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 12:04:41.063694 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.063683 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mx68b\"" Jun 08 12:04:41.064014 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.063996 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 12:04:41.064102 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.064050 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 12:04:41.064468 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.064454 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 12:04:41.064675 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.064658 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 12:04:41.065220 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.065200 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:04:41.065280 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.065230 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-host-run-netns\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.065280 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.065259 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-ovnkube-config\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.065378 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.065282 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqncz\" (UniqueName: \"kubernetes.io/projected/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-kube-api-access-xqncz\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.065378 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.065322 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/faa7bc0a-10e1-4949-88ff-798e93b72801-os-release\") pod \"multus-additional-cni-plugins-tcm54\" (UID: \"faa7bc0a-10e1-4949-88ff-798e93b72801\") " pod="openshift-multus/multus-additional-cni-plugins-tcm54" Jun 08 12:04:41.065378 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.065368 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-host-run-netns\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.065500 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.065392 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs\") pod \"network-metrics-daemon-8tsdl\" (UID: \"50c05198-1996-4465-97df-8ae929b9410b\") " pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:04:41.065500 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.065431 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-run-openvswitch\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.065500 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.065473 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-etc-kubernetes\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.065634 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.065504 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-host-slash\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.065634 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.065528 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-run-ovn\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.065634 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.065567 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8ab3c794-51bd-40b0-b285-55bf8e6ae8b3-registration-dir\") pod \"aws-ebs-csi-driver-node-7xkp6\" (UID: \"8ab3c794-51bd-40b0-b285-55bf8e6ae8b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkp6" Jun 08 12:04:41.065634 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.065591 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/faa7bc0a-10e1-4949-88ff-798e93b72801-system-cni-dir\") pod \"multus-additional-cni-plugins-tcm54\" (UID: \"faa7bc0a-10e1-4949-88ff-798e93b72801\") " pod="openshift-multus/multus-additional-cni-plugins-tcm54" Jun 08 12:04:41.065634 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.065620 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp6ns\" (UniqueName: \"kubernetes.io/projected/8ab3c794-51bd-40b0-b285-55bf8e6ae8b3-kube-api-access-mp6ns\") pod \"aws-ebs-csi-driver-node-7xkp6\" (UID: \"8ab3c794-51bd-40b0-b285-55bf8e6ae8b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkp6" Jun 08 12:04:41.065856 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.065654 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/faa7bc0a-10e1-4949-88ff-798e93b72801-cni-binary-copy\") pod \"multus-additional-cni-plugins-tcm54\" (UID: \"faa7bc0a-10e1-4949-88ff-798e93b72801\") " pod="openshift-multus/multus-additional-cni-plugins-tcm54" Jun 08 12:04:41.065856 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.065698 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59c37349-dd98-4803-a359-6c76f3be9d75-cni-binary-copy\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.065856 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.065729 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-host-var-lib-cni-multus\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.065856 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.065755 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/59c37349-dd98-4803-a359-6c76f3be9d75-multus-daemon-config\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.065856 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.065819 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-host-kubelet\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.065856 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.065854 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/af53aaaa-69bd-4d1e-9fb7-6eaf4b58fb13-serviceca\") pod \"node-ca-xz292\" (UID: \"af53aaaa-69bd-4d1e-9fb7-6eaf4b58fb13\") " pod="openshift-image-registry/node-ca-xz292" Jun 08 12:04:41.066099 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.065893 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98vkx\" (UniqueName: \"kubernetes.io/projected/50c05198-1996-4465-97df-8ae929b9410b-kube-api-access-98vkx\") pod \"network-metrics-daemon-8tsdl\" (UID: \"50c05198-1996-4465-97df-8ae929b9410b\") " pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:04:41.066099 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.065922 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-etc-openvswitch\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.066099 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.065964 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2msp\" (UniqueName: \"kubernetes.io/projected/eee4acbf-8c90-49e2-8573-d2386ae891cc-kube-api-access-j2msp\") pod \"node-resolver-w4wf6\" (UID: \"eee4acbf-8c90-49e2-8573-d2386ae891cc\") " pod="openshift-dns/node-resolver-w4wf6" Jun 08 12:04:41.066099 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066014 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-multus-cni-dir\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.066099 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066043 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-multus-conf-dir\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.066099 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066064 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-run-systemd\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.066099 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066086 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-var-lib-openvswitch\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.066374 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066128 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-env-overrides\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.066374 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066160 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8ab3c794-51bd-40b0-b285-55bf8e6ae8b3-socket-dir\") pod \"aws-ebs-csi-driver-node-7xkp6\" (UID: \"8ab3c794-51bd-40b0-b285-55bf8e6ae8b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkp6" Jun 08 12:04:41.066374 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066184 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-hostroot\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.066374 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066208 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8ab3c794-51bd-40b0-b285-55bf8e6ae8b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7xkp6\" (UID: \"8ab3c794-51bd-40b0-b285-55bf8e6ae8b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkp6" Jun 08 12:04:41.066374 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066232 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/faa7bc0a-10e1-4949-88ff-798e93b72801-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tcm54\" (UID: \"faa7bc0a-10e1-4949-88ff-798e93b72801\") " pod="openshift-multus/multus-additional-cni-plugins-tcm54" Jun 08 12:04:41.066374 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066255 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-system-cni-dir\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.066374 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066277 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-host-run-k8s-cni-cncf-io\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.066374 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066324 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-node-log\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.066374 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066346 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af53aaaa-69bd-4d1e-9fb7-6eaf4b58fb13-host\") pod \"node-ca-xz292\" (UID: \"af53aaaa-69bd-4d1e-9fb7-6eaf4b58fb13\") " pod="openshift-image-registry/node-ca-xz292" Jun 08 12:04:41.066374 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066376 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t9zj\" (UniqueName: \"kubernetes.io/projected/af53aaaa-69bd-4d1e-9fb7-6eaf4b58fb13-kube-api-access-7t9zj\") pod \"node-ca-xz292\" (UID: \"af53aaaa-69bd-4d1e-9fb7-6eaf4b58fb13\") " pod="openshift-image-registry/node-ca-xz292" Jun 08 12:04:41.066757 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066395 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8ab3c794-51bd-40b0-b285-55bf8e6ae8b3-sys-fs\") pod \"aws-ebs-csi-driver-node-7xkp6\" (UID: \"8ab3c794-51bd-40b0-b285-55bf8e6ae8b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkp6" Jun 08 12:04:41.066757 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066416 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eee4acbf-8c90-49e2-8573-d2386ae891cc-hosts-file\") pod \"node-resolver-w4wf6\" (UID: \"eee4acbf-8c90-49e2-8573-d2386ae891cc\") " pod="openshift-dns/node-resolver-w4wf6" Jun 08 12:04:41.066757 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066458 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn4md\" (UniqueName: \"kubernetes.io/projected/faa7bc0a-10e1-4949-88ff-798e93b72801-kube-api-access-zn4md\") pod \"multus-additional-cni-plugins-tcm54\" (UID: \"faa7bc0a-10e1-4949-88ff-798e93b72801\") " pod="openshift-multus/multus-additional-cni-plugins-tcm54" Jun 08 12:04:41.066757 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066491 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-multus-socket-dir-parent\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.066757 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066513 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-host-var-lib-cni-bin\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.066757 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066535 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-ovnkube-script-lib\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.066757 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066558 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8ab3c794-51bd-40b0-b285-55bf8e6ae8b3-device-dir\") pod \"aws-ebs-csi-driver-node-7xkp6\" (UID: \"8ab3c794-51bd-40b0-b285-55bf8e6ae8b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkp6" Jun 08 12:04:41.066757 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066578 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8ab3c794-51bd-40b0-b285-55bf8e6ae8b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-7xkp6\" (UID: \"8ab3c794-51bd-40b0-b285-55bf8e6ae8b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkp6" Jun 08 12:04:41.066757 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066598 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eee4acbf-8c90-49e2-8573-d2386ae891cc-tmp-dir\") pod \"node-resolver-w4wf6\" (UID: \"eee4acbf-8c90-49e2-8573-d2386ae891cc\") " pod="openshift-dns/node-resolver-w4wf6" Jun 08 12:04:41.066757 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066619 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-host-var-lib-kubelet\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.066757 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066640 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-host-run-multus-certs\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.066757 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066671 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-f7c8g\"" Jun 08 12:04:41.066757 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066677 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.066757 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066713 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/faa7bc0a-10e1-4949-88ff-798e93b72801-cnibin\") pod \"multus-additional-cni-plugins-tcm54\" (UID: \"faa7bc0a-10e1-4949-88ff-798e93b72801\") " pod="openshift-multus/multus-additional-cni-plugins-tcm54" Jun 08 12:04:41.066757 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066739 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-host-run-ovn-kubernetes\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.066757 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066764 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-ovn-node-metrics-cert\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.067428 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066797 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hhx4\" (UniqueName: \"kubernetes.io/projected/095c54d8-85fa-477f-a17f-416f9f0fc588-kube-api-access-4hhx4\") pod \"network-check-target-gdsnk\" (UID: \"095c54d8-85fa-477f-a17f-416f9f0fc588\") " pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:04:41.067428 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.067093 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 12:04:41.067428 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.066845 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/faa7bc0a-10e1-4949-88ff-798e93b72801-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tcm54\" (UID: \"faa7bc0a-10e1-4949-88ff-798e93b72801\") " pod="openshift-multus/multus-additional-cni-plugins-tcm54" Jun 08 12:04:41.067428 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.067334 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxbfm\" (UniqueName: \"kubernetes.io/projected/59c37349-dd98-4803-a359-6c76f3be9d75-kube-api-access-lxbfm\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.067428 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.067377 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-host-cni-bin\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.067428 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.067397 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-cnibin\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.067428 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.067416 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-os-release\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.067614 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.067434 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-systemd-units\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.067614 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.067449 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-log-socket\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.067614 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.067465 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-host-cni-netd\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.067614 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.067483 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/faa7bc0a-10e1-4949-88ff-798e93b72801-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tcm54\" (UID: \"faa7bc0a-10e1-4949-88ff-798e93b72801\") " pod="openshift-multus/multus-additional-cni-plugins-tcm54" Jun 08 12:04:41.067614 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.067586 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-v8xkl\"" Jun 08 12:04:41.068077 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.068057 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rg2xk\"" Jun 08 12:04:41.073242 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.073225 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 12:04:41.114367 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.114345 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wjvnr" Jun 08 12:04:41.122269 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.122220 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-35.ec2.internal" event={"ID":"3f0d14af2a26bde7f58d321a723d5ba5","Type":"ContainerStarted","Data":"1a13624681406ca511dc5701d5b8bced792bf93f3162e040397d4a9e09c5b640"} Jun 08 12:04:41.123381 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.123358 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-35.ec2.internal" event={"ID":"e8bdb6261778b7a080713b42923a31a4","Type":"ContainerStarted","Data":"7d0dcafb2a04c7ea32a1c8a4e68850219d95dd0c3a2b5bb4140d8c75a387aa46"} Jun 08 12:04:41.128414 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.128389 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wjvnr" Jun 08 12:04:41.153806 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.153785 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 12:04:41.167618 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.167595 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-run-openvswitch\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.167691 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.167620 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-etc-kubernetes\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.167691 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.167635 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-host-slash\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.167691 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.167649 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-run-ovn\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.167691 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.167663 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8ab3c794-51bd-40b0-b285-55bf8e6ae8b3-registration-dir\") pod \"aws-ebs-csi-driver-node-7xkp6\" (UID: \"8ab3c794-51bd-40b0-b285-55bf8e6ae8b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkp6" Jun 08 12:04:41.167691 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.167678 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/faa7bc0a-10e1-4949-88ff-798e93b72801-system-cni-dir\") pod \"multus-additional-cni-plugins-tcm54\" (UID: \"faa7bc0a-10e1-4949-88ff-798e93b72801\") " pod="openshift-multus/multus-additional-cni-plugins-tcm54" Jun 08 12:04:41.167691 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.167674 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-run-openvswitch\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.167944 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.167701 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-etc-sysctl-d\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.167944 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.167738 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-etc-kubernetes\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.167944 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.167747 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp6ns\" (UniqueName: \"kubernetes.io/projected/8ab3c794-51bd-40b0-b285-55bf8e6ae8b3-kube-api-access-mp6ns\") pod \"aws-ebs-csi-driver-node-7xkp6\" (UID: \"8ab3c794-51bd-40b0-b285-55bf8e6ae8b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkp6" Jun 08 12:04:41.167944 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.167752 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-run-ovn\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.167944 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.167772 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/faa7bc0a-10e1-4949-88ff-798e93b72801-cni-binary-copy\") pod \"multus-additional-cni-plugins-tcm54\" (UID: \"faa7bc0a-10e1-4949-88ff-798e93b72801\") " pod="openshift-multus/multus-additional-cni-plugins-tcm54" Jun 08 12:04:41.167944 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.167779 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/faa7bc0a-10e1-4949-88ff-798e93b72801-system-cni-dir\") pod \"multus-additional-cni-plugins-tcm54\" (UID: \"faa7bc0a-10e1-4949-88ff-798e93b72801\") " pod="openshift-multus/multus-additional-cni-plugins-tcm54" Jun 08 12:04:41.167944 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.167786 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8ab3c794-51bd-40b0-b285-55bf8e6ae8b3-registration-dir\") pod \"aws-ebs-csi-driver-node-7xkp6\" (UID: \"8ab3c794-51bd-40b0-b285-55bf8e6ae8b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkp6" Jun 08 12:04:41.167944 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.167793 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9feeac32-9e54-42d4-85f7-3e4175f9eb08-dbus\") pod \"global-pull-secret-syncer-96gpg\" (UID: \"9feeac32-9e54-42d4-85f7-3e4175f9eb08\") " pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:04:41.167944 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.167811 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-host-slash\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.167944 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.167839 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59c37349-dd98-4803-a359-6c76f3be9d75-cni-binary-copy\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.167944 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.167875 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-host-var-lib-cni-multus\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.167944 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.167899 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/59c37349-dd98-4803-a359-6c76f3be9d75-multus-daemon-config\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.167944 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.167924 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-host-kubelet\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.167944 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.167933 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-host-var-lib-cni-multus\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.167944 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.167945 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/af53aaaa-69bd-4d1e-9fb7-6eaf4b58fb13-serviceca\") pod \"node-ca-xz292\" (UID: \"af53aaaa-69bd-4d1e-9fb7-6eaf4b58fb13\") " pod="openshift-image-registry/node-ca-xz292" Jun 08 12:04:41.168607 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168069 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98vkx\" (UniqueName: \"kubernetes.io/projected/50c05198-1996-4465-97df-8ae929b9410b-kube-api-access-98vkx\") pod \"network-metrics-daemon-8tsdl\" (UID: \"50c05198-1996-4465-97df-8ae929b9410b\") " pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:04:41.168607 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168242 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-host-kubelet\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.168607 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168282 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-etc-openvswitch\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.168607 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168326 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e8ddff45-74e9-4a4f-94db-ad39271f28d1-etc-tuned\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.168607 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168353 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89582a50-702c-4538-a255-b1b7692c41a4-host-slash\") pod \"iptables-alerter-xj98x\" (UID: \"89582a50-702c-4538-a255-b1b7692c41a4\") " pod="openshift-network-operator/iptables-alerter-xj98x" Jun 08 12:04:41.168607 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168377 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2msp\" (UniqueName: \"kubernetes.io/projected/eee4acbf-8c90-49e2-8573-d2386ae891cc-kube-api-access-j2msp\") pod \"node-resolver-w4wf6\" (UID: \"eee4acbf-8c90-49e2-8573-d2386ae891cc\") " pod="openshift-dns/node-resolver-w4wf6" Jun 08 12:04:41.168607 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168401 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-multus-cni-dir\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.168607 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168418 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/af53aaaa-69bd-4d1e-9fb7-6eaf4b58fb13-serviceca\") pod \"node-ca-xz292\" (UID: \"af53aaaa-69bd-4d1e-9fb7-6eaf4b58fb13\") " pod="openshift-image-registry/node-ca-xz292" Jun 08 12:04:41.168607 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168428 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-etc-openvswitch\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.168607 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168438 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/faa7bc0a-10e1-4949-88ff-798e93b72801-cni-binary-copy\") pod \"multus-additional-cni-plugins-tcm54\" (UID: \"faa7bc0a-10e1-4949-88ff-798e93b72801\") " pod="openshift-multus/multus-additional-cni-plugins-tcm54" Jun 08 12:04:41.168607 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168441 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-multus-conf-dir\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.168607 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168473 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/59c37349-dd98-4803-a359-6c76f3be9d75-multus-daemon-config\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.168607 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168483 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-multus-conf-dir\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.168607 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168502 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-multus-cni-dir\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.168607 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168557 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59c37349-dd98-4803-a359-6c76f3be9d75-cni-binary-copy\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.168607 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168569 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-run-systemd\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.168607 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168602 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-run-systemd\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.168607 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168615 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-var-lib-openvswitch\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.169432 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168632 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-var-lib-openvswitch\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.169432 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168643 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-env-overrides\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.169432 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168670 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8ab3c794-51bd-40b0-b285-55bf8e6ae8b3-socket-dir\") pod \"aws-ebs-csi-driver-node-7xkp6\" (UID: \"8ab3c794-51bd-40b0-b285-55bf8e6ae8b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkp6" Jun 08 12:04:41.169432 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168701 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-run\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.169432 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168725 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-hostroot\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.169432 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168748 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8ab3c794-51bd-40b0-b285-55bf8e6ae8b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7xkp6\" (UID: \"8ab3c794-51bd-40b0-b285-55bf8e6ae8b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkp6" Jun 08 12:04:41.169432 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168771 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/faa7bc0a-10e1-4949-88ff-798e93b72801-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tcm54\" (UID: \"faa7bc0a-10e1-4949-88ff-798e93b72801\") " pod="openshift-multus/multus-additional-cni-plugins-tcm54" Jun 08 12:04:41.169432 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168792 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-hostroot\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.169432 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168794 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-host\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.169432 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168809 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8ab3c794-51bd-40b0-b285-55bf8e6ae8b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7xkp6\" (UID: \"8ab3c794-51bd-40b0-b285-55bf8e6ae8b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkp6" Jun 08 12:04:41.169432 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168858 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv4mp\" (UniqueName: \"kubernetes.io/projected/e8ddff45-74e9-4a4f-94db-ad39271f28d1-kube-api-access-sv4mp\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.169432 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168863 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8ab3c794-51bd-40b0-b285-55bf8e6ae8b3-socket-dir\") pod \"aws-ebs-csi-driver-node-7xkp6\" (UID: \"8ab3c794-51bd-40b0-b285-55bf8e6ae8b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkp6" Jun 08 12:04:41.169432 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168875 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72rgc\" (UniqueName: \"kubernetes.io/projected/89582a50-702c-4538-a255-b1b7692c41a4-kube-api-access-72rgc\") pod \"iptables-alerter-xj98x\" (UID: \"89582a50-702c-4538-a255-b1b7692c41a4\") " pod="openshift-network-operator/iptables-alerter-xj98x" Jun 08 12:04:41.169432 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168900 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9feeac32-9e54-42d4-85f7-3e4175f9eb08-kubelet-config\") pod \"global-pull-secret-syncer-96gpg\" (UID: \"9feeac32-9e54-42d4-85f7-3e4175f9eb08\") " pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:04:41.169432 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168914 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9feeac32-9e54-42d4-85f7-3e4175f9eb08-original-pull-secret\") pod \"global-pull-secret-syncer-96gpg\" (UID: \"9feeac32-9e54-42d4-85f7-3e4175f9eb08\") " pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:04:41.169432 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168929 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-system-cni-dir\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.169432 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168949 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-host-run-k8s-cni-cncf-io\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.170144 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.168969 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-node-log\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.170144 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169009 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-host-run-k8s-cni-cncf-io\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.170144 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169049 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-node-log\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.170144 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169090 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-env-overrides\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.170144 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169122 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af53aaaa-69bd-4d1e-9fb7-6eaf4b58fb13-host\") pod \"node-ca-xz292\" (UID: \"af53aaaa-69bd-4d1e-9fb7-6eaf4b58fb13\") " pod="openshift-image-registry/node-ca-xz292" Jun 08 12:04:41.170144 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169141 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t9zj\" (UniqueName: \"kubernetes.io/projected/af53aaaa-69bd-4d1e-9fb7-6eaf4b58fb13-kube-api-access-7t9zj\") pod \"node-ca-xz292\" (UID: \"af53aaaa-69bd-4d1e-9fb7-6eaf4b58fb13\") " pod="openshift-image-registry/node-ca-xz292" Jun 08 12:04:41.170144 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169143 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-system-cni-dir\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.170144 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169165 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8ab3c794-51bd-40b0-b285-55bf8e6ae8b3-sys-fs\") pod \"aws-ebs-csi-driver-node-7xkp6\" (UID: \"8ab3c794-51bd-40b0-b285-55bf8e6ae8b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkp6" Jun 08 12:04:41.170144 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169178 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af53aaaa-69bd-4d1e-9fb7-6eaf4b58fb13-host\") pod \"node-ca-xz292\" (UID: \"af53aaaa-69bd-4d1e-9fb7-6eaf4b58fb13\") " pod="openshift-image-registry/node-ca-xz292" Jun 08 12:04:41.170144 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169185 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eee4acbf-8c90-49e2-8573-d2386ae891cc-hosts-file\") pod \"node-resolver-w4wf6\" (UID: \"eee4acbf-8c90-49e2-8573-d2386ae891cc\") " pod="openshift-dns/node-resolver-w4wf6" Jun 08 12:04:41.170144 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169207 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn4md\" (UniqueName: \"kubernetes.io/projected/faa7bc0a-10e1-4949-88ff-798e93b72801-kube-api-access-zn4md\") pod \"multus-additional-cni-plugins-tcm54\" (UID: \"faa7bc0a-10e1-4949-88ff-798e93b72801\") " pod="openshift-multus/multus-additional-cni-plugins-tcm54" Jun 08 12:04:41.170144 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169225 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8ab3c794-51bd-40b0-b285-55bf8e6ae8b3-sys-fs\") pod \"aws-ebs-csi-driver-node-7xkp6\" (UID: \"8ab3c794-51bd-40b0-b285-55bf8e6ae8b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkp6" Jun 08 12:04:41.170144 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169232 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-multus-socket-dir-parent\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.170144 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169257 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-host-var-lib-cni-bin\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.170144 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169270 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eee4acbf-8c90-49e2-8573-d2386ae891cc-hosts-file\") pod \"node-resolver-w4wf6\" (UID: \"eee4acbf-8c90-49e2-8573-d2386ae891cc\") " pod="openshift-dns/node-resolver-w4wf6" Jun 08 12:04:41.170144 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169269 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/faa7bc0a-10e1-4949-88ff-798e93b72801-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tcm54\" (UID: \"faa7bc0a-10e1-4949-88ff-798e93b72801\") " pod="openshift-multus/multus-additional-cni-plugins-tcm54" Jun 08 12:04:41.170144 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169280 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-ovnkube-script-lib\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.170144 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169336 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-host-var-lib-cni-bin\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.170955 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169339 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-etc-systemd\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.170955 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169343 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-multus-socket-dir-parent\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.170955 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169368 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-lib-modules\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.170955 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169401 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-var-lib-kubelet\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.170955 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169431 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87ecf61c-d270-4aeb-bf85-8ba8713e26ee-konnectivity-ca\") pod \"konnectivity-agent-7vjm8\" (UID: \"87ecf61c-d270-4aeb-bf85-8ba8713e26ee\") " pod="kube-system/konnectivity-agent-7vjm8" Jun 08 12:04:41.170955 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169489 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8ab3c794-51bd-40b0-b285-55bf8e6ae8b3-device-dir\") pod \"aws-ebs-csi-driver-node-7xkp6\" (UID: \"8ab3c794-51bd-40b0-b285-55bf8e6ae8b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkp6" Jun 08 12:04:41.170955 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169516 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8ab3c794-51bd-40b0-b285-55bf8e6ae8b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-7xkp6\" (UID: \"8ab3c794-51bd-40b0-b285-55bf8e6ae8b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkp6" Jun 08 12:04:41.170955 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169538 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eee4acbf-8c90-49e2-8573-d2386ae891cc-tmp-dir\") pod \"node-resolver-w4wf6\" (UID: \"eee4acbf-8c90-49e2-8573-d2386ae891cc\") " pod="openshift-dns/node-resolver-w4wf6" Jun 08 12:04:41.170955 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169590 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8ab3c794-51bd-40b0-b285-55bf8e6ae8b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-7xkp6\" (UID: \"8ab3c794-51bd-40b0-b285-55bf8e6ae8b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkp6" Jun 08 12:04:41.170955 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169638 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-etc-sysconfig\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.170955 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169660 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-sys\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.170955 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169656 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8ab3c794-51bd-40b0-b285-55bf8e6ae8b3-device-dir\") pod \"aws-ebs-csi-driver-node-7xkp6\" (UID: \"8ab3c794-51bd-40b0-b285-55bf8e6ae8b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkp6" Jun 08 12:04:41.170955 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169687 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8ddff45-74e9-4a4f-94db-ad39271f28d1-tmp\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.170955 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169719 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-host-var-lib-kubelet\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.170955 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169725 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-ovnkube-script-lib\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.170955 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169743 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-host-run-multus-certs\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.170955 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169756 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eee4acbf-8c90-49e2-8573-d2386ae891cc-tmp-dir\") pod \"node-resolver-w4wf6\" (UID: \"eee4acbf-8c90-49e2-8573-d2386ae891cc\") " pod="openshift-dns/node-resolver-w4wf6" Jun 08 12:04:41.171526 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169768 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.171526 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169773 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-host-var-lib-kubelet\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.171526 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169795 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/faa7bc0a-10e1-4949-88ff-798e93b72801-cnibin\") pod \"multus-additional-cni-plugins-tcm54\" (UID: \"faa7bc0a-10e1-4949-88ff-798e93b72801\") " pod="openshift-multus/multus-additional-cni-plugins-tcm54" Jun 08 12:04:41.171526 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169814 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-etc-sysctl-conf\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.171526 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169829 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87ecf61c-d270-4aeb-bf85-8ba8713e26ee-agent-certs\") pod \"konnectivity-agent-7vjm8\" (UID: \"87ecf61c-d270-4aeb-bf85-8ba8713e26ee\") " pod="kube-system/konnectivity-agent-7vjm8" Jun 08 12:04:41.171526 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169838 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-host-run-multus-certs\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.171526 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169864 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/faa7bc0a-10e1-4949-88ff-798e93b72801-cnibin\") pod \"multus-additional-cni-plugins-tcm54\" (UID: \"faa7bc0a-10e1-4949-88ff-798e93b72801\") " pod="openshift-multus/multus-additional-cni-plugins-tcm54" Jun 08 12:04:41.171526 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169871 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-host-run-ovn-kubernetes\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.171526 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169873 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.171526 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169928 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-ovn-node-metrics-cert\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.171526 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.169972 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-host-run-ovn-kubernetes\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.171526 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170007 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hhx4\" (UniqueName: \"kubernetes.io/projected/095c54d8-85fa-477f-a17f-416f9f0fc588-kube-api-access-4hhx4\") pod \"network-check-target-gdsnk\" (UID: \"095c54d8-85fa-477f-a17f-416f9f0fc588\") " pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:04:41.171526 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170035 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/faa7bc0a-10e1-4949-88ff-798e93b72801-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tcm54\" (UID: \"faa7bc0a-10e1-4949-88ff-798e93b72801\") " pod="openshift-multus/multus-additional-cni-plugins-tcm54" Jun 08 12:04:41.171526 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170063 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-etc-modprobe-d\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.171526 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170088 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxbfm\" (UniqueName: \"kubernetes.io/projected/59c37349-dd98-4803-a359-6c76f3be9d75-kube-api-access-lxbfm\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.171526 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170111 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-host-cni-bin\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.172068 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170135 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89582a50-702c-4538-a255-b1b7692c41a4-iptables-alerter-script\") pod \"iptables-alerter-xj98x\" (UID: \"89582a50-702c-4538-a255-b1b7692c41a4\") " pod="openshift-network-operator/iptables-alerter-xj98x" Jun 08 12:04:41.172068 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170159 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-cnibin\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.172068 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170180 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-os-release\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.172068 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170203 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-systemd-units\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.172068 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170237 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-log-socket\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.172068 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170261 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 12:04:41.172068 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170276 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-host-cni-netd\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.172068 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170293 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-cnibin\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.172068 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170361 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-log-socket\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.172068 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170248 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-systemd-units\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.172068 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170356 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-host-cni-netd\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.172068 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170411 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-host-cni-bin\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.172068 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170416 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/faa7bc0a-10e1-4949-88ff-798e93b72801-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tcm54\" (UID: \"faa7bc0a-10e1-4949-88ff-798e93b72801\") " pod="openshift-multus/multus-additional-cni-plugins-tcm54" Jun 08 12:04:41.172068 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170446 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-etc-kubernetes\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.172068 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170473 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-host-run-netns\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.172068 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170495 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-os-release\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.172068 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170509 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-host-run-netns\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.172068 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170513 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-ovnkube-config\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.172657 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170551 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/faa7bc0a-10e1-4949-88ff-798e93b72801-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tcm54\" (UID: \"faa7bc0a-10e1-4949-88ff-798e93b72801\") " pod="openshift-multus/multus-additional-cni-plugins-tcm54" Jun 08 12:04:41.172657 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170555 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqncz\" (UniqueName: \"kubernetes.io/projected/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-kube-api-access-xqncz\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.172657 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170521 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/faa7bc0a-10e1-4949-88ff-798e93b72801-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tcm54\" (UID: \"faa7bc0a-10e1-4949-88ff-798e93b72801\") " pod="openshift-multus/multus-additional-cni-plugins-tcm54" Jun 08 12:04:41.172657 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170582 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/faa7bc0a-10e1-4949-88ff-798e93b72801-os-release\") pod \"multus-additional-cni-plugins-tcm54\" (UID: \"faa7bc0a-10e1-4949-88ff-798e93b72801\") " pod="openshift-multus/multus-additional-cni-plugins-tcm54" Jun 08 12:04:41.172657 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170619 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-host-run-netns\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.172657 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170640 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs\") pod \"network-metrics-daemon-8tsdl\" (UID: \"50c05198-1996-4465-97df-8ae929b9410b\") " pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:04:41.172657 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170701 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59c37349-dd98-4803-a359-6c76f3be9d75-host-run-netns\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.172657 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170711 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/faa7bc0a-10e1-4949-88ff-798e93b72801-os-release\") pod \"multus-additional-cni-plugins-tcm54\" (UID: \"faa7bc0a-10e1-4949-88ff-798e93b72801\") " pod="openshift-multus/multus-additional-cni-plugins-tcm54" Jun 08 12:04:41.172657 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:41.170740 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:04:41.172657 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:41.170803 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs podName:50c05198-1996-4465-97df-8ae929b9410b nodeName:}" failed. No retries permitted until 2026-06-08 12:04:41.670785883 +0000 UTC m=+2.999134528 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs") pod "network-metrics-daemon-8tsdl" (UID: "50c05198-1996-4465-97df-8ae929b9410b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:04:41.172657 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.170974 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-ovnkube-config\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.173795 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.173764 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-ovn-node-metrics-cert\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.183152 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.183092 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2msp\" (UniqueName: \"kubernetes.io/projected/eee4acbf-8c90-49e2-8573-d2386ae891cc-kube-api-access-j2msp\") pod \"node-resolver-w4wf6\" (UID: \"eee4acbf-8c90-49e2-8573-d2386ae891cc\") " pod="openshift-dns/node-resolver-w4wf6" Jun 08 12:04:41.183701 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.183653 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98vkx\" (UniqueName: \"kubernetes.io/projected/50c05198-1996-4465-97df-8ae929b9410b-kube-api-access-98vkx\") pod \"network-metrics-daemon-8tsdl\" (UID: \"50c05198-1996-4465-97df-8ae929b9410b\") " pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:04:41.184065 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:41.183798 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:04:41.184065 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:41.183822 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:04:41.184065 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:41.183837 2565 projected.go:196] Error preparing data for projected volume kube-api-access-4hhx4 for pod openshift-network-diagnostics/network-check-target-gdsnk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:04:41.184065 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:41.183923 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/095c54d8-85fa-477f-a17f-416f9f0fc588-kube-api-access-4hhx4 podName:095c54d8-85fa-477f-a17f-416f9f0fc588 nodeName:}" failed. No retries permitted until 2026-06-08 12:04:41.683906282 +0000 UTC m=+3.012254939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4hhx4" (UniqueName: "kubernetes.io/projected/095c54d8-85fa-477f-a17f-416f9f0fc588-kube-api-access-4hhx4") pod "network-check-target-gdsnk" (UID: "095c54d8-85fa-477f-a17f-416f9f0fc588") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:04:41.185229 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.185162 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp6ns\" (UniqueName: \"kubernetes.io/projected/8ab3c794-51bd-40b0-b285-55bf8e6ae8b3-kube-api-access-mp6ns\") pod \"aws-ebs-csi-driver-node-7xkp6\" (UID: \"8ab3c794-51bd-40b0-b285-55bf8e6ae8b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkp6" Jun 08 12:04:41.185610 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.185581 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t9zj\" (UniqueName: \"kubernetes.io/projected/af53aaaa-69bd-4d1e-9fb7-6eaf4b58fb13-kube-api-access-7t9zj\") pod \"node-ca-xz292\" (UID: \"af53aaaa-69bd-4d1e-9fb7-6eaf4b58fb13\") " pod="openshift-image-registry/node-ca-xz292" Jun 08 12:04:41.186297 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.186277 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqncz\" (UniqueName: \"kubernetes.io/projected/c96f0d0b-bdfb-42c4-a74f-183f2cf4876f-kube-api-access-xqncz\") pod \"ovnkube-node-94jtj\" (UID: \"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f\") " pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.186752 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.186731 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn4md\" (UniqueName: \"kubernetes.io/projected/faa7bc0a-10e1-4949-88ff-798e93b72801-kube-api-access-zn4md\") pod \"multus-additional-cni-plugins-tcm54\" (UID: \"faa7bc0a-10e1-4949-88ff-798e93b72801\") " pod="openshift-multus/multus-additional-cni-plugins-tcm54" Jun 08 12:04:41.187865 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.187848 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxbfm\" (UniqueName: \"kubernetes.io/projected/59c37349-dd98-4803-a359-6c76f3be9d75-kube-api-access-lxbfm\") pod \"multus-tfqv5\" (UID: \"59c37349-dd98-4803-a359-6c76f3be9d75\") " pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.271512 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.271480 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-etc-kubernetes\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.271630 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.271523 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-etc-sysctl-d\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.271630 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.271539 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9feeac32-9e54-42d4-85f7-3e4175f9eb08-dbus\") pod \"global-pull-secret-syncer-96gpg\" (UID: \"9feeac32-9e54-42d4-85f7-3e4175f9eb08\") " pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:04:41.271733 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.271685 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e8ddff45-74e9-4a4f-94db-ad39271f28d1-etc-tuned\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.271733 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.271694 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9feeac32-9e54-42d4-85f7-3e4175f9eb08-dbus\") pod \"global-pull-secret-syncer-96gpg\" (UID: \"9feeac32-9e54-42d4-85f7-3e4175f9eb08\") " pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:04:41.271733 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.271698 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-etc-sysctl-d\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.271837 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.271764 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-etc-kubernetes\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.271837 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.271787 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89582a50-702c-4538-a255-b1b7692c41a4-host-slash\") pod \"iptables-alerter-xj98x\" (UID: \"89582a50-702c-4538-a255-b1b7692c41a4\") " pod="openshift-network-operator/iptables-alerter-xj98x" Jun 08 12:04:41.271837 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.271806 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-run\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.271837 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.271825 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89582a50-702c-4538-a255-b1b7692c41a4-host-slash\") pod \"iptables-alerter-xj98x\" (UID: \"89582a50-702c-4538-a255-b1b7692c41a4\") " pod="openshift-network-operator/iptables-alerter-xj98x" Jun 08 12:04:41.271837 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.271828 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-host\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.272048 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.271851 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv4mp\" (UniqueName: \"kubernetes.io/projected/e8ddff45-74e9-4a4f-94db-ad39271f28d1-kube-api-access-sv4mp\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.272048 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.271852 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-host\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.272048 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.271919 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-run\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.272048 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.271948 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72rgc\" (UniqueName: \"kubernetes.io/projected/89582a50-702c-4538-a255-b1b7692c41a4-kube-api-access-72rgc\") pod \"iptables-alerter-xj98x\" (UID: \"89582a50-702c-4538-a255-b1b7692c41a4\") " pod="openshift-network-operator/iptables-alerter-xj98x" Jun 08 12:04:41.272048 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.271972 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9feeac32-9e54-42d4-85f7-3e4175f9eb08-kubelet-config\") pod \"global-pull-secret-syncer-96gpg\" (UID: \"9feeac32-9e54-42d4-85f7-3e4175f9eb08\") " pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:04:41.272048 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.271987 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9feeac32-9e54-42d4-85f7-3e4175f9eb08-original-pull-secret\") pod \"global-pull-secret-syncer-96gpg\" (UID: \"9feeac32-9e54-42d4-85f7-3e4175f9eb08\") " pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:04:41.272048 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.272034 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9feeac32-9e54-42d4-85f7-3e4175f9eb08-kubelet-config\") pod \"global-pull-secret-syncer-96gpg\" (UID: \"9feeac32-9e54-42d4-85f7-3e4175f9eb08\") " pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:04:41.272380 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.272062 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-etc-systemd\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.272380 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:41.272077 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:04:41.272380 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.272086 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-lib-modules\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.272380 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.272107 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-var-lib-kubelet\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.272380 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:41.272127 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9feeac32-9e54-42d4-85f7-3e4175f9eb08-original-pull-secret podName:9feeac32-9e54-42d4-85f7-3e4175f9eb08 nodeName:}" failed. No retries permitted until 2026-06-08 12:04:41.772110607 +0000 UTC m=+3.100459249 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9feeac32-9e54-42d4-85f7-3e4175f9eb08-original-pull-secret") pod "global-pull-secret-syncer-96gpg" (UID: "9feeac32-9e54-42d4-85f7-3e4175f9eb08") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:04:41.272380 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.272153 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87ecf61c-d270-4aeb-bf85-8ba8713e26ee-konnectivity-ca\") pod \"konnectivity-agent-7vjm8\" (UID: \"87ecf61c-d270-4aeb-bf85-8ba8713e26ee\") " pod="kube-system/konnectivity-agent-7vjm8" Jun 08 12:04:41.272380 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.272178 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-etc-sysconfig\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.272380 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.272188 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-etc-systemd\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.272380 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.272155 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-var-lib-kubelet\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.272380 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.272205 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-sys\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.272380 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.272231 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8ddff45-74e9-4a4f-94db-ad39271f28d1-tmp\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.272380 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.272256 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-etc-sysctl-conf\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.272380 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.272278 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87ecf61c-d270-4aeb-bf85-8ba8713e26ee-agent-certs\") pod \"konnectivity-agent-7vjm8\" (UID: \"87ecf61c-d270-4aeb-bf85-8ba8713e26ee\") " pod="kube-system/konnectivity-agent-7vjm8" Jun 08 12:04:41.272380 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.272301 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-lib-modules\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.272380 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.272327 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-etc-sysconfig\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.272380 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.272330 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-etc-modprobe-d\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.272380 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.272346 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-sys\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.273030 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.272370 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89582a50-702c-4538-a255-b1b7692c41a4-iptables-alerter-script\") pod \"iptables-alerter-xj98x\" (UID: \"89582a50-702c-4538-a255-b1b7692c41a4\") " pod="openshift-network-operator/iptables-alerter-xj98x" Jun 08 12:04:41.273030 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.272421 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-etc-modprobe-d\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.273030 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.272472 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e8ddff45-74e9-4a4f-94db-ad39271f28d1-etc-sysctl-conf\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.273030 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.272771 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87ecf61c-d270-4aeb-bf85-8ba8713e26ee-konnectivity-ca\") pod \"konnectivity-agent-7vjm8\" (UID: \"87ecf61c-d270-4aeb-bf85-8ba8713e26ee\") " pod="kube-system/konnectivity-agent-7vjm8" Jun 08 12:04:41.273030 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.272818 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89582a50-702c-4538-a255-b1b7692c41a4-iptables-alerter-script\") pod \"iptables-alerter-xj98x\" (UID: \"89582a50-702c-4538-a255-b1b7692c41a4\") " pod="openshift-network-operator/iptables-alerter-xj98x" Jun 08 12:04:41.274083 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.274058 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e8ddff45-74e9-4a4f-94db-ad39271f28d1-etc-tuned\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.274803 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.274526 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8ddff45-74e9-4a4f-94db-ad39271f28d1-tmp\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.274803 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.274759 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87ecf61c-d270-4aeb-bf85-8ba8713e26ee-agent-certs\") pod \"konnectivity-agent-7vjm8\" (UID: \"87ecf61c-d270-4aeb-bf85-8ba8713e26ee\") " pod="kube-system/konnectivity-agent-7vjm8" Jun 08 12:04:41.280824 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.280806 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72rgc\" (UniqueName: \"kubernetes.io/projected/89582a50-702c-4538-a255-b1b7692c41a4-kube-api-access-72rgc\") pod \"iptables-alerter-xj98x\" (UID: \"89582a50-702c-4538-a255-b1b7692c41a4\") " pod="openshift-network-operator/iptables-alerter-xj98x" Jun 08 12:04:41.281205 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.281186 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv4mp\" (UniqueName: \"kubernetes.io/projected/e8ddff45-74e9-4a4f-94db-ad39271f28d1-kube-api-access-sv4mp\") pod \"tuned-tgs2t\" (UID: \"e8ddff45-74e9-4a4f-94db-ad39271f28d1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.357828 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.357801 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkp6" Jun 08 12:04:41.365918 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.365899 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tfqv5" Jun 08 12:04:41.372773 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.372749 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w4wf6" Jun 08 12:04:41.377657 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.377642 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tcm54" Jun 08 12:04:41.384414 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.384395 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:04:41.392921 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.392905 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xz292" Jun 08 12:04:41.399471 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.399446 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" Jun 08 12:04:41.404958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.404933 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7vjm8" Jun 08 12:04:41.410522 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.410502 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xj98x" Jun 08 12:04:41.675008 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.674933 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs\") pod \"network-metrics-daemon-8tsdl\" (UID: \"50c05198-1996-4465-97df-8ae929b9410b\") " pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:04:41.675130 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:41.675057 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:04:41.675130 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:41.675109 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs podName:50c05198-1996-4465-97df-8ae929b9410b nodeName:}" failed. No retries permitted until 2026-06-08 12:04:42.675094722 +0000 UTC m=+4.003443349 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs") pod "network-metrics-daemon-8tsdl" (UID: "50c05198-1996-4465-97df-8ae929b9410b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:04:41.775785 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.775476 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9feeac32-9e54-42d4-85f7-3e4175f9eb08-original-pull-secret\") pod \"global-pull-secret-syncer-96gpg\" (UID: \"9feeac32-9e54-42d4-85f7-3e4175f9eb08\") " pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:04:41.775785 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:41.775550 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hhx4\" (UniqueName: \"kubernetes.io/projected/095c54d8-85fa-477f-a17f-416f9f0fc588-kube-api-access-4hhx4\") pod \"network-check-target-gdsnk\" (UID: \"095c54d8-85fa-477f-a17f-416f9f0fc588\") " pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:04:41.775785 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:41.775607 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:04:41.775785 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:41.775681 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9feeac32-9e54-42d4-85f7-3e4175f9eb08-original-pull-secret podName:9feeac32-9e54-42d4-85f7-3e4175f9eb08 nodeName:}" failed. No retries permitted until 2026-06-08 12:04:42.775661123 +0000 UTC m=+4.104009756 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9feeac32-9e54-42d4-85f7-3e4175f9eb08-original-pull-secret") pod "global-pull-secret-syncer-96gpg" (UID: "9feeac32-9e54-42d4-85f7-3e4175f9eb08") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:04:41.775785 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:41.775687 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:04:41.775785 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:41.775702 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:04:41.775785 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:41.775713 2565 projected.go:196] Error preparing data for projected volume kube-api-access-4hhx4 for pod openshift-network-diagnostics/network-check-target-gdsnk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:04:41.775785 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:41.775758 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/095c54d8-85fa-477f-a17f-416f9f0fc588-kube-api-access-4hhx4 podName:095c54d8-85fa-477f-a17f-416f9f0fc588 nodeName:}" failed. No retries permitted until 2026-06-08 12:04:42.775743686 +0000 UTC m=+4.104092316 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4hhx4" (UniqueName: "kubernetes.io/projected/095c54d8-85fa-477f-a17f-416f9f0fc588-kube-api-access-4hhx4") pod "network-check-target-gdsnk" (UID: "095c54d8-85fa-477f-a17f-416f9f0fc588") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:04:41.928316 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:41.928277 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ab3c794_51bd_40b0_b285_55bf8e6ae8b3.slice/crio-da3a193f01d05bd4b29c16e763b4370a9d78fee4f884b3d8841897c27b091b70 WatchSource:0}: Error finding container da3a193f01d05bd4b29c16e763b4370a9d78fee4f884b3d8841897c27b091b70: Status 404 returned error can't find the container with id da3a193f01d05bd4b29c16e763b4370a9d78fee4f884b3d8841897c27b091b70 Jun 08 12:04:41.928779 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:41.928736 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87ecf61c_d270_4aeb_bf85_8ba8713e26ee.slice/crio-470941cb56192a9ea32ee91011c547caf7cc7fb4c912004e7b1fb103afad5a95 WatchSource:0}: Error finding container 470941cb56192a9ea32ee91011c547caf7cc7fb4c912004e7b1fb103afad5a95: Status 404 returned error can't find the container with id 470941cb56192a9ea32ee91011c547caf7cc7fb4c912004e7b1fb103afad5a95 Jun 08 12:04:41.929654 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:41.929633 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaa7bc0a_10e1_4949_88ff_798e93b72801.slice/crio-ccb9547033de204bc4033473809e6f345d0084bdacc3de3e01d0e9197a774085 WatchSource:0}: Error finding container ccb9547033de204bc4033473809e6f345d0084bdacc3de3e01d0e9197a774085: Status 404 returned error can't find the container with id ccb9547033de204bc4033473809e6f345d0084bdacc3de3e01d0e9197a774085 Jun 08 12:04:41.931438 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:41.931417 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59c37349_dd98_4803_a359_6c76f3be9d75.slice/crio-de9fefae83a3a14aae8b3efd447f8a57c38936160acdc0e6f1e41ff4cf72923d WatchSource:0}: Error finding container de9fefae83a3a14aae8b3efd447f8a57c38936160acdc0e6f1e41ff4cf72923d: Status 404 returned error can't find the container with id de9fefae83a3a14aae8b3efd447f8a57c38936160acdc0e6f1e41ff4cf72923d Jun 08 12:04:41.934239 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:41.934213 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc96f0d0b_bdfb_42c4_a74f_183f2cf4876f.slice/crio-a9c3e28c08eadf34b6095da9fe7db55b0f326146b1f751c6e54cd300b67f5ec3 WatchSource:0}: Error finding container a9c3e28c08eadf34b6095da9fe7db55b0f326146b1f751c6e54cd300b67f5ec3: Status 404 returned error can't find the container with id a9c3e28c08eadf34b6095da9fe7db55b0f326146b1f751c6e54cd300b67f5ec3 Jun 08 12:04:41.936513 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:41.936493 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8ddff45_74e9_4a4f_94db_ad39271f28d1.slice/crio-3a66683fef9fe6baa955fc7aa1caf52a5a072e04670a0c5daec986259b71c3cb WatchSource:0}: Error finding container 3a66683fef9fe6baa955fc7aa1caf52a5a072e04670a0c5daec986259b71c3cb: Status 404 returned error can't find the container with id 3a66683fef9fe6baa955fc7aa1caf52a5a072e04670a0c5daec986259b71c3cb Jun 08 12:04:41.937332 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:41.937295 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeee4acbf_8c90_49e2_8573_d2386ae891cc.slice/crio-95bdcf6a6da9c38d079090d88b23e0d8474e086aeff8b0f7a47a0f94c3126667 WatchSource:0}: Error finding container 95bdcf6a6da9c38d079090d88b23e0d8474e086aeff8b0f7a47a0f94c3126667: Status 404 returned error can't find the container with id 95bdcf6a6da9c38d079090d88b23e0d8474e086aeff8b0f7a47a0f94c3126667 Jun 08 12:04:41.938645 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:41.938594 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf53aaaa_69bd_4d1e_9fb7_6eaf4b58fb13.slice/crio-535ddff4cee25cc724d9c64430a807a82090c3fe989b5ce09b91b1c0721a5fa1 WatchSource:0}: Error finding container 535ddff4cee25cc724d9c64430a807a82090c3fe989b5ce09b91b1c0721a5fa1: Status 404 returned error can't find the container with id 535ddff4cee25cc724d9c64430a807a82090c3fe989b5ce09b91b1c0721a5fa1 Jun 08 12:04:41.939628 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:04:41.939343 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89582a50_702c_4538_a255_b1b7692c41a4.slice/crio-0d9e5f19c249403732bc0870582a70138cb7e358147d3addacf26e444c5072d4 WatchSource:0}: Error finding container 0d9e5f19c249403732bc0870582a70138cb7e358147d3addacf26e444c5072d4: Status 404 returned error can't find the container with id 0d9e5f19c249403732bc0870582a70138cb7e358147d3addacf26e444c5072d4 Jun 08 12:04:42.119057 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:42.118911 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:04:42.119527 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:42.119150 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96gpg" podUID="9feeac32-9e54-42d4-85f7-3e4175f9eb08" Jun 08 12:04:42.127509 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:42.127473 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-35.ec2.internal" event={"ID":"3f0d14af2a26bde7f58d321a723d5ba5","Type":"ContainerStarted","Data":"79906728f0d80ae3942085b9f9a6b3d6ff09c7c16576137b81af7161b3176b24"} Jun 08 12:04:42.128960 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:42.128939 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xj98x" event={"ID":"89582a50-702c-4538-a255-b1b7692c41a4","Type":"ContainerStarted","Data":"0d9e5f19c249403732bc0870582a70138cb7e358147d3addacf26e444c5072d4"} Jun 08 12:04:42.130343 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:42.130318 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 11:59:41 +0000 UTC" deadline="2028-01-18 11:07:47.603100009 +0000 UTC" Jun 08 12:04:42.130343 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:42.130342 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14135h3m5.472760732s" Jun 08 12:04:42.131222 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:42.131201 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xz292" event={"ID":"af53aaaa-69bd-4d1e-9fb7-6eaf4b58fb13","Type":"ContainerStarted","Data":"535ddff4cee25cc724d9c64430a807a82090c3fe989b5ce09b91b1c0721a5fa1"} Jun 08 12:04:42.132352 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:42.132332 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w4wf6" event={"ID":"eee4acbf-8c90-49e2-8573-d2386ae891cc","Type":"ContainerStarted","Data":"95bdcf6a6da9c38d079090d88b23e0d8474e086aeff8b0f7a47a0f94c3126667"} Jun 08 12:04:42.133743 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:42.133725 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" event={"ID":"e8ddff45-74e9-4a4f-94db-ad39271f28d1","Type":"ContainerStarted","Data":"3a66683fef9fe6baa955fc7aa1caf52a5a072e04670a0c5daec986259b71c3cb"} Jun 08 12:04:42.134730 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:42.134706 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" event={"ID":"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f","Type":"ContainerStarted","Data":"a9c3e28c08eadf34b6095da9fe7db55b0f326146b1f751c6e54cd300b67f5ec3"} Jun 08 12:04:42.135843 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:42.135824 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tfqv5" event={"ID":"59c37349-dd98-4803-a359-6c76f3be9d75","Type":"ContainerStarted","Data":"de9fefae83a3a14aae8b3efd447f8a57c38936160acdc0e6f1e41ff4cf72923d"} Jun 08 12:04:42.137456 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:42.137437 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tcm54" event={"ID":"faa7bc0a-10e1-4949-88ff-798e93b72801","Type":"ContainerStarted","Data":"ccb9547033de204bc4033473809e6f345d0084bdacc3de3e01d0e9197a774085"} Jun 08 12:04:42.139588 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:42.139569 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7vjm8" event={"ID":"87ecf61c-d270-4aeb-bf85-8ba8713e26ee","Type":"ContainerStarted","Data":"470941cb56192a9ea32ee91011c547caf7cc7fb4c912004e7b1fb103afad5a95"} Jun 08 12:04:42.143468 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:42.143442 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkp6" event={"ID":"8ab3c794-51bd-40b0-b285-55bf8e6ae8b3","Type":"ContainerStarted","Data":"da3a193f01d05bd4b29c16e763b4370a9d78fee4f884b3d8841897c27b091b70"} Jun 08 12:04:42.682554 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:42.682519 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs\") pod \"network-metrics-daemon-8tsdl\" (UID: \"50c05198-1996-4465-97df-8ae929b9410b\") " pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:04:42.682738 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:42.682699 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:04:42.682931 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:42.682764 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs podName:50c05198-1996-4465-97df-8ae929b9410b nodeName:}" failed. No retries permitted until 2026-06-08 12:04:44.682743423 +0000 UTC m=+6.011092070 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs") pod "network-metrics-daemon-8tsdl" (UID: "50c05198-1996-4465-97df-8ae929b9410b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:04:42.783803 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:42.783758 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9feeac32-9e54-42d4-85f7-3e4175f9eb08-original-pull-secret\") pod \"global-pull-secret-syncer-96gpg\" (UID: \"9feeac32-9e54-42d4-85f7-3e4175f9eb08\") " pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:04:42.783990 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:42.783823 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hhx4\" (UniqueName: \"kubernetes.io/projected/095c54d8-85fa-477f-a17f-416f9f0fc588-kube-api-access-4hhx4\") pod \"network-check-target-gdsnk\" (UID: \"095c54d8-85fa-477f-a17f-416f9f0fc588\") " pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:04:42.783990 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:42.783891 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:04:42.783990 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:42.783967 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9feeac32-9e54-42d4-85f7-3e4175f9eb08-original-pull-secret podName:9feeac32-9e54-42d4-85f7-3e4175f9eb08 nodeName:}" failed. No retries permitted until 2026-06-08 12:04:44.78394575 +0000 UTC m=+6.112294397 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9feeac32-9e54-42d4-85f7-3e4175f9eb08-original-pull-secret") pod "global-pull-secret-syncer-96gpg" (UID: "9feeac32-9e54-42d4-85f7-3e4175f9eb08") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:04:42.783990 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:42.783979 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:04:42.784190 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:42.783999 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:04:42.784190 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:42.784013 2565 projected.go:196] Error preparing data for projected volume kube-api-access-4hhx4 for pod openshift-network-diagnostics/network-check-target-gdsnk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:04:42.784190 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:42.784061 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/095c54d8-85fa-477f-a17f-416f9f0fc588-kube-api-access-4hhx4 podName:095c54d8-85fa-477f-a17f-416f9f0fc588 nodeName:}" failed. No retries permitted until 2026-06-08 12:04:44.784045406 +0000 UTC m=+6.112394035 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4hhx4" (UniqueName: "kubernetes.io/projected/095c54d8-85fa-477f-a17f-416f9f0fc588-kube-api-access-4hhx4") pod "network-check-target-gdsnk" (UID: "095c54d8-85fa-477f-a17f-416f9f0fc588") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:04:43.074904 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:43.074829 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:04:43.120859 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:43.120833 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:04:43.121409 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:43.120952 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tsdl" podUID="50c05198-1996-4465-97df-8ae929b9410b" Jun 08 12:04:43.121409 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:43.121342 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:04:43.121529 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:43.121427 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdsnk" podUID="095c54d8-85fa-477f-a17f-416f9f0fc588" Jun 08 12:04:43.131262 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:43.131183 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 11:59:41 +0000 UTC" deadline="2028-01-18 02:03:00.241458635 +0000 UTC" Jun 08 12:04:43.131262 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:43.131237 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14125h58m17.11022466s" Jun 08 12:04:43.169001 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:43.168949 2565 generic.go:356] "Generic (PLEG): container finished" podID="e8bdb6261778b7a080713b42923a31a4" containerID="6bd9b38c00c1a9d6903ae6da27646c21f71c58f227e1fb200ef03ef7f022e09f" exitCode=0 Jun 08 12:04:43.169882 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:43.169856 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-35.ec2.internal" event={"ID":"e8bdb6261778b7a080713b42923a31a4","Type":"ContainerDied","Data":"6bd9b38c00c1a9d6903ae6da27646c21f71c58f227e1fb200ef03ef7f022e09f"} Jun 08 12:04:43.185849 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:43.185801 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-35.ec2.internal" podStartSLOduration=3.185783082 podStartE2EDuration="3.185783082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:04:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:04:42.146237376 +0000 UTC m=+3.474586026" watchObservedRunningTime="2026-06-08 12:04:43.185783082 +0000 UTC m=+4.514131732" Jun 08 12:04:44.118888 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:44.118859 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:04:44.119055 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:44.118983 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96gpg" podUID="9feeac32-9e54-42d4-85f7-3e4175f9eb08" Jun 08 12:04:44.185085 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:44.185037 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-35.ec2.internal" event={"ID":"e8bdb6261778b7a080713b42923a31a4","Type":"ContainerStarted","Data":"36f395cc9c500c3b334f6e9b53202e04ca19acbbf868189b81a4dba511bfdb50"} Jun 08 12:04:44.702808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:44.702772 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs\") pod \"network-metrics-daemon-8tsdl\" (UID: \"50c05198-1996-4465-97df-8ae929b9410b\") " pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:04:44.703005 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:44.702969 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:04:44.703063 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:44.703030 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs podName:50c05198-1996-4465-97df-8ae929b9410b nodeName:}" failed. No retries permitted until 2026-06-08 12:04:48.703012511 +0000 UTC m=+10.031361142 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs") pod "network-metrics-daemon-8tsdl" (UID: "50c05198-1996-4465-97df-8ae929b9410b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:04:44.804168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:44.804130 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9feeac32-9e54-42d4-85f7-3e4175f9eb08-original-pull-secret\") pod \"global-pull-secret-syncer-96gpg\" (UID: \"9feeac32-9e54-42d4-85f7-3e4175f9eb08\") " pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:04:44.804352 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:44.804196 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hhx4\" (UniqueName: \"kubernetes.io/projected/095c54d8-85fa-477f-a17f-416f9f0fc588-kube-api-access-4hhx4\") pod \"network-check-target-gdsnk\" (UID: \"095c54d8-85fa-477f-a17f-416f9f0fc588\") " pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:04:44.804437 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:44.804403 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:04:44.804484 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:44.804473 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9feeac32-9e54-42d4-85f7-3e4175f9eb08-original-pull-secret podName:9feeac32-9e54-42d4-85f7-3e4175f9eb08 nodeName:}" failed. No retries permitted until 2026-06-08 12:04:48.804454128 +0000 UTC m=+10.132802757 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9feeac32-9e54-42d4-85f7-3e4175f9eb08-original-pull-secret") pod "global-pull-secret-syncer-96gpg" (UID: "9feeac32-9e54-42d4-85f7-3e4175f9eb08") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:04:44.804541 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:44.804515 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:04:44.804541 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:44.804536 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:04:44.804630 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:44.804549 2565 projected.go:196] Error preparing data for projected volume kube-api-access-4hhx4 for pod openshift-network-diagnostics/network-check-target-gdsnk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:04:44.804630 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:44.804590 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/095c54d8-85fa-477f-a17f-416f9f0fc588-kube-api-access-4hhx4 podName:095c54d8-85fa-477f-a17f-416f9f0fc588 nodeName:}" failed. No retries permitted until 2026-06-08 12:04:48.804578256 +0000 UTC m=+10.132926888 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4hhx4" (UniqueName: "kubernetes.io/projected/095c54d8-85fa-477f-a17f-416f9f0fc588-kube-api-access-4hhx4") pod "network-check-target-gdsnk" (UID: "095c54d8-85fa-477f-a17f-416f9f0fc588") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:04:45.118798 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:45.118766 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:04:45.118798 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:45.118790 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:04:45.119001 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:45.118906 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdsnk" podUID="095c54d8-85fa-477f-a17f-416f9f0fc588" Jun 08 12:04:45.119063 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:45.119027 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tsdl" podUID="50c05198-1996-4465-97df-8ae929b9410b" Jun 08 12:04:46.118964 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:46.118481 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:04:46.118964 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:46.118614 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96gpg" podUID="9feeac32-9e54-42d4-85f7-3e4175f9eb08" Jun 08 12:04:47.118535 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:47.118480 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:04:47.118724 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:47.118618 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdsnk" podUID="095c54d8-85fa-477f-a17f-416f9f0fc588" Jun 08 12:04:47.118724 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:47.118663 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:04:47.118833 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:47.118793 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tsdl" podUID="50c05198-1996-4465-97df-8ae929b9410b" Jun 08 12:04:48.118219 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:48.118185 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:04:48.118580 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:48.118332 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96gpg" podUID="9feeac32-9e54-42d4-85f7-3e4175f9eb08" Jun 08 12:04:48.738022 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:48.737984 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs\") pod \"network-metrics-daemon-8tsdl\" (UID: \"50c05198-1996-4465-97df-8ae929b9410b\") " pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:04:48.738240 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:48.738221 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:04:48.738346 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:48.738292 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs podName:50c05198-1996-4465-97df-8ae929b9410b nodeName:}" failed. No retries permitted until 2026-06-08 12:04:56.738271492 +0000 UTC m=+18.066620149 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs") pod "network-metrics-daemon-8tsdl" (UID: "50c05198-1996-4465-97df-8ae929b9410b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:04:48.838754 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:48.838717 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9feeac32-9e54-42d4-85f7-3e4175f9eb08-original-pull-secret\") pod \"global-pull-secret-syncer-96gpg\" (UID: \"9feeac32-9e54-42d4-85f7-3e4175f9eb08\") " pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:04:48.838908 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:48.838773 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hhx4\" (UniqueName: \"kubernetes.io/projected/095c54d8-85fa-477f-a17f-416f9f0fc588-kube-api-access-4hhx4\") pod \"network-check-target-gdsnk\" (UID: \"095c54d8-85fa-477f-a17f-416f9f0fc588\") " pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:04:48.838908 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:48.838880 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:04:48.839034 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:48.838922 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:04:48.839034 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:48.838939 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:04:48.839034 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:48.838951 2565 projected.go:196] Error preparing data for projected volume kube-api-access-4hhx4 for pod openshift-network-diagnostics/network-check-target-gdsnk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:04:48.839034 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:48.838955 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9feeac32-9e54-42d4-85f7-3e4175f9eb08-original-pull-secret podName:9feeac32-9e54-42d4-85f7-3e4175f9eb08 nodeName:}" failed. No retries permitted until 2026-06-08 12:04:56.838936518 +0000 UTC m=+18.167285150 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9feeac32-9e54-42d4-85f7-3e4175f9eb08-original-pull-secret") pod "global-pull-secret-syncer-96gpg" (UID: "9feeac32-9e54-42d4-85f7-3e4175f9eb08") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:04:48.839034 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:48.838999 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/095c54d8-85fa-477f-a17f-416f9f0fc588-kube-api-access-4hhx4 podName:095c54d8-85fa-477f-a17f-416f9f0fc588 nodeName:}" failed. No retries permitted until 2026-06-08 12:04:56.838982943 +0000 UTC m=+18.167331590 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4hhx4" (UniqueName: "kubernetes.io/projected/095c54d8-85fa-477f-a17f-416f9f0fc588-kube-api-access-4hhx4") pod "network-check-target-gdsnk" (UID: "095c54d8-85fa-477f-a17f-416f9f0fc588") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:04:49.121380 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:49.121109 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:04:49.121380 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:49.121252 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdsnk" podUID="095c54d8-85fa-477f-a17f-416f9f0fc588" Jun 08 12:04:49.122140 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:49.121984 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:04:49.122140 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:49.122086 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tsdl" podUID="50c05198-1996-4465-97df-8ae929b9410b" Jun 08 12:04:50.119019 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:50.118520 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:04:50.119019 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:50.118655 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96gpg" podUID="9feeac32-9e54-42d4-85f7-3e4175f9eb08" Jun 08 12:04:51.118880 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:51.118765 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:04:51.119380 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:51.118898 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdsnk" podUID="095c54d8-85fa-477f-a17f-416f9f0fc588" Jun 08 12:04:51.119380 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:51.119265 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:04:51.119495 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:51.119379 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tsdl" podUID="50c05198-1996-4465-97df-8ae929b9410b" Jun 08 12:04:52.118763 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:52.118734 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:04:52.118936 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:52.118858 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96gpg" podUID="9feeac32-9e54-42d4-85f7-3e4175f9eb08" Jun 08 12:04:53.118686 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:53.118644 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:04:53.118868 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:53.118652 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:04:53.118868 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:53.118796 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tsdl" podUID="50c05198-1996-4465-97df-8ae929b9410b" Jun 08 12:04:53.118868 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:53.118848 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdsnk" podUID="095c54d8-85fa-477f-a17f-416f9f0fc588" Jun 08 12:04:54.118639 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:54.118609 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:04:54.118797 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:54.118739 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96gpg" podUID="9feeac32-9e54-42d4-85f7-3e4175f9eb08" Jun 08 12:04:55.119001 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:55.118966 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:04:55.119423 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:55.118966 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:04:55.119423 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:55.119105 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tsdl" podUID="50c05198-1996-4465-97df-8ae929b9410b" Jun 08 12:04:55.119423 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:55.119138 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdsnk" podUID="095c54d8-85fa-477f-a17f-416f9f0fc588" Jun 08 12:04:56.118388 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:56.118344 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:04:56.118580 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:56.118471 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96gpg" podUID="9feeac32-9e54-42d4-85f7-3e4175f9eb08" Jun 08 12:04:56.797415 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:56.797365 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs\") pod \"network-metrics-daemon-8tsdl\" (UID: \"50c05198-1996-4465-97df-8ae929b9410b\") " pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:04:56.797857 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:56.797551 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:04:56.797857 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:56.797622 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs podName:50c05198-1996-4465-97df-8ae929b9410b nodeName:}" failed. No retries permitted until 2026-06-08 12:05:12.797601304 +0000 UTC m=+34.125949948 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs") pod "network-metrics-daemon-8tsdl" (UID: "50c05198-1996-4465-97df-8ae929b9410b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:04:56.898119 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:56.898073 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9feeac32-9e54-42d4-85f7-3e4175f9eb08-original-pull-secret\") pod \"global-pull-secret-syncer-96gpg\" (UID: \"9feeac32-9e54-42d4-85f7-3e4175f9eb08\") " pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:04:56.898299 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:56.898137 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hhx4\" (UniqueName: \"kubernetes.io/projected/095c54d8-85fa-477f-a17f-416f9f0fc588-kube-api-access-4hhx4\") pod \"network-check-target-gdsnk\" (UID: \"095c54d8-85fa-477f-a17f-416f9f0fc588\") " pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:04:56.898299 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:56.898234 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:04:56.898299 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:56.898245 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:04:56.898299 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:56.898259 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:04:56.898299 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:56.898273 2565 projected.go:196] Error preparing data for projected volume kube-api-access-4hhx4 for pod openshift-network-diagnostics/network-check-target-gdsnk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:04:56.898572 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:56.898318 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9feeac32-9e54-42d4-85f7-3e4175f9eb08-original-pull-secret podName:9feeac32-9e54-42d4-85f7-3e4175f9eb08 nodeName:}" failed. No retries permitted until 2026-06-08 12:05:12.898286221 +0000 UTC m=+34.226634850 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9feeac32-9e54-42d4-85f7-3e4175f9eb08-original-pull-secret") pod "global-pull-secret-syncer-96gpg" (UID: "9feeac32-9e54-42d4-85f7-3e4175f9eb08") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:04:56.898572 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:56.898339 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/095c54d8-85fa-477f-a17f-416f9f0fc588-kube-api-access-4hhx4 podName:095c54d8-85fa-477f-a17f-416f9f0fc588 nodeName:}" failed. No retries permitted until 2026-06-08 12:05:12.898327677 +0000 UTC m=+34.226676305 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4hhx4" (UniqueName: "kubernetes.io/projected/095c54d8-85fa-477f-a17f-416f9f0fc588-kube-api-access-4hhx4") pod "network-check-target-gdsnk" (UID: "095c54d8-85fa-477f-a17f-416f9f0fc588") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:04:57.118752 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:57.118667 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:04:57.118922 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:57.118667 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:04:57.118922 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:57.118817 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tsdl" podUID="50c05198-1996-4465-97df-8ae929b9410b" Jun 08 12:04:57.118922 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:57.118892 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdsnk" podUID="095c54d8-85fa-477f-a17f-416f9f0fc588" Jun 08 12:04:58.118910 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:58.118871 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:04:58.119300 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:58.118976 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96gpg" podUID="9feeac32-9e54-42d4-85f7-3e4175f9eb08" Jun 08 12:04:59.119735 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:59.119701 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:04:59.120153 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:04:59.119783 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:04:59.120153 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:59.119812 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tsdl" podUID="50c05198-1996-4465-97df-8ae929b9410b" Jun 08 12:04:59.120153 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:04:59.119882 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdsnk" podUID="095c54d8-85fa-477f-a17f-416f9f0fc588" Jun 08 12:05:00.118787 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:00.118764 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:05:00.118881 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:00.118865 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96gpg" podUID="9feeac32-9e54-42d4-85f7-3e4175f9eb08" Jun 08 12:05:01.118639 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:01.118182 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:05:01.119177 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:01.118184 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:05:01.119177 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:01.118749 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdsnk" podUID="095c54d8-85fa-477f-a17f-416f9f0fc588" Jun 08 12:05:01.119177 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:01.118806 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tsdl" podUID="50c05198-1996-4465-97df-8ae929b9410b" Jun 08 12:05:01.219260 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:01.219118 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7vjm8" event={"ID":"87ecf61c-d270-4aeb-bf85-8ba8713e26ee","Type":"ContainerStarted","Data":"dd615d8db85017d1531c04e238c479e3e2e120a872e6745786dc24fbc22b31a9"} Jun 08 12:05:01.220653 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:01.220626 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkp6" event={"ID":"8ab3c794-51bd-40b0-b285-55bf8e6ae8b3","Type":"ContainerStarted","Data":"ad1acefefab7a01ac49d9530346f571bc5b2a117009a81f4653c262808f8dcd3"} Jun 08 12:05:01.222127 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:01.222101 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xz292" event={"ID":"af53aaaa-69bd-4d1e-9fb7-6eaf4b58fb13","Type":"ContainerStarted","Data":"9fd443f829f952b5ac76bb384af0f6c1298ffc6063f3208c41686976340c68b1"} Jun 08 12:05:01.223596 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:01.223567 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w4wf6" event={"ID":"eee4acbf-8c90-49e2-8573-d2386ae891cc","Type":"ContainerStarted","Data":"6adebd295692f149eb8b9e3fa91f2b87c7e57dcedc212d53aaf55f3f50ca32a3"} Jun 08 12:05:01.225030 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:01.225002 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" event={"ID":"e8ddff45-74e9-4a4f-94db-ad39271f28d1","Type":"ContainerStarted","Data":"981880c13913f4fe0bfb9d715dec62a09306ec604e99f3298ffd365b92929190"} Jun 08 12:05:01.227805 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:01.227788 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94jtj_c96f0d0b-bdfb-42c4-a74f-183f2cf4876f/ovn-acl-logging/0.log" Jun 08 12:05:01.228160 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:01.228138 2565 generic.go:356] "Generic (PLEG): container finished" podID="c96f0d0b-bdfb-42c4-a74f-183f2cf4876f" containerID="5660d1a57f640da7b9a862491fcd444f33ad562b764580275f1640ea01b67d46" exitCode=1 Jun 08 12:05:01.228241 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:01.228212 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" event={"ID":"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f","Type":"ContainerStarted","Data":"70d578da6311cf1fbeed7fd0a2538b879b359c671159b62900d341d99ff33355"} Jun 08 12:05:01.228298 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:01.228275 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" event={"ID":"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f","Type":"ContainerStarted","Data":"2883acab7139551c8dcc9b46a4b9c4b4f18fde00490522c0df0a48b45d8b0657"} Jun 08 12:05:01.228380 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:01.228359 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" event={"ID":"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f","Type":"ContainerStarted","Data":"e072de400f07b026d4a568e008c722214c01ee574b6a229efa98cfaf1f1af5a8"} Jun 08 12:05:01.228430 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:01.228409 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" event={"ID":"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f","Type":"ContainerStarted","Data":"90e6a0ac29aeaf65100f5b0c01d7718d5c5127303c72bb7afa3bf2aae939a9a5"} Jun 08 12:05:01.228484 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:01.228452 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" event={"ID":"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f","Type":"ContainerDied","Data":"5660d1a57f640da7b9a862491fcd444f33ad562b764580275f1640ea01b67d46"} Jun 08 12:05:01.228532 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:01.228500 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" event={"ID":"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f","Type":"ContainerStarted","Data":"0d17f04e056015f2d120b46b5a383b54b2edbbc8ea068aaf9798e625cf8eaca4"} Jun 08 12:05:01.231570 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:01.231548 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tfqv5" event={"ID":"59c37349-dd98-4803-a359-6c76f3be9d75","Type":"ContainerStarted","Data":"103f6ce29055cab44373d12a9f283a653e9f819e1ce3d4d3a9ab4466fb039365"} Jun 08 12:05:01.233607 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:01.233544 2565 generic.go:356] "Generic (PLEG): container finished" podID="faa7bc0a-10e1-4949-88ff-798e93b72801" containerID="68761babd5934f8efc0802706bdc08ecb015eaca16b453b375e8dee9ee187ca8" exitCode=0 Jun 08 12:05:01.233607 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:01.233583 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tcm54" event={"ID":"faa7bc0a-10e1-4949-88ff-798e93b72801","Type":"ContainerDied","Data":"68761babd5934f8efc0802706bdc08ecb015eaca16b453b375e8dee9ee187ca8"} Jun 08 12:05:01.236540 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:01.236497 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7vjm8" podStartSLOduration=4.008280903 podStartE2EDuration="22.236480767s" totalImagesPullingTime="18.228199864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:01.235810938 +0000 UTC m=+22.564159587" watchObservedRunningTime="2026-06-08 12:05:01.236480767 +0000 UTC m=+22.564829417" Jun 08 12:05:01.236877 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:01.236844 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-35.ec2.internal" podStartSLOduration=21.236837503 podStartE2EDuration="21.236837503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:04:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:04:44.213870059 +0000 UTC m=+5.542218716" watchObservedRunningTime="2026-06-08 12:05:01.236837503 +0000 UTC m=+22.565186153" Jun 08 12:05:01.257039 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:01.256992 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tfqv5" podStartSLOduration=3.998932468 podStartE2EDuration="22.256980851s" totalImagesPullingTime="18.258048383s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:01.256210914 +0000 UTC m=+22.584559576" watchObservedRunningTime="2026-06-08 12:05:01.256980851 +0000 UTC m=+22.585329499" Jun 08 12:05:01.272404 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:01.272352 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-w4wf6" podStartSLOduration=4.015933048 podStartE2EDuration="22.272338609s" totalImagesPullingTime="18.256405561s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:01.272259045 +0000 UTC m=+22.600607696" watchObservedRunningTime="2026-06-08 12:05:01.272338609 +0000 UTC m=+22.600687258" Jun 08 12:05:01.315622 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:01.315580 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xz292" podStartSLOduration=4.097085877 podStartE2EDuration="22.315565861s" totalImagesPullingTime="18.218479984s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:01.315430613 +0000 UTC m=+22.643779261" watchObservedRunningTime="2026-06-08 12:05:01.315565861 +0000 UTC m=+22.643914565" Jun 08 12:05:01.337395 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:01.337355 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tgs2t" podStartSLOduration=4.086067572 podStartE2EDuration="22.337342306s" totalImagesPullingTime="18.251274734s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:01.336999361 +0000 UTC m=+22.665348009" watchObservedRunningTime="2026-06-08 12:05:01.337342306 +0000 UTC m=+22.665690955" Jun 08 12:05:01.802873 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:01.802852 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 12:05:02.118405 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:02.118341 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:05:02.118536 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:02.118432 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96gpg" podUID="9feeac32-9e54-42d4-85f7-3e4175f9eb08" Jun 08 12:05:02.121440 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:02.121365 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T12:05:01.802869422Z","UUID":"30bbd803-9b30-4073-b0d5-a60ced248dcd","Handler":null,"Name":"","Endpoint":""} Jun 08 12:05:02.122787 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:02.122769 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 12:05:02.122896 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:02.122799 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 12:05:02.237937 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:02.237906 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xj98x" event={"ID":"89582a50-702c-4538-a255-b1b7692c41a4","Type":"ContainerStarted","Data":"2b186368179635542438f26df21d269f31da48f62688f8f47c1675228788c84b"} Jun 08 12:05:02.240417 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:02.240358 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkp6" event={"ID":"8ab3c794-51bd-40b0-b285-55bf8e6ae8b3","Type":"ContainerStarted","Data":"134b7cf16704670e628593df9e03952ccc39851d556f57f1d7af327ee9c595ac"} Jun 08 12:05:02.253037 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:02.252989 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xj98x" podStartSLOduration=5.002654717 podStartE2EDuration="23.252975694s" totalImagesPullingTime="18.250320977s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:02.252636372 +0000 UTC m=+23.580985020" watchObservedRunningTime="2026-06-08 12:05:02.252975694 +0000 UTC m=+23.581324343" Jun 08 12:05:02.740552 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:02.740520 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7vjm8" Jun 08 12:05:02.741440 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:02.741419 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7vjm8" Jun 08 12:05:03.118805 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:03.118784 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:05:03.118909 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:03.118806 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:05:03.118975 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:03.118907 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdsnk" podUID="095c54d8-85fa-477f-a17f-416f9f0fc588" Jun 08 12:05:03.119057 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:03.119033 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tsdl" podUID="50c05198-1996-4465-97df-8ae929b9410b" Jun 08 12:05:03.244701 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:03.244668 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkp6" event={"ID":"8ab3c794-51bd-40b0-b285-55bf8e6ae8b3","Type":"ContainerStarted","Data":"89e94284b6a10a42352325246998754596e69223a78dc15a33d371fab5506a9b"} Jun 08 12:05:03.247409 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:03.247387 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94jtj_c96f0d0b-bdfb-42c4-a74f-183f2cf4876f/ovn-acl-logging/0.log" Jun 08 12:05:03.247701 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:03.247683 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" event={"ID":"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f","Type":"ContainerStarted","Data":"f3675731e943d36c334ff263f665888b4c8ecbaf05aa41beaeb49e309eadad27"} Jun 08 12:05:03.248004 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:03.247967 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7vjm8" Jun 08 12:05:03.250738 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:03.248588 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7vjm8" Jun 08 12:05:03.267002 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:03.266951 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkp6" podStartSLOduration=3.867436721 podStartE2EDuration="24.266932961s" totalImagesPullingTime="20.39949624s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:04:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:03.266336595 +0000 UTC m=+24.594685244" watchObservedRunningTime="2026-06-08 12:05:03.266932961 +0000 UTC m=+24.595281628" Jun 08 12:05:04.118767 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:04.118539 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:05:04.118941 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:04.118850 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96gpg" podUID="9feeac32-9e54-42d4-85f7-3e4175f9eb08" Jun 08 12:05:05.118299 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:05.118263 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:05:05.118299 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:05.118299 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:05:05.118774 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:05.118409 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdsnk" podUID="095c54d8-85fa-477f-a17f-416f9f0fc588" Jun 08 12:05:05.118774 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:05.118541 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tsdl" podUID="50c05198-1996-4465-97df-8ae929b9410b" Jun 08 12:05:06.118369 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:06.118347 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:05:06.118644 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:06.118438 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96gpg" podUID="9feeac32-9e54-42d4-85f7-3e4175f9eb08" Jun 08 12:05:06.257095 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:06.257068 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94jtj_c96f0d0b-bdfb-42c4-a74f-183f2cf4876f/ovn-acl-logging/0.log" Jun 08 12:05:06.257421 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:06.257398 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" event={"ID":"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f","Type":"ContainerStarted","Data":"67a2399e13bb0914b78bb28b51ed622ca6082d561e14e34044eed6a0fb844490"} Jun 08 12:05:06.257701 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:06.257676 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:05:06.257802 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:06.257740 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:05:06.257887 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:06.257870 2565 scope.go:117] "RemoveContainer" containerID="5660d1a57f640da7b9a862491fcd444f33ad562b764580275f1640ea01b67d46" Jun 08 12:05:06.274373 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:06.273873 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:05:07.118546 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:07.118512 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:05:07.118896 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:07.118618 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tsdl" podUID="50c05198-1996-4465-97df-8ae929b9410b" Jun 08 12:05:07.118896 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:07.118671 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:05:07.118896 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:07.118754 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdsnk" podUID="095c54d8-85fa-477f-a17f-416f9f0fc588" Jun 08 12:05:07.262627 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:07.262600 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94jtj_c96f0d0b-bdfb-42c4-a74f-183f2cf4876f/ovn-acl-logging/0.log" Jun 08 12:05:07.262947 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:07.262929 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" event={"ID":"c96f0d0b-bdfb-42c4-a74f-183f2cf4876f","Type":"ContainerStarted","Data":"29e187df2124623b33becf6593590221d987904763d8a5aa5dc80b5f3ecc4ee9"} Jun 08 12:05:07.263205 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:07.263185 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:05:07.264834 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:07.264809 2565 generic.go:356] "Generic (PLEG): container finished" podID="faa7bc0a-10e1-4949-88ff-798e93b72801" containerID="17e9847a21780978b8122bea0223e4323a355194e455e61f22beeb356b271d39" exitCode=0 Jun 08 12:05:07.264944 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:07.264861 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tcm54" event={"ID":"faa7bc0a-10e1-4949-88ff-798e93b72801","Type":"ContainerDied","Data":"17e9847a21780978b8122bea0223e4323a355194e455e61f22beeb356b271d39"} Jun 08 12:05:07.277906 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:07.277886 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:05:07.301784 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:07.301702 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" podStartSLOduration=9.907224065 podStartE2EDuration="28.301688993s" totalImagesPullingTime="18.394464928s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:07.301215357 +0000 UTC m=+28.629564004" watchObservedRunningTime="2026-06-08 12:05:07.301688993 +0000 UTC m=+28.630037642" Jun 08 12:05:08.119023 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:08.118993 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:05:08.119687 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:08.119092 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96gpg" podUID="9feeac32-9e54-42d4-85f7-3e4175f9eb08" Jun 08 12:05:08.268731 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:08.268656 2565 generic.go:356] "Generic (PLEG): container finished" podID="faa7bc0a-10e1-4949-88ff-798e93b72801" containerID="50da406fe4d103f572ab1d5ebfcc375add75889f49747826505e23d1a024931d" exitCode=0 Jun 08 12:05:08.268879 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:08.268737 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tcm54" event={"ID":"faa7bc0a-10e1-4949-88ff-798e93b72801","Type":"ContainerDied","Data":"50da406fe4d103f572ab1d5ebfcc375add75889f49747826505e23d1a024931d"} Jun 08 12:05:08.296400 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:08.296354 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-96gpg"] Jun 08 12:05:08.296579 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:08.296468 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:05:08.296579 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:08.296555 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96gpg" podUID="9feeac32-9e54-42d4-85f7-3e4175f9eb08" Jun 08 12:05:08.298950 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:08.298926 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gdsnk"] Jun 08 12:05:08.299068 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:08.299015 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:05:08.299107 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:08.299084 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdsnk" podUID="095c54d8-85fa-477f-a17f-416f9f0fc588" Jun 08 12:05:08.315629 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:08.315594 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8tsdl"] Jun 08 12:05:08.315772 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:08.315699 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:05:08.315813 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:08.315778 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tsdl" podUID="50c05198-1996-4465-97df-8ae929b9410b" Jun 08 12:05:09.273094 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:09.273059 2565 generic.go:356] "Generic (PLEG): container finished" podID="faa7bc0a-10e1-4949-88ff-798e93b72801" containerID="3ab5d5ddbf9580d798a058e56ad38d8fc4fc1f5f0a100dd7a7571a4e184e34af" exitCode=0 Jun 08 12:05:09.273533 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:09.273138 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tcm54" event={"ID":"faa7bc0a-10e1-4949-88ff-798e93b72801","Type":"ContainerDied","Data":"3ab5d5ddbf9580d798a058e56ad38d8fc4fc1f5f0a100dd7a7571a4e184e34af"} Jun 08 12:05:10.119752 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:10.119228 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:05:10.119752 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:10.119379 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tsdl" podUID="50c05198-1996-4465-97df-8ae929b9410b" Jun 08 12:05:10.119967 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:10.119780 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:05:10.119967 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:10.119793 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:05:10.119967 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:10.119880 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96gpg" podUID="9feeac32-9e54-42d4-85f7-3e4175f9eb08" Jun 08 12:05:10.119967 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:10.119960 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdsnk" podUID="095c54d8-85fa-477f-a17f-416f9f0fc588" Jun 08 12:05:12.118538 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:12.118499 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:05:12.119006 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:12.118499 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:05:12.119006 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:12.118638 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-96gpg" podUID="9feeac32-9e54-42d4-85f7-3e4175f9eb08" Jun 08 12:05:12.119006 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:12.118731 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tsdl" podUID="50c05198-1996-4465-97df-8ae929b9410b" Jun 08 12:05:12.119006 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:12.118499 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:05:12.119006 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:12.118815 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdsnk" podUID="095c54d8-85fa-477f-a17f-416f9f0fc588" Jun 08 12:05:12.815045 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:12.815001 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs\") pod \"network-metrics-daemon-8tsdl\" (UID: \"50c05198-1996-4465-97df-8ae929b9410b\") " pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:05:12.815237 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:12.815188 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:05:12.815294 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:12.815269 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs podName:50c05198-1996-4465-97df-8ae929b9410b nodeName:}" failed. No retries permitted until 2026-06-08 12:05:44.815248405 +0000 UTC m=+66.143597049 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs") pod "network-metrics-daemon-8tsdl" (UID: "50c05198-1996-4465-97df-8ae929b9410b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:05:12.915749 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:12.915708 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9feeac32-9e54-42d4-85f7-3e4175f9eb08-original-pull-secret\") pod \"global-pull-secret-syncer-96gpg\" (UID: \"9feeac32-9e54-42d4-85f7-3e4175f9eb08\") " pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:05:12.915919 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:12.915766 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hhx4\" (UniqueName: \"kubernetes.io/projected/095c54d8-85fa-477f-a17f-416f9f0fc588-kube-api-access-4hhx4\") pod \"network-check-target-gdsnk\" (UID: \"095c54d8-85fa-477f-a17f-416f9f0fc588\") " pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:05:12.915919 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:12.915883 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:05:12.915919 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:12.915905 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:05:12.916086 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:12.915924 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:05:12.916086 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:12.915936 2565 projected.go:196] Error preparing data for projected volume kube-api-access-4hhx4 for pod openshift-network-diagnostics/network-check-target-gdsnk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:05:12.916086 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:12.915965 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9feeac32-9e54-42d4-85f7-3e4175f9eb08-original-pull-secret podName:9feeac32-9e54-42d4-85f7-3e4175f9eb08 nodeName:}" failed. No retries permitted until 2026-06-08 12:05:44.915944767 +0000 UTC m=+66.244293399 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9feeac32-9e54-42d4-85f7-3e4175f9eb08-original-pull-secret") pod "global-pull-secret-syncer-96gpg" (UID: "9feeac32-9e54-42d4-85f7-3e4175f9eb08") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:05:12.916086 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:12.915986 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/095c54d8-85fa-477f-a17f-416f9f0fc588-kube-api-access-4hhx4 podName:095c54d8-85fa-477f-a17f-416f9f0fc588 nodeName:}" failed. No retries permitted until 2026-06-08 12:05:44.915975939 +0000 UTC m=+66.244324573 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4hhx4" (UniqueName: "kubernetes.io/projected/095c54d8-85fa-477f-a17f-416f9f0fc588-kube-api-access-4hhx4") pod "network-check-target-gdsnk" (UID: "095c54d8-85fa-477f-a17f-416f9f0fc588") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:05:12.973331 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:12.973279 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-35.ec2.internal" event="NodeReady" Jun 08 12:05:12.973524 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:12.973449 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 12:05:13.079388 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.079285 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kcc8l"] Jun 08 12:05:13.104090 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.104051 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-t4z7r"] Jun 08 12:05:13.104781 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.104755 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kcc8l" Jun 08 12:05:13.107277 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.107237 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dcszh\"" Jun 08 12:05:13.107743 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.107710 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 12:05:13.108424 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.108344 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 12:05:13.118037 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.118008 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kcc8l"] Jun 08 12:05:13.118160 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.118048 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t4z7r"] Jun 08 12:05:13.118160 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.118116 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t4z7r" Jun 08 12:05:13.120292 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.120270 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 12:05:13.120674 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.120472 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 12:05:13.120674 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.120647 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 12:05:13.120783 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.120746 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p7rkr\"" Jun 08 12:05:13.219111 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.219069 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f729f0e-de15-48e8-ae58-d85687aa7a72-cert\") pod \"ingress-canary-t4z7r\" (UID: \"3f729f0e-de15-48e8-ae58-d85687aa7a72\") " pod="openshift-ingress-canary/ingress-canary-t4z7r" Jun 08 12:05:13.219345 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.219175 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls\") pod \"dns-default-kcc8l\" (UID: \"e7ae58fd-3b0e-48b3-91bb-e9ee538e8895\") " pod="openshift-dns/dns-default-kcc8l" Jun 08 12:05:13.219345 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.219267 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmgpq\" (UniqueName: \"kubernetes.io/projected/3f729f0e-de15-48e8-ae58-d85687aa7a72-kube-api-access-cmgpq\") pod \"ingress-canary-t4z7r\" (UID: \"3f729f0e-de15-48e8-ae58-d85687aa7a72\") " pod="openshift-ingress-canary/ingress-canary-t4z7r" Jun 08 12:05:13.219345 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.219295 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-tmp-dir\") pod \"dns-default-kcc8l\" (UID: \"e7ae58fd-3b0e-48b3-91bb-e9ee538e8895\") " pod="openshift-dns/dns-default-kcc8l" Jun 08 12:05:13.219504 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.219355 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h2qc\" (UniqueName: \"kubernetes.io/projected/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-kube-api-access-8h2qc\") pod \"dns-default-kcc8l\" (UID: \"e7ae58fd-3b0e-48b3-91bb-e9ee538e8895\") " pod="openshift-dns/dns-default-kcc8l" Jun 08 12:05:13.219504 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.219400 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-config-volume\") pod \"dns-default-kcc8l\" (UID: \"e7ae58fd-3b0e-48b3-91bb-e9ee538e8895\") " pod="openshift-dns/dns-default-kcc8l" Jun 08 12:05:13.319736 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.319695 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmgpq\" (UniqueName: \"kubernetes.io/projected/3f729f0e-de15-48e8-ae58-d85687aa7a72-kube-api-access-cmgpq\") pod \"ingress-canary-t4z7r\" (UID: \"3f729f0e-de15-48e8-ae58-d85687aa7a72\") " pod="openshift-ingress-canary/ingress-canary-t4z7r" Jun 08 12:05:13.319736 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.319733 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-tmp-dir\") pod \"dns-default-kcc8l\" (UID: \"e7ae58fd-3b0e-48b3-91bb-e9ee538e8895\") " pod="openshift-dns/dns-default-kcc8l" Jun 08 12:05:13.319983 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.319763 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h2qc\" (UniqueName: \"kubernetes.io/projected/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-kube-api-access-8h2qc\") pod \"dns-default-kcc8l\" (UID: \"e7ae58fd-3b0e-48b3-91bb-e9ee538e8895\") " pod="openshift-dns/dns-default-kcc8l" Jun 08 12:05:13.319983 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.319781 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-config-volume\") pod \"dns-default-kcc8l\" (UID: \"e7ae58fd-3b0e-48b3-91bb-e9ee538e8895\") " pod="openshift-dns/dns-default-kcc8l" Jun 08 12:05:13.319983 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.319807 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f729f0e-de15-48e8-ae58-d85687aa7a72-cert\") pod \"ingress-canary-t4z7r\" (UID: \"3f729f0e-de15-48e8-ae58-d85687aa7a72\") " pod="openshift-ingress-canary/ingress-canary-t4z7r" Jun 08 12:05:13.319983 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.319831 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls\") pod \"dns-default-kcc8l\" (UID: \"e7ae58fd-3b0e-48b3-91bb-e9ee538e8895\") " pod="openshift-dns/dns-default-kcc8l" Jun 08 12:05:13.320182 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:13.320013 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:05:13.320182 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.320073 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-tmp-dir\") pod \"dns-default-kcc8l\" (UID: \"e7ae58fd-3b0e-48b3-91bb-e9ee538e8895\") " pod="openshift-dns/dns-default-kcc8l" Jun 08 12:05:13.320182 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:13.320086 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls podName:e7ae58fd-3b0e-48b3-91bb-e9ee538e8895 nodeName:}" failed. No retries permitted until 2026-06-08 12:05:13.820066642 +0000 UTC m=+35.148415283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls") pod "dns-default-kcc8l" (UID: "e7ae58fd-3b0e-48b3-91bb-e9ee538e8895") : secret "dns-default-metrics-tls" not found Jun 08 12:05:13.320397 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.320377 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-config-volume\") pod \"dns-default-kcc8l\" (UID: \"e7ae58fd-3b0e-48b3-91bb-e9ee538e8895\") " pod="openshift-dns/dns-default-kcc8l" Jun 08 12:05:13.323986 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.323963 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f729f0e-de15-48e8-ae58-d85687aa7a72-cert\") pod \"ingress-canary-t4z7r\" (UID: \"3f729f0e-de15-48e8-ae58-d85687aa7a72\") " pod="openshift-ingress-canary/ingress-canary-t4z7r" Jun 08 12:05:13.331708 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.331635 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h2qc\" (UniqueName: \"kubernetes.io/projected/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-kube-api-access-8h2qc\") pod \"dns-default-kcc8l\" (UID: \"e7ae58fd-3b0e-48b3-91bb-e9ee538e8895\") " pod="openshift-dns/dns-default-kcc8l" Jun 08 12:05:13.331893 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.331874 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmgpq\" (UniqueName: \"kubernetes.io/projected/3f729f0e-de15-48e8-ae58-d85687aa7a72-kube-api-access-cmgpq\") pod \"ingress-canary-t4z7r\" (UID: \"3f729f0e-de15-48e8-ae58-d85687aa7a72\") " pod="openshift-ingress-canary/ingress-canary-t4z7r" Jun 08 12:05:13.428638 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.428602 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t4z7r" Jun 08 12:05:13.599762 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.599688 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t4z7r"] Jun 08 12:05:13.604674 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:05:13.604650 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f729f0e_de15_48e8_ae58_d85687aa7a72.slice/crio-76cac4f68f8e45fb8f8b11c60e1d9aed82197627de04b18f3ff33e7eca66c0ad WatchSource:0}: Error finding container 76cac4f68f8e45fb8f8b11c60e1d9aed82197627de04b18f3ff33e7eca66c0ad: Status 404 returned error can't find the container with id 76cac4f68f8e45fb8f8b11c60e1d9aed82197627de04b18f3ff33e7eca66c0ad Jun 08 12:05:13.823764 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:13.823512 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls\") pod \"dns-default-kcc8l\" (UID: \"e7ae58fd-3b0e-48b3-91bb-e9ee538e8895\") " pod="openshift-dns/dns-default-kcc8l" Jun 08 12:05:13.823916 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:13.823665 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:05:13.823916 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:13.823878 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls podName:e7ae58fd-3b0e-48b3-91bb-e9ee538e8895 nodeName:}" failed. No retries permitted until 2026-06-08 12:05:14.823856525 +0000 UTC m=+36.152205156 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls") pod "dns-default-kcc8l" (UID: "e7ae58fd-3b0e-48b3-91bb-e9ee538e8895") : secret "dns-default-metrics-tls" not found Jun 08 12:05:14.118320 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:14.118272 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:05:14.118545 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:14.118333 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:05:14.118545 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:14.118333 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:05:14.121830 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:14.121805 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h5xcw\"" Jun 08 12:05:14.122243 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:14.121809 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jxz55\"" Jun 08 12:05:14.122243 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:14.121881 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 12:05:14.122243 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:14.121922 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 12:05:14.122243 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:14.121888 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 12:05:14.122560 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:14.122544 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 12:05:14.287559 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:14.287526 2565 generic.go:356] "Generic (PLEG): container finished" podID="faa7bc0a-10e1-4949-88ff-798e93b72801" containerID="43eb36681afeac9a63dd5e19a0aac84207d52b0583de4b3364fe13fb43f5b503" exitCode=0 Jun 08 12:05:14.287830 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:14.287615 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tcm54" event={"ID":"faa7bc0a-10e1-4949-88ff-798e93b72801","Type":"ContainerDied","Data":"43eb36681afeac9a63dd5e19a0aac84207d52b0583de4b3364fe13fb43f5b503"} Jun 08 12:05:14.288956 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:14.288739 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t4z7r" event={"ID":"3f729f0e-de15-48e8-ae58-d85687aa7a72","Type":"ContainerStarted","Data":"76cac4f68f8e45fb8f8b11c60e1d9aed82197627de04b18f3ff33e7eca66c0ad"} Jun 08 12:05:14.677484 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:14.677400 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:05:14.775765 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:14.775686 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:05:14.831665 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:14.831626 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls\") pod \"dns-default-kcc8l\" (UID: \"e7ae58fd-3b0e-48b3-91bb-e9ee538e8895\") " pod="openshift-dns/dns-default-kcc8l" Jun 08 12:05:14.831874 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:14.831807 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:05:14.831936 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:14.831884 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls podName:e7ae58fd-3b0e-48b3-91bb-e9ee538e8895 nodeName:}" failed. No retries permitted until 2026-06-08 12:05:16.831859506 +0000 UTC m=+38.160208146 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls") pod "dns-default-kcc8l" (UID: "e7ae58fd-3b0e-48b3-91bb-e9ee538e8895") : secret "dns-default-metrics-tls" not found Jun 08 12:05:15.294090 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:15.294058 2565 generic.go:356] "Generic (PLEG): container finished" podID="faa7bc0a-10e1-4949-88ff-798e93b72801" containerID="892f0b056539d07cbc8987c233b192cf6fc0206298a896172dc79a745bad26cc" exitCode=0 Jun 08 12:05:15.294706 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:15.294097 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tcm54" event={"ID":"faa7bc0a-10e1-4949-88ff-798e93b72801","Type":"ContainerDied","Data":"892f0b056539d07cbc8987c233b192cf6fc0206298a896172dc79a745bad26cc"} Jun 08 12:05:15.824263 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:15.824225 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:05:15.896611 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:15.896527 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:05:16.138944 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:16.138907 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:05:16.214522 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:16.214429 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:05:16.297964 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:16.297929 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t4z7r" event={"ID":"3f729f0e-de15-48e8-ae58-d85687aa7a72","Type":"ContainerStarted","Data":"5ea5ef7398cae4500c9118a28a4face39f3c303789c9fd9bf2709c18e9871784"} Jun 08 12:05:16.301034 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:16.301011 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tcm54" event={"ID":"faa7bc0a-10e1-4949-88ff-798e93b72801","Type":"ContainerStarted","Data":"62e8031d8f27a60078c01019b4b40d086ba0513b5f6a4070f13a5891949dbc01"} Jun 08 12:05:16.315878 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:16.315832 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-t4z7r" podStartSLOduration=1.328159152 podStartE2EDuration="3.315817912s" totalImagesPullingTime="1.98765876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:05:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:16.315067525 +0000 UTC m=+37.643416185" watchObservedRunningTime="2026-06-08 12:05:16.315817912 +0000 UTC m=+37.644166560" Jun 08 12:05:16.343226 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:16.342940 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tcm54" podStartSLOduration=8.718011647 podStartE2EDuration="37.342920605s" totalImagesPullingTime="28.624908958s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:04:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:16.341514517 +0000 UTC m=+37.669863165" watchObservedRunningTime="2026-06-08 12:05:16.342920605 +0000 UTC m=+37.671269256" Jun 08 12:05:16.476103 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:16.476015 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:05:16.590414 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:16.590379 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:05:16.765511 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:16.765420 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:05:16.845987 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:16.845951 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls\") pod \"dns-default-kcc8l\" (UID: \"e7ae58fd-3b0e-48b3-91bb-e9ee538e8895\") " pod="openshift-dns/dns-default-kcc8l" Jun 08 12:05:16.846149 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:16.846108 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:05:16.846188 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:16.846179 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls podName:e7ae58fd-3b0e-48b3-91bb-e9ee538e8895 nodeName:}" failed. No retries permitted until 2026-06-08 12:05:20.846158032 +0000 UTC m=+42.174506659 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls") pod "dns-default-kcc8l" (UID: "e7ae58fd-3b0e-48b3-91bb-e9ee538e8895") : secret "dns-default-metrics-tls" not found Jun 08 12:05:16.865950 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:16.865897 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:05:17.181507 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.181469 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:05:17.280165 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.280132 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:05:17.578336 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.578293 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-769b77c66-nx8rv"] Jun 08 12:05:17.596552 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.596522 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-769b77c66-nx8rv" Jun 08 12:05:17.597525 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.597502 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-769b77c66-nx8rv"] Jun 08 12:05:17.599084 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.599067 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-rbrvc\"" Jun 08 12:05:17.599192 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.599148 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 08 12:05:17.599323 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.599284 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 08 12:05:17.599769 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.599755 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 08 12:05:17.600060 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.600047 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 08 12:05:17.607350 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.607330 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd"] Jun 08 12:05:17.621007 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.620960 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" Jun 08 12:05:17.623198 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.623179 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 08 12:05:17.636538 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.636514 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd"] Jun 08 12:05:17.753790 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.753752 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm6xm\" (UniqueName: \"kubernetes.io/projected/4aa9c617-6c96-4e5f-94cb-962925e87635-kube-api-access-bm6xm\") pod \"managed-serviceaccount-addon-agent-769b77c66-nx8rv\" (UID: \"4aa9c617-6c96-4e5f-94cb-962925e87635\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-769b77c66-nx8rv" Jun 08 12:05:17.753790 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.753792 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwkg4\" (UniqueName: \"kubernetes.io/projected/5ee92154-dbe6-47a2-b9ee-cdfc45a93785-kube-api-access-mwkg4\") pod \"klusterlet-addon-workmgr-7669f58669-872wd\" (UID: \"5ee92154-dbe6-47a2-b9ee-cdfc45a93785\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" Jun 08 12:05:17.753998 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.753876 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4aa9c617-6c96-4e5f-94cb-962925e87635-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-769b77c66-nx8rv\" (UID: \"4aa9c617-6c96-4e5f-94cb-962925e87635\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-769b77c66-nx8rv" Jun 08 12:05:17.753998 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.753903 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5ee92154-dbe6-47a2-b9ee-cdfc45a93785-klusterlet-config\") pod \"klusterlet-addon-workmgr-7669f58669-872wd\" (UID: \"5ee92154-dbe6-47a2-b9ee-cdfc45a93785\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" Jun 08 12:05:17.753998 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.753933 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ee92154-dbe6-47a2-b9ee-cdfc45a93785-tmp\") pod \"klusterlet-addon-workmgr-7669f58669-872wd\" (UID: \"5ee92154-dbe6-47a2-b9ee-cdfc45a93785\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" Jun 08 12:05:17.832143 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.832033 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:05:17.855023 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.854990 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ee92154-dbe6-47a2-b9ee-cdfc45a93785-tmp\") pod \"klusterlet-addon-workmgr-7669f58669-872wd\" (UID: \"5ee92154-dbe6-47a2-b9ee-cdfc45a93785\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" Jun 08 12:05:17.855181 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.855072 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm6xm\" (UniqueName: \"kubernetes.io/projected/4aa9c617-6c96-4e5f-94cb-962925e87635-kube-api-access-bm6xm\") pod \"managed-serviceaccount-addon-agent-769b77c66-nx8rv\" (UID: \"4aa9c617-6c96-4e5f-94cb-962925e87635\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-769b77c66-nx8rv" Jun 08 12:05:17.855181 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.855095 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwkg4\" (UniqueName: \"kubernetes.io/projected/5ee92154-dbe6-47a2-b9ee-cdfc45a93785-kube-api-access-mwkg4\") pod \"klusterlet-addon-workmgr-7669f58669-872wd\" (UID: \"5ee92154-dbe6-47a2-b9ee-cdfc45a93785\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" Jun 08 12:05:17.855181 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.855156 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4aa9c617-6c96-4e5f-94cb-962925e87635-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-769b77c66-nx8rv\" (UID: \"4aa9c617-6c96-4e5f-94cb-962925e87635\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-769b77c66-nx8rv" Jun 08 12:05:17.855181 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.855178 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5ee92154-dbe6-47a2-b9ee-cdfc45a93785-klusterlet-config\") pod \"klusterlet-addon-workmgr-7669f58669-872wd\" (UID: \"5ee92154-dbe6-47a2-b9ee-cdfc45a93785\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" Jun 08 12:05:17.855458 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.855437 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ee92154-dbe6-47a2-b9ee-cdfc45a93785-tmp\") pod \"klusterlet-addon-workmgr-7669f58669-872wd\" (UID: \"5ee92154-dbe6-47a2-b9ee-cdfc45a93785\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" Jun 08 12:05:17.858908 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.858764 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5ee92154-dbe6-47a2-b9ee-cdfc45a93785-klusterlet-config\") pod \"klusterlet-addon-workmgr-7669f58669-872wd\" (UID: \"5ee92154-dbe6-47a2-b9ee-cdfc45a93785\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" Jun 08 12:05:17.859000 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.858875 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4aa9c617-6c96-4e5f-94cb-962925e87635-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-769b77c66-nx8rv\" (UID: \"4aa9c617-6c96-4e5f-94cb-962925e87635\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-769b77c66-nx8rv" Jun 08 12:05:17.865278 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.865256 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm6xm\" (UniqueName: \"kubernetes.io/projected/4aa9c617-6c96-4e5f-94cb-962925e87635-kube-api-access-bm6xm\") pod \"managed-serviceaccount-addon-agent-769b77c66-nx8rv\" (UID: \"4aa9c617-6c96-4e5f-94cb-962925e87635\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-769b77c66-nx8rv" Jun 08 12:05:17.865415 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.865363 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwkg4\" (UniqueName: \"kubernetes.io/projected/5ee92154-dbe6-47a2-b9ee-cdfc45a93785-kube-api-access-mwkg4\") pod \"klusterlet-addon-workmgr-7669f58669-872wd\" (UID: \"5ee92154-dbe6-47a2-b9ee-cdfc45a93785\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" Jun 08 12:05:17.906448 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.906409 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:05:17.919364 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.919342 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-769b77c66-nx8rv" Jun 08 12:05:17.929374 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:17.929352 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" Jun 08 12:05:18.088768 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:18.088667 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-769b77c66-nx8rv"] Jun 08 12:05:18.102479 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:05:18.102444 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4aa9c617_6c96_4e5f_94cb_962925e87635.slice/crio-cd37ae23ec22178e264831d4a2c0cd98e9dca5c434f5cd08f898f40b57c6748c WatchSource:0}: Error finding container cd37ae23ec22178e264831d4a2c0cd98e9dca5c434f5cd08f898f40b57c6748c: Status 404 returned error can't find the container with id cd37ae23ec22178e264831d4a2c0cd98e9dca5c434f5cd08f898f40b57c6748c Jun 08 12:05:18.121249 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:18.121220 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd"] Jun 08 12:05:18.124300 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:05:18.124275 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ee92154_dbe6_47a2_b9ee_cdfc45a93785.slice/crio-3b92e7d380c8ab571d22cbec3de11e9d256dd80b0ff4672333b92b7fe5b1a031 WatchSource:0}: Error finding container 3b92e7d380c8ab571d22cbec3de11e9d256dd80b0ff4672333b92b7fe5b1a031: Status 404 returned error can't find the container with id 3b92e7d380c8ab571d22cbec3de11e9d256dd80b0ff4672333b92b7fe5b1a031 Jun 08 12:05:18.306425 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:18.306390 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" event={"ID":"5ee92154-dbe6-47a2-b9ee-cdfc45a93785","Type":"ContainerStarted","Data":"3b92e7d380c8ab571d22cbec3de11e9d256dd80b0ff4672333b92b7fe5b1a031"} Jun 08 12:05:18.307443 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:18.307417 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-769b77c66-nx8rv" event={"ID":"4aa9c617-6c96-4e5f-94cb-962925e87635","Type":"ContainerStarted","Data":"cd37ae23ec22178e264831d4a2c0cd98e9dca5c434f5cd08f898f40b57c6748c"} Jun 08 12:05:19.320145 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:19.320102 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:05:19.396808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:19.396771 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:05:20.880820 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:20.880781 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls\") pod \"dns-default-kcc8l\" (UID: \"e7ae58fd-3b0e-48b3-91bb-e9ee538e8895\") " pod="openshift-dns/dns-default-kcc8l" Jun 08 12:05:20.881263 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:20.880959 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:05:20.881263 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:20.881049 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls podName:e7ae58fd-3b0e-48b3-91bb-e9ee538e8895 nodeName:}" failed. No retries permitted until 2026-06-08 12:05:28.881025945 +0000 UTC m=+50.209374574 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls") pod "dns-default-kcc8l" (UID: "e7ae58fd-3b0e-48b3-91bb-e9ee538e8895") : secret "dns-default-metrics-tls" not found Jun 08 12:05:22.321042 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:22.320981 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-769b77c66-nx8rv" event={"ID":"4aa9c617-6c96-4e5f-94cb-962925e87635","Type":"ContainerStarted","Data":"89b326b48f28391046758f4897e120261b4badc7f7780e627a536e90bbd22618"} Jun 08 12:05:22.339777 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:22.339711 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-769b77c66-nx8rv" podStartSLOduration=1.246310055 podStartE2EDuration="5.33969519s" totalImagesPullingTime="4.093385135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:05:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:22.338990688 +0000 UTC m=+43.667339336" watchObservedRunningTime="2026-06-08 12:05:22.33969519 +0000 UTC m=+43.668043880" Jun 08 12:05:24.328338 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:24.328290 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" event={"ID":"5ee92154-dbe6-47a2-b9ee-cdfc45a93785","Type":"ContainerStarted","Data":"2d79feab8173dc585a6dcad6ac08ce9b19ceafe64d4a5f5b64c8dc035ed68850"} Jun 08 12:05:24.328735 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:24.328487 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" Jun 08 12:05:24.330134 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:24.330114 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" Jun 08 12:05:24.345825 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:24.345635 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" podStartSLOduration=1.5336463089999999 podStartE2EDuration="7.345619754s" totalImagesPullingTime="5.811973445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:05:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:24.345179106 +0000 UTC m=+45.673527754" watchObservedRunningTime="2026-06-08 12:05:24.345619754 +0000 UTC m=+45.673968403" Jun 08 12:05:28.937982 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:28.937947 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls\") pod \"dns-default-kcc8l\" (UID: \"e7ae58fd-3b0e-48b3-91bb-e9ee538e8895\") " pod="openshift-dns/dns-default-kcc8l" Jun 08 12:05:28.938389 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:28.938085 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:05:28.938389 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:28.938144 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls podName:e7ae58fd-3b0e-48b3-91bb-e9ee538e8895 nodeName:}" failed. No retries permitted until 2026-06-08 12:05:44.938128044 +0000 UTC m=+66.266476671 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls") pod "dns-default-kcc8l" (UID: "e7ae58fd-3b0e-48b3-91bb-e9ee538e8895") : secret "dns-default-metrics-tls" not found Jun 08 12:05:36.803933 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:36.803897 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:05:36.876703 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:36.876668 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:05:39.283198 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:39.283167 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-94jtj" Jun 08 12:05:39.460063 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:39.460028 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:05:39.531960 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:39.531937 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:05:39.679625 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:39.679592 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:05:39.765683 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:39.765657 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:05:44.843617 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:44.843584 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs\") pod \"network-metrics-daemon-8tsdl\" (UID: \"50c05198-1996-4465-97df-8ae929b9410b\") " pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:05:44.845913 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:44.845896 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 12:05:44.854636 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:44.854620 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 12:05:44.854704 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:44.854670 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs podName:50c05198-1996-4465-97df-8ae929b9410b nodeName:}" failed. No retries permitted until 2026-06-08 12:06:48.854656937 +0000 UTC m=+130.183005565 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs") pod "network-metrics-daemon-8tsdl" (UID: "50c05198-1996-4465-97df-8ae929b9410b") : secret "metrics-daemon-secret" not found Jun 08 12:05:44.944696 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:44.944675 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls\") pod \"dns-default-kcc8l\" (UID: \"e7ae58fd-3b0e-48b3-91bb-e9ee538e8895\") " pod="openshift-dns/dns-default-kcc8l" Jun 08 12:05:44.944758 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:44.944711 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9feeac32-9e54-42d4-85f7-3e4175f9eb08-original-pull-secret\") pod \"global-pull-secret-syncer-96gpg\" (UID: \"9feeac32-9e54-42d4-85f7-3e4175f9eb08\") " pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:05:44.944758 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:44.944737 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hhx4\" (UniqueName: \"kubernetes.io/projected/095c54d8-85fa-477f-a17f-416f9f0fc588-kube-api-access-4hhx4\") pod \"network-check-target-gdsnk\" (UID: \"095c54d8-85fa-477f-a17f-416f9f0fc588\") " pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:05:44.944825 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:44.944811 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:05:44.944875 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:05:44.944864 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls podName:e7ae58fd-3b0e-48b3-91bb-e9ee538e8895 nodeName:}" failed. No retries permitted until 2026-06-08 12:06:16.944847855 +0000 UTC m=+98.273196502 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls") pod "dns-default-kcc8l" (UID: "e7ae58fd-3b0e-48b3-91bb-e9ee538e8895") : secret "dns-default-metrics-tls" not found Jun 08 12:05:44.946681 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:44.946667 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 12:05:44.946722 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:44.946668 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 12:05:44.957059 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:44.957040 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 12:05:44.958153 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:44.958126 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9feeac32-9e54-42d4-85f7-3e4175f9eb08-original-pull-secret\") pod \"global-pull-secret-syncer-96gpg\" (UID: \"9feeac32-9e54-42d4-85f7-3e4175f9eb08\") " pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:05:44.967534 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:44.967515 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hhx4\" (UniqueName: \"kubernetes.io/projected/095c54d8-85fa-477f-a17f-416f9f0fc588-kube-api-access-4hhx4\") pod \"network-check-target-gdsnk\" (UID: \"095c54d8-85fa-477f-a17f-416f9f0fc588\") " pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:05:45.032463 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:45.032439 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h5xcw\"" Jun 08 12:05:45.040655 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:45.040637 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:05:45.043928 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:45.043909 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-96gpg" Jun 08 12:05:45.203041 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:45.202991 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gdsnk"] Jun 08 12:05:45.205869 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:05:45.205846 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod095c54d8_85fa_477f_a17f_416f9f0fc588.slice/crio-5380654c4f30b74568bc307495ac74e88e3842886aee81f5f2c53926cb04954c WatchSource:0}: Error finding container 5380654c4f30b74568bc307495ac74e88e3842886aee81f5f2c53926cb04954c: Status 404 returned error can't find the container with id 5380654c4f30b74568bc307495ac74e88e3842886aee81f5f2c53926cb04954c Jun 08 12:05:45.217921 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:45.217899 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-96gpg"] Jun 08 12:05:45.220545 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:05:45.220511 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9feeac32_9e54_42d4_85f7_3e4175f9eb08.slice/crio-646c55416dc2fb0927461e318ecd34f747a6f4cd2d3eaf827c62b77f53a151b2 WatchSource:0}: Error finding container 646c55416dc2fb0927461e318ecd34f747a6f4cd2d3eaf827c62b77f53a151b2: Status 404 returned error can't find the container with id 646c55416dc2fb0927461e318ecd34f747a6f4cd2d3eaf827c62b77f53a151b2 Jun 08 12:05:45.379581 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:45.379503 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-96gpg" event={"ID":"9feeac32-9e54-42d4-85f7-3e4175f9eb08","Type":"ContainerStarted","Data":"646c55416dc2fb0927461e318ecd34f747a6f4cd2d3eaf827c62b77f53a151b2"} Jun 08 12:05:45.380517 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:45.380497 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gdsnk" event={"ID":"095c54d8-85fa-477f-a17f-416f9f0fc588","Type":"ContainerStarted","Data":"5380654c4f30b74568bc307495ac74e88e3842886aee81f5f2c53926cb04954c"} Jun 08 12:05:50.395983 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:50.395949 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gdsnk" event={"ID":"095c54d8-85fa-477f-a17f-416f9f0fc588","Type":"ContainerStarted","Data":"bfcb89f92e74e38fa9824815dea88b8cef8a972d098ae186aef628b2dfcaa28c"} Jun 08 12:05:50.396456 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:50.396019 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:05:50.397292 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:50.397271 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-96gpg" event={"ID":"9feeac32-9e54-42d4-85f7-3e4175f9eb08","Type":"ContainerStarted","Data":"f8cdb447ca44f83ab626d13d35ad095683d87c81d0d8632853590e44b9a61fd7"} Jun 08 12:05:50.414594 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:50.414553 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gdsnk" podStartSLOduration=66.826888339 podStartE2EDuration="1m11.414542265s" totalImagesPullingTime="4.587653926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:50.413132151 +0000 UTC m=+71.741480799" watchObservedRunningTime="2026-06-08 12:05:50.414542265 +0000 UTC m=+71.742890913" Jun 08 12:05:50.429891 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:50.429853 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-96gpg" podStartSLOduration=66.855230545 podStartE2EDuration="1m11.429841104s" totalImagesPullingTime="4.574610559s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:50.429196102 +0000 UTC m=+71.757544749" watchObservedRunningTime="2026-06-08 12:05:50.429841104 +0000 UTC m=+71.758189751" Jun 08 12:05:50.513725 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:50.513702 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:05:50.586214 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:05:50.586190 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:06:16.962947 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:06:16.962899 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls\") pod \"dns-default-kcc8l\" (UID: \"e7ae58fd-3b0e-48b3-91bb-e9ee538e8895\") " pod="openshift-dns/dns-default-kcc8l" Jun 08 12:06:16.963450 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:06:16.963054 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:06:16.963450 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:06:16.963128 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls podName:e7ae58fd-3b0e-48b3-91bb-e9ee538e8895 nodeName:}" failed. No retries permitted until 2026-06-08 12:07:20.963111938 +0000 UTC m=+162.291460566 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls") pod "dns-default-kcc8l" (UID: "e7ae58fd-3b0e-48b3-91bb-e9ee538e8895") : secret "dns-default-metrics-tls" not found Jun 08 12:06:21.403047 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:06:21.403019 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gdsnk" Jun 08 12:06:48.863937 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:06:48.863898 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs\") pod \"network-metrics-daemon-8tsdl\" (UID: \"50c05198-1996-4465-97df-8ae929b9410b\") " pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:06:48.864431 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:06:48.864049 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 12:06:48.864431 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:06:48.864116 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs podName:50c05198-1996-4465-97df-8ae929b9410b nodeName:}" failed. No retries permitted until 2026-06-08 12:08:50.864101606 +0000 UTC m=+252.192450233 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs") pod "network-metrics-daemon-8tsdl" (UID: "50c05198-1996-4465-97df-8ae929b9410b") : secret "metrics-daemon-secret" not found Jun 08 12:07:16.116038 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:07:16.115987 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kcc8l" podUID="e7ae58fd-3b0e-48b3-91bb-e9ee538e8895" Jun 08 12:07:16.631743 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:07:16.631708 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kcc8l" Jun 08 12:07:17.137660 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:07:17.137630 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8tsdl" podUID="50c05198-1996-4465-97df-8ae929b9410b" Jun 08 12:07:20.972991 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:07:20.972953 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls\") pod \"dns-default-kcc8l\" (UID: \"e7ae58fd-3b0e-48b3-91bb-e9ee538e8895\") " pod="openshift-dns/dns-default-kcc8l" Jun 08 12:07:20.973377 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:07:20.973073 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:07:20.973377 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:07:20.973124 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls podName:e7ae58fd-3b0e-48b3-91bb-e9ee538e8895 nodeName:}" failed. No retries permitted until 2026-06-08 12:09:22.973110467 +0000 UTC m=+284.301459095 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls") pod "dns-default-kcc8l" (UID: "e7ae58fd-3b0e-48b3-91bb-e9ee538e8895") : secret "dns-default-metrics-tls" not found Jun 08 12:07:22.647923 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:07:22.647862 2565 generic.go:356] "Generic (PLEG): container finished" podID="4aa9c617-6c96-4e5f-94cb-962925e87635" containerID="89b326b48f28391046758f4897e120261b4badc7f7780e627a536e90bbd22618" exitCode=255 Jun 08 12:07:22.647923 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:07:22.647912 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-769b77c66-nx8rv" event={"ID":"4aa9c617-6c96-4e5f-94cb-962925e87635","Type":"ContainerDied","Data":"89b326b48f28391046758f4897e120261b4badc7f7780e627a536e90bbd22618"} Jun 08 12:07:22.653193 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:07:22.653174 2565 scope.go:117] "RemoveContainer" containerID="89b326b48f28391046758f4897e120261b4badc7f7780e627a536e90bbd22618" Jun 08 12:07:23.652154 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:07:23.652119 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-769b77c66-nx8rv" event={"ID":"4aa9c617-6c96-4e5f-94cb-962925e87635","Type":"ContainerStarted","Data":"0526e077af861957fc0885510770e005d0ca086768a347ee965bffe301aa6b85"} Jun 08 12:07:24.020509 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:07:24.020433 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:07:24.329570 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:07:24.329527 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" podUID="5ee92154-dbe6-47a2-b9ee-cdfc45a93785" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.9:8000/readyz\": dial tcp 10.133.0.9:8000: connect: connection refused" Jun 08 12:07:24.656464 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:07:24.656411 2565 generic.go:356] "Generic (PLEG): container finished" podID="5ee92154-dbe6-47a2-b9ee-cdfc45a93785" containerID="2d79feab8173dc585a6dcad6ac08ce9b19ceafe64d4a5f5b64c8dc035ed68850" exitCode=1 Jun 08 12:07:24.656771 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:07:24.656476 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" event={"ID":"5ee92154-dbe6-47a2-b9ee-cdfc45a93785","Type":"ContainerDied","Data":"2d79feab8173dc585a6dcad6ac08ce9b19ceafe64d4a5f5b64c8dc035ed68850"} Jun 08 12:07:24.656771 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:07:24.656720 2565 scope.go:117] "RemoveContainer" containerID="2d79feab8173dc585a6dcad6ac08ce9b19ceafe64d4a5f5b64c8dc035ed68850" Jun 08 12:07:25.660880 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:07:25.660845 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" event={"ID":"5ee92154-dbe6-47a2-b9ee-cdfc45a93785","Type":"ContainerStarted","Data":"e2442ce386319db80dae6500fcd083f5178f4b1c087dd0f2c2c24e0f0fb8be7b"} Jun 08 12:07:25.661296 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:07:25.661202 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" Jun 08 12:07:25.661791 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:07:25.661769 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" Jun 08 12:07:28.118860 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:07:28.118829 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:07:36.653470 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:07:36.653386 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:12.993954 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:12.993923 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-hqv87"] Jun 08 12:08:12.996002 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:12.995981 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7ccb6b87c4-q7xlf"] Jun 08 12:08:12.996141 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:12.996093 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-hqv87" Jun 08 12:08:12.997695 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:12.997675 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:13.001192 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.001170 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 12:08:13.001432 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.001417 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 08 12:08:13.001577 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.001555 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 12:08:13.001661 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.001586 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-whdg8\"" Jun 08 12:08:13.001661 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.001639 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 08 12:08:13.001838 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.001825 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 08 12:08:13.002260 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.002246 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 08 12:08:13.002651 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.002383 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 08 12:08:13.003198 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.003178 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gdkss\"" Jun 08 12:08:13.008761 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.008613 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 08 12:08:13.009350 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.009334 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 08 12:08:13.013846 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.013827 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7ccb6b87c4-q7xlf"] Jun 08 12:08:13.018760 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.018741 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-hqv87"] Jun 08 12:08:13.107162 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.107140 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d5ec04a0-580b-44a0-a883-051acfdd1eb6-snapshots\") pod \"insights-operator-896549976-hqv87\" (UID: \"d5ec04a0-580b-44a0-a883-051acfdd1eb6\") " pod="openshift-insights/insights-operator-896549976-hqv87" Jun 08 12:08:13.107269 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.107166 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5ec04a0-580b-44a0-a883-051acfdd1eb6-service-ca-bundle\") pod \"insights-operator-896549976-hqv87\" (UID: \"d5ec04a0-580b-44a0-a883-051acfdd1eb6\") " pod="openshift-insights/insights-operator-896549976-hqv87" Jun 08 12:08:13.107269 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.107223 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5ec04a0-580b-44a0-a883-051acfdd1eb6-serving-cert\") pod \"insights-operator-896549976-hqv87\" (UID: \"d5ec04a0-580b-44a0-a883-051acfdd1eb6\") " pod="openshift-insights/insights-operator-896549976-hqv87" Jun 08 12:08:13.107269 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.107248 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0311d851-b401-448c-a313-00c2aacc2025-image-registry-private-configuration\") pod \"image-registry-7ccb6b87c4-q7xlf\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:13.107269 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.107266 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0311d851-b401-448c-a313-00c2aacc2025-ca-trust-extracted\") pod \"image-registry-7ccb6b87c4-q7xlf\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:13.107414 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.107332 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5ec04a0-580b-44a0-a883-051acfdd1eb6-tmp\") pod \"insights-operator-896549976-hqv87\" (UID: \"d5ec04a0-580b-44a0-a883-051acfdd1eb6\") " pod="openshift-insights/insights-operator-896549976-hqv87" Jun 08 12:08:13.107414 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.107356 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5ec04a0-580b-44a0-a883-051acfdd1eb6-trusted-ca-bundle\") pod \"insights-operator-896549976-hqv87\" (UID: \"d5ec04a0-580b-44a0-a883-051acfdd1eb6\") " pod="openshift-insights/insights-operator-896549976-hqv87" Jun 08 12:08:13.107414 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.107370 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sncwn\" (UniqueName: \"kubernetes.io/projected/d5ec04a0-580b-44a0-a883-051acfdd1eb6-kube-api-access-sncwn\") pod \"insights-operator-896549976-hqv87\" (UID: \"d5ec04a0-580b-44a0-a883-051acfdd1eb6\") " pod="openshift-insights/insights-operator-896549976-hqv87" Jun 08 12:08:13.107414 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.107383 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-registry-tls\") pod \"image-registry-7ccb6b87c4-q7xlf\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:13.107414 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.107398 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0311d851-b401-448c-a313-00c2aacc2025-installation-pull-secrets\") pod \"image-registry-7ccb6b87c4-q7xlf\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:13.107560 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.107417 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkp27\" (UniqueName: \"kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-kube-api-access-rkp27\") pod \"image-registry-7ccb6b87c4-q7xlf\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:13.107560 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.107436 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0311d851-b401-448c-a313-00c2aacc2025-trusted-ca\") pod \"image-registry-7ccb6b87c4-q7xlf\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:13.107560 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.107451 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-bound-sa-token\") pod \"image-registry-7ccb6b87c4-q7xlf\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:13.107560 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.107469 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0311d851-b401-448c-a313-00c2aacc2025-registry-certificates\") pod \"image-registry-7ccb6b87c4-q7xlf\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:13.114223 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.114204 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:13.208547 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.208522 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5ec04a0-580b-44a0-a883-051acfdd1eb6-serving-cert\") pod \"insights-operator-896549976-hqv87\" (UID: \"d5ec04a0-580b-44a0-a883-051acfdd1eb6\") " pod="openshift-insights/insights-operator-896549976-hqv87" Jun 08 12:08:13.208649 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.208550 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0311d851-b401-448c-a313-00c2aacc2025-image-registry-private-configuration\") pod \"image-registry-7ccb6b87c4-q7xlf\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:13.208649 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.208567 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0311d851-b401-448c-a313-00c2aacc2025-ca-trust-extracted\") pod \"image-registry-7ccb6b87c4-q7xlf\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:13.208649 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.208602 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5ec04a0-580b-44a0-a883-051acfdd1eb6-tmp\") pod \"insights-operator-896549976-hqv87\" (UID: \"d5ec04a0-580b-44a0-a883-051acfdd1eb6\") " pod="openshift-insights/insights-operator-896549976-hqv87" Jun 08 12:08:13.208649 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.208638 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5ec04a0-580b-44a0-a883-051acfdd1eb6-trusted-ca-bundle\") pod \"insights-operator-896549976-hqv87\" (UID: \"d5ec04a0-580b-44a0-a883-051acfdd1eb6\") " pod="openshift-insights/insights-operator-896549976-hqv87" Jun 08 12:08:13.208843 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.208660 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sncwn\" (UniqueName: \"kubernetes.io/projected/d5ec04a0-580b-44a0-a883-051acfdd1eb6-kube-api-access-sncwn\") pod \"insights-operator-896549976-hqv87\" (UID: \"d5ec04a0-580b-44a0-a883-051acfdd1eb6\") " pod="openshift-insights/insights-operator-896549976-hqv87" Jun 08 12:08:13.208843 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.208686 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-registry-tls\") pod \"image-registry-7ccb6b87c4-q7xlf\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:13.208947 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:08:13.208870 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 12:08:13.208947 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:08:13.208891 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ccb6b87c4-q7xlf: secret "image-registry-tls" not found Jun 08 12:08:13.209038 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.208952 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0311d851-b401-448c-a313-00c2aacc2025-ca-trust-extracted\") pod \"image-registry-7ccb6b87c4-q7xlf\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:13.209038 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:08:13.208969 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-registry-tls podName:0311d851-b401-448c-a313-00c2aacc2025 nodeName:}" failed. No retries permitted until 2026-06-08 12:08:13.708950626 +0000 UTC m=+215.037299262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-registry-tls") pod "image-registry-7ccb6b87c4-q7xlf" (UID: "0311d851-b401-448c-a313-00c2aacc2025") : secret "image-registry-tls" not found Jun 08 12:08:13.209148 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.209076 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5ec04a0-580b-44a0-a883-051acfdd1eb6-tmp\") pod \"insights-operator-896549976-hqv87\" (UID: \"d5ec04a0-580b-44a0-a883-051acfdd1eb6\") " pod="openshift-insights/insights-operator-896549976-hqv87" Jun 08 12:08:13.209201 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.209157 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0311d851-b401-448c-a313-00c2aacc2025-installation-pull-secrets\") pod \"image-registry-7ccb6b87c4-q7xlf\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:13.209201 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.209187 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkp27\" (UniqueName: \"kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-kube-api-access-rkp27\") pod \"image-registry-7ccb6b87c4-q7xlf\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:13.209302 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.209216 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0311d851-b401-448c-a313-00c2aacc2025-trusted-ca\") pod \"image-registry-7ccb6b87c4-q7xlf\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:13.209302 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.209241 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-bound-sa-token\") pod \"image-registry-7ccb6b87c4-q7xlf\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:13.209302 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.209270 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0311d851-b401-448c-a313-00c2aacc2025-registry-certificates\") pod \"image-registry-7ccb6b87c4-q7xlf\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:13.209302 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.209296 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d5ec04a0-580b-44a0-a883-051acfdd1eb6-snapshots\") pod \"insights-operator-896549976-hqv87\" (UID: \"d5ec04a0-580b-44a0-a883-051acfdd1eb6\") " pod="openshift-insights/insights-operator-896549976-hqv87" Jun 08 12:08:13.209525 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.209334 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5ec04a0-580b-44a0-a883-051acfdd1eb6-service-ca-bundle\") pod \"insights-operator-896549976-hqv87\" (UID: \"d5ec04a0-580b-44a0-a883-051acfdd1eb6\") " pod="openshift-insights/insights-operator-896549976-hqv87" Jun 08 12:08:13.209756 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.209710 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5ec04a0-580b-44a0-a883-051acfdd1eb6-trusted-ca-bundle\") pod \"insights-operator-896549976-hqv87\" (UID: \"d5ec04a0-580b-44a0-a883-051acfdd1eb6\") " pod="openshift-insights/insights-operator-896549976-hqv87" Jun 08 12:08:13.209934 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.209910 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5ec04a0-580b-44a0-a883-051acfdd1eb6-service-ca-bundle\") pod \"insights-operator-896549976-hqv87\" (UID: \"d5ec04a0-580b-44a0-a883-051acfdd1eb6\") " pod="openshift-insights/insights-operator-896549976-hqv87" Jun 08 12:08:13.210152 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.210132 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d5ec04a0-580b-44a0-a883-051acfdd1eb6-snapshots\") pod \"insights-operator-896549976-hqv87\" (UID: \"d5ec04a0-580b-44a0-a883-051acfdd1eb6\") " pod="openshift-insights/insights-operator-896549976-hqv87" Jun 08 12:08:13.210210 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.210149 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0311d851-b401-448c-a313-00c2aacc2025-registry-certificates\") pod \"image-registry-7ccb6b87c4-q7xlf\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:13.210462 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.210445 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0311d851-b401-448c-a313-00c2aacc2025-trusted-ca\") pod \"image-registry-7ccb6b87c4-q7xlf\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:13.210993 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.210973 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0311d851-b401-448c-a313-00c2aacc2025-image-registry-private-configuration\") pod \"image-registry-7ccb6b87c4-q7xlf\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:13.211153 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.211133 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5ec04a0-580b-44a0-a883-051acfdd1eb6-serving-cert\") pod \"insights-operator-896549976-hqv87\" (UID: \"d5ec04a0-580b-44a0-a883-051acfdd1eb6\") " pod="openshift-insights/insights-operator-896549976-hqv87" Jun 08 12:08:13.211423 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.211407 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0311d851-b401-448c-a313-00c2aacc2025-installation-pull-secrets\") pod \"image-registry-7ccb6b87c4-q7xlf\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:13.219102 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.219081 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-bound-sa-token\") pod \"image-registry-7ccb6b87c4-q7xlf\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:13.219184 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.219138 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkp27\" (UniqueName: \"kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-kube-api-access-rkp27\") pod \"image-registry-7ccb6b87c4-q7xlf\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:13.219251 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.219232 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sncwn\" (UniqueName: \"kubernetes.io/projected/d5ec04a0-580b-44a0-a883-051acfdd1eb6-kube-api-access-sncwn\") pod \"insights-operator-896549976-hqv87\" (UID: \"d5ec04a0-580b-44a0-a883-051acfdd1eb6\") " pod="openshift-insights/insights-operator-896549976-hqv87" Jun 08 12:08:13.305503 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.305457 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-hqv87" Jun 08 12:08:13.420651 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.420614 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-hqv87"] Jun 08 12:08:13.423935 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:08:13.423906 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5ec04a0_580b_44a0_a883_051acfdd1eb6.slice/crio-3f0343dd7644a485bdd006730e8cc43d485b838e6da65e787713aab804c830fc WatchSource:0}: Error finding container 3f0343dd7644a485bdd006730e8cc43d485b838e6da65e787713aab804c830fc: Status 404 returned error can't find the container with id 3f0343dd7644a485bdd006730e8cc43d485b838e6da65e787713aab804c830fc Jun 08 12:08:13.713513 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.713484 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-registry-tls\") pod \"image-registry-7ccb6b87c4-q7xlf\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:13.713641 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:08:13.713580 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 12:08:13.713641 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:08:13.713591 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ccb6b87c4-q7xlf: secret "image-registry-tls" not found Jun 08 12:08:13.713641 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:08:13.713641 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-registry-tls podName:0311d851-b401-448c-a313-00c2aacc2025 nodeName:}" failed. No retries permitted until 2026-06-08 12:08:14.71362849 +0000 UTC m=+216.041977118 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-registry-tls") pod "image-registry-7ccb6b87c4-q7xlf" (UID: "0311d851-b401-448c-a313-00c2aacc2025") : secret "image-registry-tls" not found Jun 08 12:08:13.794693 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:13.794666 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-hqv87" event={"ID":"d5ec04a0-580b-44a0-a883-051acfdd1eb6","Type":"ContainerStarted","Data":"3f0343dd7644a485bdd006730e8cc43d485b838e6da65e787713aab804c830fc"} Jun 08 12:08:14.189760 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:14.189726 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:14.719656 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:14.719623 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-registry-tls\") pod \"image-registry-7ccb6b87c4-q7xlf\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:14.719825 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:08:14.719779 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 12:08:14.719825 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:08:14.719798 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ccb6b87c4-q7xlf: secret "image-registry-tls" not found Jun 08 12:08:14.719967 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:08:14.719865 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-registry-tls podName:0311d851-b401-448c-a313-00c2aacc2025 nodeName:}" failed. No retries permitted until 2026-06-08 12:08:16.719843731 +0000 UTC m=+218.048192361 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-registry-tls") pod "image-registry-7ccb6b87c4-q7xlf" (UID: "0311d851-b401-448c-a313-00c2aacc2025") : secret "image-registry-tls" not found Jun 08 12:08:15.186249 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:15.186217 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:15.287487 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:15.287453 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:15.803083 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:15.803050 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-hqv87" event={"ID":"d5ec04a0-580b-44a0-a883-051acfdd1eb6","Type":"ContainerStarted","Data":"c544b0bd1f335af6031b08781266fa7227242bef6e3c1d8cce56bcce66187e90"} Jun 08 12:08:15.818590 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:15.818542 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-hqv87" podStartSLOduration=1.572535461 podStartE2EDuration="3.818527494s" totalImagesPullingTime="2.245992033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:08:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:08:15.818282065 +0000 UTC m=+217.146630715" watchObservedRunningTime="2026-06-08 12:08:15.818527494 +0000 UTC m=+217.146876142" Jun 08 12:08:16.674601 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:16.674565 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:16.735848 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:16.735819 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-registry-tls\") pod \"image-registry-7ccb6b87c4-q7xlf\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:16.735984 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:08:16.735955 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 12:08:16.735984 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:08:16.735969 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ccb6b87c4-q7xlf: secret "image-registry-tls" not found Jun 08 12:08:16.736053 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:08:16.736014 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-registry-tls podName:0311d851-b401-448c-a313-00c2aacc2025 nodeName:}" failed. No retries permitted until 2026-06-08 12:08:20.736001812 +0000 UTC m=+222.064350439 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-registry-tls") pod "image-registry-7ccb6b87c4-q7xlf" (UID: "0311d851-b401-448c-a313-00c2aacc2025") : secret "image-registry-tls" not found Jun 08 12:08:16.766590 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:16.766569 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:17.055976 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:17.055953 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:17.112132 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:17.112104 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:17.483347 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:17.483263 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:17.538691 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:17.538666 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:17.757036 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:17.756972 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:17.863061 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:17.863035 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:18.138951 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:18.138930 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-grts6"] Jun 08 12:08:18.142060 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:18.142046 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-grts6" Jun 08 12:08:18.144321 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:18.144293 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-s9rnp\"" Jun 08 12:08:18.144471 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:18.144454 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 08 12:08:18.144867 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:18.144856 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 08 12:08:18.146542 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:18.146524 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:18.151046 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:18.151027 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-grts6"] Jun 08 12:08:18.232573 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:18.232553 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:18.245968 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:18.245944 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6n2v\" (UniqueName: \"kubernetes.io/projected/8707cb3e-5f4b-45e7-89b1-f290850e6832-kube-api-access-j6n2v\") pod \"migrator-955ffdf5f-grts6\" (UID: \"8707cb3e-5f4b-45e7-89b1-f290850e6832\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-grts6" Jun 08 12:08:18.332190 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:18.332170 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:18.346185 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:18.346165 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6n2v\" (UniqueName: \"kubernetes.io/projected/8707cb3e-5f4b-45e7-89b1-f290850e6832-kube-api-access-j6n2v\") pod \"migrator-955ffdf5f-grts6\" (UID: \"8707cb3e-5f4b-45e7-89b1-f290850e6832\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-grts6" Jun 08 12:08:18.354795 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:18.354770 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6n2v\" (UniqueName: \"kubernetes.io/projected/8707cb3e-5f4b-45e7-89b1-f290850e6832-kube-api-access-j6n2v\") pod \"migrator-955ffdf5f-grts6\" (UID: \"8707cb3e-5f4b-45e7-89b1-f290850e6832\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-grts6" Jun 08 12:08:18.451201 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:18.451154 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-grts6" Jun 08 12:08:18.565262 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:18.565232 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-grts6"] Jun 08 12:08:18.568014 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:08:18.567979 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8707cb3e_5f4b_45e7_89b1_f290850e6832.slice/crio-674e7739f2cebde6b3a4fe4f0c0b8db46a17b0ea0f8fc3fc0a8194bd0ebc2705 WatchSource:0}: Error finding container 674e7739f2cebde6b3a4fe4f0c0b8db46a17b0ea0f8fc3fc0a8194bd0ebc2705: Status 404 returned error can't find the container with id 674e7739f2cebde6b3a4fe4f0c0b8db46a17b0ea0f8fc3fc0a8194bd0ebc2705 Jun 08 12:08:18.800369 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:18.800301 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w4wf6_eee4acbf-8c90-49e2-8573-d2386ae891cc/dns-node-resolver/0.log" Jun 08 12:08:18.812567 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:18.812544 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-grts6" event={"ID":"8707cb3e-5f4b-45e7-89b1-f290850e6832","Type":"ContainerStarted","Data":"674e7739f2cebde6b3a4fe4f0c0b8db46a17b0ea0f8fc3fc0a8194bd0ebc2705"} Jun 08 12:08:19.391183 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:19.391148 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:19.454051 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:19.454026 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:19.800560 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:19.800540 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xz292_af53aaaa-69bd-4d1e-9fb7-6eaf4b58fb13/node-ca/0.log" Jun 08 12:08:20.242500 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:20.242474 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:20.601320 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:20.601290 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t4z7r_3f729f0e-de15-48e8-ae58-d85687aa7a72/serve-healthcheck-canary/0.log" Jun 08 12:08:20.762617 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:20.762590 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-registry-tls\") pod \"image-registry-7ccb6b87c4-q7xlf\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:20.762719 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:08:20.762693 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 12:08:20.762719 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:08:20.762705 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ccb6b87c4-q7xlf: secret "image-registry-tls" not found Jun 08 12:08:20.762793 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:08:20.762752 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-registry-tls podName:0311d851-b401-448c-a313-00c2aacc2025 nodeName:}" failed. No retries permitted until 2026-06-08 12:08:28.762737274 +0000 UTC m=+230.091085920 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-registry-tls") pod "image-registry-7ccb6b87c4-q7xlf" (UID: "0311d851-b401-448c-a313-00c2aacc2025") : secret "image-registry-tls" not found Jun 08 12:08:20.819505 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:20.819480 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-grts6" event={"ID":"8707cb3e-5f4b-45e7-89b1-f290850e6832","Type":"ContainerStarted","Data":"52d036b36d10922cc0fc522451779aa8c5c564f6e8023af4a66289fd980e3c4d"} Jun 08 12:08:20.819808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:20.819530 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-grts6" event={"ID":"8707cb3e-5f4b-45e7-89b1-f290850e6832","Type":"ContainerStarted","Data":"c91035fae2dc81df5d95648aa26258ef9fae66bbd6ddc02aad824ee654c6378a"} Jun 08 12:08:20.835145 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:20.835102 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-grts6" podStartSLOduration=1.638939782 podStartE2EDuration="2.835089808s" totalImagesPullingTime="1.196150026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:08:20.834616087 +0000 UTC m=+222.162964747" watchObservedRunningTime="2026-06-08 12:08:20.835089808 +0000 UTC m=+222.163438456" Jun 08 12:08:22.986715 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:22.986683 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:23.362761 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:23.362733 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:23.463776 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:23.463751 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:23.563719 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:23.563670 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:23.664123 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:23.664067 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:23.764998 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:23.764973 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:24.094381 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:24.094356 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:25.051621 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:25.051590 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:25.449830 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:25.449807 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:25.658258 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:25.658230 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:25.849697 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:25.849671 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:26.246993 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:26.246932 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:26.881347 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:26.881320 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:27.065597 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:27.065574 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:27.249320 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:27.249244 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:27.511456 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:27.511392 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:27.650444 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:27.650415 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:27.846848 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:27.846827 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:28.050010 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:28.049987 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:28.816980 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:28.816950 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-registry-tls\") pod \"image-registry-7ccb6b87c4-q7xlf\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:28.819133 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:28.819114 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-registry-tls\") pod \"image-registry-7ccb6b87c4-q7xlf\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:28.910931 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:28.910899 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:29.031002 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:29.030976 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7ccb6b87c4-q7xlf"] Jun 08 12:08:29.033981 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:08:29.033959 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0311d851_b401_448c_a313_00c2aacc2025.slice/crio-527f57f10cf7fcd5526da90c0cab27045bda53349d6628afdc9a69c8f2e4d81e WatchSource:0}: Error finding container 527f57f10cf7fcd5526da90c0cab27045bda53349d6628afdc9a69c8f2e4d81e: Status 404 returned error can't find the container with id 527f57f10cf7fcd5526da90c0cab27045bda53349d6628afdc9a69c8f2e4d81e Jun 08 12:08:29.053350 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:29.053327 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:29.251517 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:29.251485 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:29.647378 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:29.647280 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:29.748062 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:29.748038 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:29.844297 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:29.844272 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" event={"ID":"0311d851-b401-448c-a313-00c2aacc2025","Type":"ContainerStarted","Data":"c76a875a311c9ef21573e08e045d0061659651ce4723fc64b961ec69cc30092b"} Jun 08 12:08:29.844436 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:29.844328 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" event={"ID":"0311d851-b401-448c-a313-00c2aacc2025","Type":"ContainerStarted","Data":"527f57f10cf7fcd5526da90c0cab27045bda53349d6628afdc9a69c8f2e4d81e"} Jun 08 12:08:29.844436 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:29.844358 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:08:29.863029 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:29.862990 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" podStartSLOduration=17.862977234 podStartE2EDuration="17.862977234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:08:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:08:29.861848945 +0000 UTC m=+231.190197596" watchObservedRunningTime="2026-06-08 12:08:29.862977234 +0000 UTC m=+231.191325902" Jun 08 12:08:29.866033 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:29.866007 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:29.965889 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:29.965837 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:30.455027 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:30.455003 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:30.849762 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:30.849726 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:31.130128 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:31.130056 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:31.182615 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:31.182588 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:31.249136 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:31.249114 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:31.452914 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:31.452848 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:31.652825 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:31.652805 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:31.854403 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:31.854380 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:32.454139 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:32.454117 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:32.854838 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:32.854811 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:33.255190 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:33.255124 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:33.453048 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:33.453022 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:33.848270 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:33.848245 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:34.049808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:34.049780 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:40.337882 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:40.337851 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5th2j"] Jun 08 12:08:40.342828 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:40.342811 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5th2j" Jun 08 12:08:40.345025 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:40.345003 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 12:08:40.345139 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:40.345005 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hq4d8\"" Jun 08 12:08:40.345139 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:40.345053 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 12:08:40.350739 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:40.350719 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5th2j"] Jun 08 12:08:40.389945 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:40.389921 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7ccb6b87c4-q7xlf"] Jun 08 12:08:40.455152 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:40.455122 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:40.491401 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:40.491382 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/20a0d005-c050-4c9d-ae42-2feea0eb416b-data-volume\") pod \"insights-runtime-extractor-5th2j\" (UID: \"20a0d005-c050-4c9d-ae42-2feea0eb416b\") " pod="openshift-insights/insights-runtime-extractor-5th2j" Jun 08 12:08:40.491498 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:40.491412 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/20a0d005-c050-4c9d-ae42-2feea0eb416b-crio-socket\") pod \"insights-runtime-extractor-5th2j\" (UID: \"20a0d005-c050-4c9d-ae42-2feea0eb416b\") " pod="openshift-insights/insights-runtime-extractor-5th2j" Jun 08 12:08:40.491498 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:40.491444 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkllz\" (UniqueName: \"kubernetes.io/projected/20a0d005-c050-4c9d-ae42-2feea0eb416b-kube-api-access-zkllz\") pod \"insights-runtime-extractor-5th2j\" (UID: \"20a0d005-c050-4c9d-ae42-2feea0eb416b\") " pod="openshift-insights/insights-runtime-extractor-5th2j" Jun 08 12:08:40.491567 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:40.491551 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20a0d005-c050-4c9d-ae42-2feea0eb416b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5th2j\" (UID: \"20a0d005-c050-4c9d-ae42-2feea0eb416b\") " pod="openshift-insights/insights-runtime-extractor-5th2j" Jun 08 12:08:40.491600 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:40.491584 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20a0d005-c050-4c9d-ae42-2feea0eb416b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5th2j\" (UID: \"20a0d005-c050-4c9d-ae42-2feea0eb416b\") " pod="openshift-insights/insights-runtime-extractor-5th2j" Jun 08 12:08:40.531214 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:40.531191 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:40.592737 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:40.592691 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/20a0d005-c050-4c9d-ae42-2feea0eb416b-crio-socket\") pod \"insights-runtime-extractor-5th2j\" (UID: \"20a0d005-c050-4c9d-ae42-2feea0eb416b\") " pod="openshift-insights/insights-runtime-extractor-5th2j" Jun 08 12:08:40.592737 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:40.592731 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkllz\" (UniqueName: \"kubernetes.io/projected/20a0d005-c050-4c9d-ae42-2feea0eb416b-kube-api-access-zkllz\") pod \"insights-runtime-extractor-5th2j\" (UID: \"20a0d005-c050-4c9d-ae42-2feea0eb416b\") " pod="openshift-insights/insights-runtime-extractor-5th2j" Jun 08 12:08:40.592835 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:40.592771 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20a0d005-c050-4c9d-ae42-2feea0eb416b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5th2j\" (UID: \"20a0d005-c050-4c9d-ae42-2feea0eb416b\") " pod="openshift-insights/insights-runtime-extractor-5th2j" Jun 08 12:08:40.592835 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:40.592803 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/20a0d005-c050-4c9d-ae42-2feea0eb416b-crio-socket\") pod \"insights-runtime-extractor-5th2j\" (UID: \"20a0d005-c050-4c9d-ae42-2feea0eb416b\") " pod="openshift-insights/insights-runtime-extractor-5th2j" Jun 08 12:08:40.592835 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:40.592805 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20a0d005-c050-4c9d-ae42-2feea0eb416b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5th2j\" (UID: \"20a0d005-c050-4c9d-ae42-2feea0eb416b\") " pod="openshift-insights/insights-runtime-extractor-5th2j" Jun 08 12:08:40.592941 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:40.592869 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/20a0d005-c050-4c9d-ae42-2feea0eb416b-data-volume\") pod \"insights-runtime-extractor-5th2j\" (UID: \"20a0d005-c050-4c9d-ae42-2feea0eb416b\") " pod="openshift-insights/insights-runtime-extractor-5th2j" Jun 08 12:08:40.593241 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:40.593225 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/20a0d005-c050-4c9d-ae42-2feea0eb416b-data-volume\") pod \"insights-runtime-extractor-5th2j\" (UID: \"20a0d005-c050-4c9d-ae42-2feea0eb416b\") " pod="openshift-insights/insights-runtime-extractor-5th2j" Jun 08 12:08:40.593391 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:40.593376 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20a0d005-c050-4c9d-ae42-2feea0eb416b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5th2j\" (UID: \"20a0d005-c050-4c9d-ae42-2feea0eb416b\") " pod="openshift-insights/insights-runtime-extractor-5th2j" Jun 08 12:08:40.594909 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:40.594884 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20a0d005-c050-4c9d-ae42-2feea0eb416b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5th2j\" (UID: \"20a0d005-c050-4c9d-ae42-2feea0eb416b\") " pod="openshift-insights/insights-runtime-extractor-5th2j" Jun 08 12:08:40.616316 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:40.616280 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkllz\" (UniqueName: \"kubernetes.io/projected/20a0d005-c050-4c9d-ae42-2feea0eb416b-kube-api-access-zkllz\") pod \"insights-runtime-extractor-5th2j\" (UID: \"20a0d005-c050-4c9d-ae42-2feea0eb416b\") " pod="openshift-insights/insights-runtime-extractor-5th2j" Jun 08 12:08:40.651520 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:40.651499 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5th2j" Jun 08 12:08:40.770919 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:40.770889 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5th2j"] Jun 08 12:08:40.774737 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:08:40.774710 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20a0d005_c050_4c9d_ae42_2feea0eb416b.slice/crio-ff5fe178b22410fee02f7a6c0dcb146cb903e3c935e0399876536b5f9da15770 WatchSource:0}: Error finding container ff5fe178b22410fee02f7a6c0dcb146cb903e3c935e0399876536b5f9da15770: Status 404 returned error can't find the container with id ff5fe178b22410fee02f7a6c0dcb146cb903e3c935e0399876536b5f9da15770 Jun 08 12:08:40.878598 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:40.878537 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5th2j" event={"ID":"20a0d005-c050-4c9d-ae42-2feea0eb416b","Type":"ContainerStarted","Data":"70e1f642f2c20b9e76993fcd26e5a748b5f6194e148c7f95a2052ed38452eaff"} Jun 08 12:08:40.878598 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:40.878586 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5th2j" event={"ID":"20a0d005-c050-4c9d-ae42-2feea0eb416b","Type":"ContainerStarted","Data":"ff5fe178b22410fee02f7a6c0dcb146cb903e3c935e0399876536b5f9da15770"} Jun 08 12:08:41.883505 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:41.883477 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5th2j" event={"ID":"20a0d005-c050-4c9d-ae42-2feea0eb416b","Type":"ContainerStarted","Data":"320cb239105d16859f92feb0cb8906f2c1887fc411e9b2d385acd1d6d1e6409e"} Jun 08 12:08:43.891314 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:43.891284 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5th2j" event={"ID":"20a0d005-c050-4c9d-ae42-2feea0eb416b","Type":"ContainerStarted","Data":"581d9d65b557173f93e855cb530949a0a2bc7931dfbf0ebcce4a71cb68f05eb8"} Jun 08 12:08:43.906600 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:43.906557 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5th2j" podStartSLOduration=1.656868625 podStartE2EDuration="3.906541983s" totalImagesPullingTime="2.249673358s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:08:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:08:43.906405262 +0000 UTC m=+245.234753912" watchObservedRunningTime="2026-06-08 12:08:43.906541983 +0000 UTC m=+245.234890641" Jun 08 12:08:47.346903 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:47.346861 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:47.454027 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:47.454001 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:47.548464 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:47.548442 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:47.652423 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:47.652370 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:47.657596 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:47.657577 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ksrrb"] Jun 08 12:08:47.660560 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:47.660546 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ksrrb" Jun 08 12:08:47.663748 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:47.663727 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 08 12:08:47.663862 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:47.663751 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-hgsbh\"" Jun 08 12:08:47.670949 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:47.670930 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ksrrb"] Jun 08 12:08:47.744597 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:47.744573 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0a205280-732c-4f01-a1f0-ba3e966f9166-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-ksrrb\" (UID: \"0a205280-732c-4f01-a1f0-ba3e966f9166\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ksrrb" Jun 08 12:08:47.845314 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:47.845288 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0a205280-732c-4f01-a1f0-ba3e966f9166-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-ksrrb\" (UID: \"0a205280-732c-4f01-a1f0-ba3e966f9166\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ksrrb" Jun 08 12:08:47.847483 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:47.847461 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0a205280-732c-4f01-a1f0-ba3e966f9166-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-ksrrb\" (UID: \"0a205280-732c-4f01-a1f0-ba3e966f9166\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ksrrb" Jun 08 12:08:47.908054 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:47.907998 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:47.968522 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:47.968502 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ksrrb" Jun 08 12:08:48.083463 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:48.083435 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ksrrb"] Jun 08 12:08:48.086286 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:08:48.086265 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a205280_732c_4f01_a1f0_ba3e966f9166.slice/crio-2cf4a4f901ffb8de70e36790bd20917c01f388e295733bf04da4bbdaa8dd21a8 WatchSource:0}: Error finding container 2cf4a4f901ffb8de70e36790bd20917c01f388e295733bf04da4bbdaa8dd21a8: Status 404 returned error can't find the container with id 2cf4a4f901ffb8de70e36790bd20917c01f388e295733bf04da4bbdaa8dd21a8 Jun 08 12:08:48.242212 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:48.242152 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:48.906974 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:48.906938 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ksrrb" event={"ID":"0a205280-732c-4f01-a1f0-ba3e966f9166","Type":"ContainerStarted","Data":"2cf4a4f901ffb8de70e36790bd20917c01f388e295733bf04da4bbdaa8dd21a8"} Jun 08 12:08:49.332274 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:49.332252 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:49.431558 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:49.431530 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:49.910948 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:49.910915 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ksrrb" event={"ID":"0a205280-732c-4f01-a1f0-ba3e966f9166","Type":"ContainerStarted","Data":"f381ced2ffb81ff50e6a39a362d7b4886cf52182de902d795db3836851c7fad4"} Jun 08 12:08:49.911327 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:49.911106 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ksrrb" Jun 08 12:08:49.915453 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:49.915433 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ksrrb" Jun 08 12:08:49.927485 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:49.927447 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ksrrb" podStartSLOduration=1.701872885 podStartE2EDuration="2.927432687s" totalImagesPullingTime="1.225559802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:08:49.926907664 +0000 UTC m=+251.255256319" watchObservedRunningTime="2026-06-08 12:08:49.927432687 +0000 UTC m=+251.255781350" Jun 08 12:08:50.399847 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:50.399815 2565 patch_prober.go:28] interesting pod/image-registry-7ccb6b87c4-q7xlf container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 12:08:50.399998 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:50.399869 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" podUID="0311d851-b401-448c-a313-00c2aacc2025" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 12:08:50.685190 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:50.685093 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:50.749769 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:50.749741 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:50.868849 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:50.868823 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs\") pod \"network-metrics-daemon-8tsdl\" (UID: \"50c05198-1996-4465-97df-8ae929b9410b\") " pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:08:50.870859 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:50.870838 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50c05198-1996-4465-97df-8ae929b9410b-metrics-certs\") pod \"network-metrics-daemon-8tsdl\" (UID: \"50c05198-1996-4465-97df-8ae929b9410b\") " pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:08:50.921521 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:50.921497 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jxz55\"" Jun 08 12:08:50.929875 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:50.929859 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tsdl" Jun 08 12:08:51.045839 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:51.045808 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8tsdl"] Jun 08 12:08:51.048243 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:08:51.048218 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50c05198_1996_4465_97df_8ae929b9410b.slice/crio-359cf527fc968bccd634e153e5c19f360a2cf36b4479e423ded19c4d7cebf865 WatchSource:0}: Error finding container 359cf527fc968bccd634e153e5c19f360a2cf36b4479e423ded19c4d7cebf865: Status 404 returned error can't find the container with id 359cf527fc968bccd634e153e5c19f360a2cf36b4479e423ded19c4d7cebf865 Jun 08 12:08:51.918526 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:51.918491 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8tsdl" event={"ID":"50c05198-1996-4465-97df-8ae929b9410b","Type":"ContainerStarted","Data":"359cf527fc968bccd634e153e5c19f360a2cf36b4479e423ded19c4d7cebf865"} Jun 08 12:08:52.252846 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:52.252760 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:52.310681 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:52.310627 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:52.364323 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:52.364280 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:52.845060 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:52.845033 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:52.923028 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:52.923001 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8tsdl" event={"ID":"50c05198-1996-4465-97df-8ae929b9410b","Type":"ContainerStarted","Data":"255b1d5e142002407a245855cbbf24c24b9ff8f85fc9efe22863b813f6b682e6"} Jun 08 12:08:52.923142 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:52.923049 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8tsdl" event={"ID":"50c05198-1996-4465-97df-8ae929b9410b","Type":"ContainerStarted","Data":"e7135a24f63e95d4088a37c6f3911ad7f15434b5f2c60414fd34cd534b70b478"} Jun 08 12:08:52.938247 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:52.938207 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8tsdl" podStartSLOduration=252.655961843 podStartE2EDuration="4m13.938191949s" totalImagesPullingTime="1.282230106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:08:52.937240186 +0000 UTC m=+254.265588848" watchObservedRunningTime="2026-06-08 12:08:52.938191949 +0000 UTC m=+254.266540596" Jun 08 12:08:53.028836 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:53.028814 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:53.096214 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:53.096159 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:54.826621 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:54.826597 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:54.939474 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:54.939440 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:55.058658 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.058614 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:55.134326 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.134236 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fpwsv"] Jun 08 12:08:55.137565 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.137544 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fpwsv" Jun 08 12:08:55.141931 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.141912 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 12:08:55.142280 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.142265 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 12:08:55.142409 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.142385 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 12:08:55.142640 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.142621 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vncjq\"" Jun 08 12:08:55.142734 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.142655 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 12:08:55.142734 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.142674 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 12:08:55.142842 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.142758 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 12:08:55.165276 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.165240 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:55.226695 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.226675 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:55.299113 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.299092 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a8d1e947-d56d-46ed-889e-33ee22b588fd-node-exporter-wtmp\") pod \"node-exporter-fpwsv\" (UID: \"a8d1e947-d56d-46ed-889e-33ee22b588fd\") " pod="openshift-monitoring/node-exporter-fpwsv" Jun 08 12:08:55.299212 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.299120 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8d1e947-d56d-46ed-889e-33ee22b588fd-sys\") pod \"node-exporter-fpwsv\" (UID: \"a8d1e947-d56d-46ed-889e-33ee22b588fd\") " pod="openshift-monitoring/node-exporter-fpwsv" Jun 08 12:08:55.299212 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.299136 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tq8f\" (UniqueName: \"kubernetes.io/projected/a8d1e947-d56d-46ed-889e-33ee22b588fd-kube-api-access-2tq8f\") pod \"node-exporter-fpwsv\" (UID: \"a8d1e947-d56d-46ed-889e-33ee22b588fd\") " pod="openshift-monitoring/node-exporter-fpwsv" Jun 08 12:08:55.299212 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.299158 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8d1e947-d56d-46ed-889e-33ee22b588fd-metrics-client-ca\") pod \"node-exporter-fpwsv\" (UID: \"a8d1e947-d56d-46ed-889e-33ee22b588fd\") " pod="openshift-monitoring/node-exporter-fpwsv" Jun 08 12:08:55.299212 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.299182 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a8d1e947-d56d-46ed-889e-33ee22b588fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-fpwsv\" (UID: \"a8d1e947-d56d-46ed-889e-33ee22b588fd\") " pod="openshift-monitoring/node-exporter-fpwsv" Jun 08 12:08:55.299389 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.299246 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8d1e947-d56d-46ed-889e-33ee22b588fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fpwsv\" (UID: \"a8d1e947-d56d-46ed-889e-33ee22b588fd\") " pod="openshift-monitoring/node-exporter-fpwsv" Jun 08 12:08:55.299389 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.299277 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a8d1e947-d56d-46ed-889e-33ee22b588fd-node-exporter-textfile\") pod \"node-exporter-fpwsv\" (UID: \"a8d1e947-d56d-46ed-889e-33ee22b588fd\") " pod="openshift-monitoring/node-exporter-fpwsv" Jun 08 12:08:55.299389 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.299292 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a8d1e947-d56d-46ed-889e-33ee22b588fd-node-exporter-tls\") pod \"node-exporter-fpwsv\" (UID: \"a8d1e947-d56d-46ed-889e-33ee22b588fd\") " pod="openshift-monitoring/node-exporter-fpwsv" Jun 08 12:08:55.299389 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.299342 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a8d1e947-d56d-46ed-889e-33ee22b588fd-root\") pod \"node-exporter-fpwsv\" (UID: \"a8d1e947-d56d-46ed-889e-33ee22b588fd\") " pod="openshift-monitoring/node-exporter-fpwsv" Jun 08 12:08:55.341665 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.341634 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:55.399643 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.399586 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a8d1e947-d56d-46ed-889e-33ee22b588fd-node-exporter-textfile\") pod \"node-exporter-fpwsv\" (UID: \"a8d1e947-d56d-46ed-889e-33ee22b588fd\") " pod="openshift-monitoring/node-exporter-fpwsv" Jun 08 12:08:55.399643 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.399611 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a8d1e947-d56d-46ed-889e-33ee22b588fd-node-exporter-tls\") pod \"node-exporter-fpwsv\" (UID: \"a8d1e947-d56d-46ed-889e-33ee22b588fd\") " pod="openshift-monitoring/node-exporter-fpwsv" Jun 08 12:08:55.399643 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.399638 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a8d1e947-d56d-46ed-889e-33ee22b588fd-root\") pod \"node-exporter-fpwsv\" (UID: \"a8d1e947-d56d-46ed-889e-33ee22b588fd\") " pod="openshift-monitoring/node-exporter-fpwsv" Jun 08 12:08:55.399833 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.399668 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a8d1e947-d56d-46ed-889e-33ee22b588fd-node-exporter-wtmp\") pod \"node-exporter-fpwsv\" (UID: \"a8d1e947-d56d-46ed-889e-33ee22b588fd\") " pod="openshift-monitoring/node-exporter-fpwsv" Jun 08 12:08:55.399833 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.399695 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8d1e947-d56d-46ed-889e-33ee22b588fd-sys\") pod \"node-exporter-fpwsv\" (UID: \"a8d1e947-d56d-46ed-889e-33ee22b588fd\") " pod="openshift-monitoring/node-exporter-fpwsv" Jun 08 12:08:55.399833 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.399716 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tq8f\" (UniqueName: \"kubernetes.io/projected/a8d1e947-d56d-46ed-889e-33ee22b588fd-kube-api-access-2tq8f\") pod \"node-exporter-fpwsv\" (UID: \"a8d1e947-d56d-46ed-889e-33ee22b588fd\") " pod="openshift-monitoring/node-exporter-fpwsv" Jun 08 12:08:55.399833 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.399746 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8d1e947-d56d-46ed-889e-33ee22b588fd-metrics-client-ca\") pod \"node-exporter-fpwsv\" (UID: \"a8d1e947-d56d-46ed-889e-33ee22b588fd\") " pod="openshift-monitoring/node-exporter-fpwsv" Jun 08 12:08:55.399833 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.399764 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a8d1e947-d56d-46ed-889e-33ee22b588fd-root\") pod \"node-exporter-fpwsv\" (UID: \"a8d1e947-d56d-46ed-889e-33ee22b588fd\") " pod="openshift-monitoring/node-exporter-fpwsv" Jun 08 12:08:55.399833 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.399775 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a8d1e947-d56d-46ed-889e-33ee22b588fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-fpwsv\" (UID: \"a8d1e947-d56d-46ed-889e-33ee22b588fd\") " pod="openshift-monitoring/node-exporter-fpwsv" Jun 08 12:08:55.399833 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.399787 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8d1e947-d56d-46ed-889e-33ee22b588fd-sys\") pod \"node-exporter-fpwsv\" (UID: \"a8d1e947-d56d-46ed-889e-33ee22b588fd\") " pod="openshift-monitoring/node-exporter-fpwsv" Jun 08 12:08:55.400148 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.399853 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a8d1e947-d56d-46ed-889e-33ee22b588fd-node-exporter-textfile\") pod \"node-exporter-fpwsv\" (UID: \"a8d1e947-d56d-46ed-889e-33ee22b588fd\") " pod="openshift-monitoring/node-exporter-fpwsv" Jun 08 12:08:55.400148 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.399853 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a8d1e947-d56d-46ed-889e-33ee22b588fd-node-exporter-wtmp\") pod \"node-exporter-fpwsv\" (UID: \"a8d1e947-d56d-46ed-889e-33ee22b588fd\") " pod="openshift-monitoring/node-exporter-fpwsv" Jun 08 12:08:55.400148 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.399870 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8d1e947-d56d-46ed-889e-33ee22b588fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fpwsv\" (UID: \"a8d1e947-d56d-46ed-889e-33ee22b588fd\") " pod="openshift-monitoring/node-exporter-fpwsv" Jun 08 12:08:55.400371 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.400346 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a8d1e947-d56d-46ed-889e-33ee22b588fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-fpwsv\" (UID: \"a8d1e947-d56d-46ed-889e-33ee22b588fd\") " pod="openshift-monitoring/node-exporter-fpwsv" Jun 08 12:08:55.400486 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.400444 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8d1e947-d56d-46ed-889e-33ee22b588fd-metrics-client-ca\") pod \"node-exporter-fpwsv\" (UID: \"a8d1e947-d56d-46ed-889e-33ee22b588fd\") " pod="openshift-monitoring/node-exporter-fpwsv" Jun 08 12:08:55.400605 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.400587 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:55.401914 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.401896 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a8d1e947-d56d-46ed-889e-33ee22b588fd-node-exporter-tls\") pod \"node-exporter-fpwsv\" (UID: \"a8d1e947-d56d-46ed-889e-33ee22b588fd\") " pod="openshift-monitoring/node-exporter-fpwsv" Jun 08 12:08:55.402097 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.402077 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8d1e947-d56d-46ed-889e-33ee22b588fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fpwsv\" (UID: \"a8d1e947-d56d-46ed-889e-33ee22b588fd\") " pod="openshift-monitoring/node-exporter-fpwsv" Jun 08 12:08:55.407286 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.407260 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tq8f\" (UniqueName: \"kubernetes.io/projected/a8d1e947-d56d-46ed-889e-33ee22b588fd-kube-api-access-2tq8f\") pod \"node-exporter-fpwsv\" (UID: \"a8d1e947-d56d-46ed-889e-33ee22b588fd\") " pod="openshift-monitoring/node-exporter-fpwsv" Jun 08 12:08:55.446458 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.446433 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fpwsv" Jun 08 12:08:55.458715 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:08:55.458694 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8d1e947_d56d_46ed_889e_33ee22b588fd.slice/crio-6ea210fa7d04a23b7cc82041a9917d07fc2a40707fa76232a979c0e6863c13e0 WatchSource:0}: Error finding container 6ea210fa7d04a23b7cc82041a9917d07fc2a40707fa76232a979c0e6863c13e0: Status 404 returned error can't find the container with id 6ea210fa7d04a23b7cc82041a9917d07fc2a40707fa76232a979c0e6863c13e0 Jun 08 12:08:55.461500 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.461470 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:55.700452 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.700391 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:55.935437 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:55.935402 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fpwsv" event={"ID":"a8d1e947-d56d-46ed-889e-33ee22b588fd","Type":"ContainerStarted","Data":"6ea210fa7d04a23b7cc82041a9917d07fc2a40707fa76232a979c0e6863c13e0"} Jun 08 12:08:56.074324 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:56.074283 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:56.152520 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:56.152488 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:56.376030 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:56.375940 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:56.942078 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:56.942012 2565 generic.go:356] "Generic (PLEG): container finished" podID="a8d1e947-d56d-46ed-889e-33ee22b588fd" containerID="614870d6926b74f1267e4503a932f9c7c1b924ddd64f3990e9a086289cff4dfc" exitCode=0 Jun 08 12:08:56.942078 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:56.942072 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fpwsv" event={"ID":"a8d1e947-d56d-46ed-889e-33ee22b588fd","Type":"ContainerDied","Data":"614870d6926b74f1267e4503a932f9c7c1b924ddd64f3990e9a086289cff4dfc"} Jun 08 12:08:57.078713 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.078688 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5"] Jun 08 12:08:57.082814 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.082795 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" Jun 08 12:08:57.085409 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.085389 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 08 12:08:57.085516 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.085420 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 08 12:08:57.085709 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.085692 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-vfcqk\"" Jun 08 12:08:57.085780 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.085735 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1m224encc1un2\"" Jun 08 12:08:57.085949 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.085935 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 08 12:08:57.086020 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.085969 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 08 12:08:57.086091 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.086069 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 08 12:08:57.095398 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.095379 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5"] Jun 08 12:08:57.210506 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.210449 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a44dd565-96e2-442c-a90f-4dc1a38d7b66-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b4dd9c845-hj9p5\" (UID: \"a44dd565-96e2-442c-a90f-4dc1a38d7b66\") " pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" Jun 08 12:08:57.210506 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.210488 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a44dd565-96e2-442c-a90f-4dc1a38d7b66-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b4dd9c845-hj9p5\" (UID: \"a44dd565-96e2-442c-a90f-4dc1a38d7b66\") " pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" Jun 08 12:08:57.210655 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.210518 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a44dd565-96e2-442c-a90f-4dc1a38d7b66-metrics-client-ca\") pod \"thanos-querier-5b4dd9c845-hj9p5\" (UID: \"a44dd565-96e2-442c-a90f-4dc1a38d7b66\") " pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" Jun 08 12:08:57.210655 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.210545 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a44dd565-96e2-442c-a90f-4dc1a38d7b66-secret-grpc-tls\") pod \"thanos-querier-5b4dd9c845-hj9p5\" (UID: \"a44dd565-96e2-442c-a90f-4dc1a38d7b66\") " pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" Jun 08 12:08:57.210655 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.210576 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a44dd565-96e2-442c-a90f-4dc1a38d7b66-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b4dd9c845-hj9p5\" (UID: \"a44dd565-96e2-442c-a90f-4dc1a38d7b66\") " pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" Jun 08 12:08:57.210655 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.210596 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqzdz\" (UniqueName: \"kubernetes.io/projected/a44dd565-96e2-442c-a90f-4dc1a38d7b66-kube-api-access-wqzdz\") pod \"thanos-querier-5b4dd9c845-hj9p5\" (UID: \"a44dd565-96e2-442c-a90f-4dc1a38d7b66\") " pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" Jun 08 12:08:57.210655 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.210639 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a44dd565-96e2-442c-a90f-4dc1a38d7b66-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b4dd9c845-hj9p5\" (UID: \"a44dd565-96e2-442c-a90f-4dc1a38d7b66\") " pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" Jun 08 12:08:57.210810 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.210665 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a44dd565-96e2-442c-a90f-4dc1a38d7b66-secret-thanos-querier-tls\") pod \"thanos-querier-5b4dd9c845-hj9p5\" (UID: \"a44dd565-96e2-442c-a90f-4dc1a38d7b66\") " pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" Jun 08 12:08:57.311522 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.311494 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a44dd565-96e2-442c-a90f-4dc1a38d7b66-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b4dd9c845-hj9p5\" (UID: \"a44dd565-96e2-442c-a90f-4dc1a38d7b66\") " pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" Jun 08 12:08:57.311657 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.311531 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqzdz\" (UniqueName: \"kubernetes.io/projected/a44dd565-96e2-442c-a90f-4dc1a38d7b66-kube-api-access-wqzdz\") pod \"thanos-querier-5b4dd9c845-hj9p5\" (UID: \"a44dd565-96e2-442c-a90f-4dc1a38d7b66\") " pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" Jun 08 12:08:57.311657 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.311559 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a44dd565-96e2-442c-a90f-4dc1a38d7b66-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b4dd9c845-hj9p5\" (UID: \"a44dd565-96e2-442c-a90f-4dc1a38d7b66\") " pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" Jun 08 12:08:57.311657 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.311586 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a44dd565-96e2-442c-a90f-4dc1a38d7b66-secret-thanos-querier-tls\") pod \"thanos-querier-5b4dd9c845-hj9p5\" (UID: \"a44dd565-96e2-442c-a90f-4dc1a38d7b66\") " pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" Jun 08 12:08:57.311657 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.311629 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a44dd565-96e2-442c-a90f-4dc1a38d7b66-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b4dd9c845-hj9p5\" (UID: \"a44dd565-96e2-442c-a90f-4dc1a38d7b66\") " pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" Jun 08 12:08:57.311845 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.311697 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a44dd565-96e2-442c-a90f-4dc1a38d7b66-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b4dd9c845-hj9p5\" (UID: \"a44dd565-96e2-442c-a90f-4dc1a38d7b66\") " pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" Jun 08 12:08:57.311845 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.311743 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a44dd565-96e2-442c-a90f-4dc1a38d7b66-metrics-client-ca\") pod \"thanos-querier-5b4dd9c845-hj9p5\" (UID: \"a44dd565-96e2-442c-a90f-4dc1a38d7b66\") " pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" Jun 08 12:08:57.311845 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.311767 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a44dd565-96e2-442c-a90f-4dc1a38d7b66-secret-grpc-tls\") pod \"thanos-querier-5b4dd9c845-hj9p5\" (UID: \"a44dd565-96e2-442c-a90f-4dc1a38d7b66\") " pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" Jun 08 12:08:57.312520 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.312493 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a44dd565-96e2-442c-a90f-4dc1a38d7b66-metrics-client-ca\") pod \"thanos-querier-5b4dd9c845-hj9p5\" (UID: \"a44dd565-96e2-442c-a90f-4dc1a38d7b66\") " pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" Jun 08 12:08:57.314071 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.314047 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a44dd565-96e2-442c-a90f-4dc1a38d7b66-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b4dd9c845-hj9p5\" (UID: \"a44dd565-96e2-442c-a90f-4dc1a38d7b66\") " pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" Jun 08 12:08:57.314241 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.314220 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a44dd565-96e2-442c-a90f-4dc1a38d7b66-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b4dd9c845-hj9p5\" (UID: \"a44dd565-96e2-442c-a90f-4dc1a38d7b66\") " pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" Jun 08 12:08:57.314494 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.314476 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a44dd565-96e2-442c-a90f-4dc1a38d7b66-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b4dd9c845-hj9p5\" (UID: \"a44dd565-96e2-442c-a90f-4dc1a38d7b66\") " pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" Jun 08 12:08:57.314651 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.314630 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a44dd565-96e2-442c-a90f-4dc1a38d7b66-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b4dd9c845-hj9p5\" (UID: \"a44dd565-96e2-442c-a90f-4dc1a38d7b66\") " pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" Jun 08 12:08:57.314688 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.314651 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a44dd565-96e2-442c-a90f-4dc1a38d7b66-secret-thanos-querier-tls\") pod \"thanos-querier-5b4dd9c845-hj9p5\" (UID: \"a44dd565-96e2-442c-a90f-4dc1a38d7b66\") " pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" Jun 08 12:08:57.314688 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.314643 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a44dd565-96e2-442c-a90f-4dc1a38d7b66-secret-grpc-tls\") pod \"thanos-querier-5b4dd9c845-hj9p5\" (UID: \"a44dd565-96e2-442c-a90f-4dc1a38d7b66\") " pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" Jun 08 12:08:57.319614 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.319596 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqzdz\" (UniqueName: \"kubernetes.io/projected/a44dd565-96e2-442c-a90f-4dc1a38d7b66-kube-api-access-wqzdz\") pod \"thanos-querier-5b4dd9c845-hj9p5\" (UID: \"a44dd565-96e2-442c-a90f-4dc1a38d7b66\") " pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" Jun 08 12:08:57.392571 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.392552 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" Jun 08 12:08:57.533899 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.533868 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5"] Jun 08 12:08:57.537892 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:08:57.537868 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda44dd565_96e2_442c_a90f_4dc1a38d7b66.slice/crio-020f2ed782df09999e795387cb1c68b88fcf07f1fb741f946f4a89604c40f637 WatchSource:0}: Error finding container 020f2ed782df09999e795387cb1c68b88fcf07f1fb741f946f4a89604c40f637: Status 404 returned error can't find the container with id 020f2ed782df09999e795387cb1c68b88fcf07f1fb741f946f4a89604c40f637 Jun 08 12:08:57.946185 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.946146 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" event={"ID":"a44dd565-96e2-442c-a90f-4dc1a38d7b66","Type":"ContainerStarted","Data":"020f2ed782df09999e795387cb1c68b88fcf07f1fb741f946f4a89604c40f637"} Jun 08 12:08:57.947894 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.947867 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fpwsv" event={"ID":"a8d1e947-d56d-46ed-889e-33ee22b588fd","Type":"ContainerStarted","Data":"b177c3d8bcc2f0b009f7b4bcda81527c988005f8a8887da62dcad259a6c6f650"} Jun 08 12:08:57.948004 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.947907 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fpwsv" event={"ID":"a8d1e947-d56d-46ed-889e-33ee22b588fd","Type":"ContainerStarted","Data":"90b279dff8468915ea775cbaa47d79a7bc3cd6c1ee25aa78c1cd67e398629d03"} Jun 08 12:08:57.968367 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:57.968320 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fpwsv" podStartSLOduration=1.763564185 podStartE2EDuration="2.968289355s" totalImagesPullingTime="1.142164989s" totalInitContainerRuntime="62.560181ms" isStatefulPod=true podCreationTimestamp="2026-06-08 12:08:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:08:57.967190371 +0000 UTC m=+259.295539020" watchObservedRunningTime="2026-06-08 12:08:57.968289355 +0000 UTC m=+259.296638003" Jun 08 12:08:58.002323 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:58.002278 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:58.101226 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:58.101193 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:58.157002 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:58.156974 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:58.338440 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:58.338408 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:59.227638 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.227609 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:59.282813 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.282770 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:59.362534 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.362476 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:59.502436 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.502412 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5cbdc5b888-98rw8"] Jun 08 12:08:59.505701 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.505681 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" Jun 08 12:08:59.508531 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.508512 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1tre0svg5i766\"" Jun 08 12:08:59.508639 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.508513 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-7f8fv\"" Jun 08 12:08:59.508639 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.508512 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 08 12:08:59.508639 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.508556 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 08 12:08:59.508639 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.508560 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 08 12:08:59.508639 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.508512 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 08 12:08:59.516500 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.516480 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5cbdc5b888-98rw8"] Jun 08 12:08:59.538824 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.538802 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:59.627934 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.627908 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e97d57fe-d882-4489-9bc2-5a1fd534dad8-secret-metrics-server-tls\") pod \"metrics-server-5cbdc5b888-98rw8\" (UID: \"e97d57fe-d882-4489-9bc2-5a1fd534dad8\") " pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" Jun 08 12:08:59.628019 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.627961 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e97d57fe-d882-4489-9bc2-5a1fd534dad8-client-ca-bundle\") pod \"metrics-server-5cbdc5b888-98rw8\" (UID: \"e97d57fe-d882-4489-9bc2-5a1fd534dad8\") " pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" Jun 08 12:08:59.628072 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.628052 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e97d57fe-d882-4489-9bc2-5a1fd534dad8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5cbdc5b888-98rw8\" (UID: \"e97d57fe-d882-4489-9bc2-5a1fd534dad8\") " pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" Jun 08 12:08:59.628124 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.628088 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j7j5\" (UniqueName: \"kubernetes.io/projected/e97d57fe-d882-4489-9bc2-5a1fd534dad8-kube-api-access-7j7j5\") pod \"metrics-server-5cbdc5b888-98rw8\" (UID: \"e97d57fe-d882-4489-9bc2-5a1fd534dad8\") " pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" Jun 08 12:08:59.628124 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.628108 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e97d57fe-d882-4489-9bc2-5a1fd534dad8-audit-log\") pod \"metrics-server-5cbdc5b888-98rw8\" (UID: \"e97d57fe-d882-4489-9bc2-5a1fd534dad8\") " pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" Jun 08 12:08:59.628192 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.628134 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e97d57fe-d882-4489-9bc2-5a1fd534dad8-metrics-server-audit-profiles\") pod \"metrics-server-5cbdc5b888-98rw8\" (UID: \"e97d57fe-d882-4489-9bc2-5a1fd534dad8\") " pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" Jun 08 12:08:59.628192 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.628161 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e97d57fe-d882-4489-9bc2-5a1fd534dad8-secret-metrics-server-client-certs\") pod \"metrics-server-5cbdc5b888-98rw8\" (UID: \"e97d57fe-d882-4489-9bc2-5a1fd534dad8\") " pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" Jun 08 12:08:59.728541 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.728477 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j7j5\" (UniqueName: \"kubernetes.io/projected/e97d57fe-d882-4489-9bc2-5a1fd534dad8-kube-api-access-7j7j5\") pod \"metrics-server-5cbdc5b888-98rw8\" (UID: \"e97d57fe-d882-4489-9bc2-5a1fd534dad8\") " pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" Jun 08 12:08:59.728541 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.728517 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e97d57fe-d882-4489-9bc2-5a1fd534dad8-audit-log\") pod \"metrics-server-5cbdc5b888-98rw8\" (UID: \"e97d57fe-d882-4489-9bc2-5a1fd534dad8\") " pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" Jun 08 12:08:59.728541 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.728537 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e97d57fe-d882-4489-9bc2-5a1fd534dad8-metrics-server-audit-profiles\") pod \"metrics-server-5cbdc5b888-98rw8\" (UID: \"e97d57fe-d882-4489-9bc2-5a1fd534dad8\") " pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" Jun 08 12:08:59.728739 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.728567 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e97d57fe-d882-4489-9bc2-5a1fd534dad8-secret-metrics-server-client-certs\") pod \"metrics-server-5cbdc5b888-98rw8\" (UID: \"e97d57fe-d882-4489-9bc2-5a1fd534dad8\") " pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" Jun 08 12:08:59.728739 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.728611 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e97d57fe-d882-4489-9bc2-5a1fd534dad8-secret-metrics-server-tls\") pod \"metrics-server-5cbdc5b888-98rw8\" (UID: \"e97d57fe-d882-4489-9bc2-5a1fd534dad8\") " pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" Jun 08 12:08:59.728739 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.728650 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e97d57fe-d882-4489-9bc2-5a1fd534dad8-client-ca-bundle\") pod \"metrics-server-5cbdc5b888-98rw8\" (UID: \"e97d57fe-d882-4489-9bc2-5a1fd534dad8\") " pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" Jun 08 12:08:59.728739 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.728720 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e97d57fe-d882-4489-9bc2-5a1fd534dad8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5cbdc5b888-98rw8\" (UID: \"e97d57fe-d882-4489-9bc2-5a1fd534dad8\") " pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" Jun 08 12:08:59.728931 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.728901 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e97d57fe-d882-4489-9bc2-5a1fd534dad8-audit-log\") pod \"metrics-server-5cbdc5b888-98rw8\" (UID: \"e97d57fe-d882-4489-9bc2-5a1fd534dad8\") " pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" Jun 08 12:08:59.729454 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.729428 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e97d57fe-d882-4489-9bc2-5a1fd534dad8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5cbdc5b888-98rw8\" (UID: \"e97d57fe-d882-4489-9bc2-5a1fd534dad8\") " pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" Jun 08 12:08:59.729563 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.729459 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e97d57fe-d882-4489-9bc2-5a1fd534dad8-metrics-server-audit-profiles\") pod \"metrics-server-5cbdc5b888-98rw8\" (UID: \"e97d57fe-d882-4489-9bc2-5a1fd534dad8\") " pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" Jun 08 12:08:59.731132 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.731111 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e97d57fe-d882-4489-9bc2-5a1fd534dad8-secret-metrics-server-tls\") pod \"metrics-server-5cbdc5b888-98rw8\" (UID: \"e97d57fe-d882-4489-9bc2-5a1fd534dad8\") " pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" Jun 08 12:08:59.731132 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.731129 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e97d57fe-d882-4489-9bc2-5a1fd534dad8-secret-metrics-server-client-certs\") pod \"metrics-server-5cbdc5b888-98rw8\" (UID: \"e97d57fe-d882-4489-9bc2-5a1fd534dad8\") " pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" Jun 08 12:08:59.731251 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.731116 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e97d57fe-d882-4489-9bc2-5a1fd534dad8-client-ca-bundle\") pod \"metrics-server-5cbdc5b888-98rw8\" (UID: \"e97d57fe-d882-4489-9bc2-5a1fd534dad8\") " pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" Jun 08 12:08:59.735716 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.735694 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j7j5\" (UniqueName: \"kubernetes.io/projected/e97d57fe-d882-4489-9bc2-5a1fd534dad8-kube-api-access-7j7j5\") pod \"metrics-server-5cbdc5b888-98rw8\" (UID: \"e97d57fe-d882-4489-9bc2-5a1fd534dad8\") " pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" Jun 08 12:08:59.829605 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.829579 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" Jun 08 12:08:59.849100 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.849075 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:59.947165 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.947139 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5cbdc5b888-98rw8"] Jun 08 12:08:59.950064 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:08:59.950040 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode97d57fe_d882_4489_9bc2_5a1fd534dad8.slice/crio-5873ac29f9d0d71e0e49af84feeec23b2f278e646a4dc42eb09823fe2bd5b231 WatchSource:0}: Error finding container 5873ac29f9d0d71e0e49af84feeec23b2f278e646a4dc42eb09823fe2bd5b231: Status 404 returned error can't find the container with id 5873ac29f9d0d71e0e49af84feeec23b2f278e646a4dc42eb09823fe2bd5b231 Jun 08 12:08:59.950461 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.950441 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:08:59.955969 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.955936 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" event={"ID":"a44dd565-96e2-442c-a90f-4dc1a38d7b66","Type":"ContainerStarted","Data":"dc63e6573611d31d0f1acd35f0d9a16e25fa957b4a4e512b930513bfb00f9792"} Jun 08 12:08:59.956056 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.956003 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" event={"ID":"a44dd565-96e2-442c-a90f-4dc1a38d7b66","Type":"ContainerStarted","Data":"f74c84645353c26b55a05a21422db1ea780ff705e447ebad6cfda6348dbcd39e"} Jun 08 12:08:59.956056 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.956028 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" event={"ID":"a44dd565-96e2-442c-a90f-4dc1a38d7b66","Type":"ContainerStarted","Data":"d5145178003f5333cfc085bac9520c26009e1c81da07461173ddae7429eab17e"} Jun 08 12:08:59.957662 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:08:59.957628 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" event={"ID":"e97d57fe-d882-4489-9bc2-5a1fd534dad8","Type":"ContainerStarted","Data":"5873ac29f9d0d71e0e49af84feeec23b2f278e646a4dc42eb09823fe2bd5b231"} Jun 08 12:09:00.098354 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.098302 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:00.320249 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.320215 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:00.321628 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.321604 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5689b5c5df-r89mj"] Jun 08 12:09:00.325599 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.325578 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" Jun 08 12:09:00.327789 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.327674 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 08 12:09:00.327789 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.327688 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 08 12:09:00.327789 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.327752 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-cphqn\"" Jun 08 12:09:00.327789 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.327788 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 08 12:09:00.328168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.328040 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 08 12:09:00.328233 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.328180 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 08 12:09:00.333679 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.333661 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 08 12:09:00.344719 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.344698 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5689b5c5df-r89mj"] Jun 08 12:09:00.394080 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.394010 2565 patch_prober.go:28] interesting pod/image-registry-7ccb6b87c4-q7xlf container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 12:09:00.394080 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.394051 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" podUID="0311d851-b401-448c-a313-00c2aacc2025" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 12:09:00.399934 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.399912 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:00.434677 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.434654 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khdrm\" (UniqueName: \"kubernetes.io/projected/8debbfba-a053-4587-8a8b-6524cb45bd35-kube-api-access-khdrm\") pod \"telemeter-client-5689b5c5df-r89mj\" (UID: \"8debbfba-a053-4587-8a8b-6524cb45bd35\") " pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" Jun 08 12:09:00.434736 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.434694 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8debbfba-a053-4587-8a8b-6524cb45bd35-secret-telemeter-client\") pod \"telemeter-client-5689b5c5df-r89mj\" (UID: \"8debbfba-a053-4587-8a8b-6524cb45bd35\") " pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" Jun 08 12:09:00.434736 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.434723 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8debbfba-a053-4587-8a8b-6524cb45bd35-telemeter-client-tls\") pod \"telemeter-client-5689b5c5df-r89mj\" (UID: \"8debbfba-a053-4587-8a8b-6524cb45bd35\") " pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" Jun 08 12:09:00.434823 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.434801 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8debbfba-a053-4587-8a8b-6524cb45bd35-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5689b5c5df-r89mj\" (UID: \"8debbfba-a053-4587-8a8b-6524cb45bd35\") " pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" Jun 08 12:09:00.434885 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.434837 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8debbfba-a053-4587-8a8b-6524cb45bd35-serving-certs-ca-bundle\") pod \"telemeter-client-5689b5c5df-r89mj\" (UID: \"8debbfba-a053-4587-8a8b-6524cb45bd35\") " pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" Jun 08 12:09:00.434963 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.434949 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8debbfba-a053-4587-8a8b-6524cb45bd35-federate-client-tls\") pod \"telemeter-client-5689b5c5df-r89mj\" (UID: \"8debbfba-a053-4587-8a8b-6524cb45bd35\") " pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" Jun 08 12:09:00.435011 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.434974 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8debbfba-a053-4587-8a8b-6524cb45bd35-metrics-client-ca\") pod \"telemeter-client-5689b5c5df-r89mj\" (UID: \"8debbfba-a053-4587-8a8b-6524cb45bd35\") " pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" Jun 08 12:09:00.435061 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.435025 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8debbfba-a053-4587-8a8b-6524cb45bd35-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5689b5c5df-r89mj\" (UID: \"8debbfba-a053-4587-8a8b-6524cb45bd35\") " pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" Jun 08 12:09:00.535451 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.535425 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8debbfba-a053-4587-8a8b-6524cb45bd35-federate-client-tls\") pod \"telemeter-client-5689b5c5df-r89mj\" (UID: \"8debbfba-a053-4587-8a8b-6524cb45bd35\") " pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" Jun 08 12:09:00.535549 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.535455 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8debbfba-a053-4587-8a8b-6524cb45bd35-metrics-client-ca\") pod \"telemeter-client-5689b5c5df-r89mj\" (UID: \"8debbfba-a053-4587-8a8b-6524cb45bd35\") " pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" Jun 08 12:09:00.535549 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.535491 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8debbfba-a053-4587-8a8b-6524cb45bd35-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5689b5c5df-r89mj\" (UID: \"8debbfba-a053-4587-8a8b-6524cb45bd35\") " pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" Jun 08 12:09:00.535549 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.535517 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khdrm\" (UniqueName: \"kubernetes.io/projected/8debbfba-a053-4587-8a8b-6524cb45bd35-kube-api-access-khdrm\") pod \"telemeter-client-5689b5c5df-r89mj\" (UID: \"8debbfba-a053-4587-8a8b-6524cb45bd35\") " pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" Jun 08 12:09:00.535549 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.535545 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8debbfba-a053-4587-8a8b-6524cb45bd35-secret-telemeter-client\") pod \"telemeter-client-5689b5c5df-r89mj\" (UID: \"8debbfba-a053-4587-8a8b-6524cb45bd35\") " pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" Jun 08 12:09:00.535761 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.535573 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8debbfba-a053-4587-8a8b-6524cb45bd35-telemeter-client-tls\") pod \"telemeter-client-5689b5c5df-r89mj\" (UID: \"8debbfba-a053-4587-8a8b-6524cb45bd35\") " pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" Jun 08 12:09:00.535761 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.535607 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8debbfba-a053-4587-8a8b-6524cb45bd35-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5689b5c5df-r89mj\" (UID: \"8debbfba-a053-4587-8a8b-6524cb45bd35\") " pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" Jun 08 12:09:00.535761 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.535633 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8debbfba-a053-4587-8a8b-6524cb45bd35-serving-certs-ca-bundle\") pod \"telemeter-client-5689b5c5df-r89mj\" (UID: \"8debbfba-a053-4587-8a8b-6524cb45bd35\") " pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" Jun 08 12:09:00.536253 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.536190 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8debbfba-a053-4587-8a8b-6524cb45bd35-metrics-client-ca\") pod \"telemeter-client-5689b5c5df-r89mj\" (UID: \"8debbfba-a053-4587-8a8b-6524cb45bd35\") " pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" Jun 08 12:09:00.536253 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.536246 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8debbfba-a053-4587-8a8b-6524cb45bd35-serving-certs-ca-bundle\") pod \"telemeter-client-5689b5c5df-r89mj\" (UID: \"8debbfba-a053-4587-8a8b-6524cb45bd35\") " pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" Jun 08 12:09:00.536700 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.536655 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8debbfba-a053-4587-8a8b-6524cb45bd35-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5689b5c5df-r89mj\" (UID: \"8debbfba-a053-4587-8a8b-6524cb45bd35\") " pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" Jun 08 12:09:00.538268 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.538231 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8debbfba-a053-4587-8a8b-6524cb45bd35-federate-client-tls\") pod \"telemeter-client-5689b5c5df-r89mj\" (UID: \"8debbfba-a053-4587-8a8b-6524cb45bd35\") " pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" Jun 08 12:09:00.538565 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.538542 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8debbfba-a053-4587-8a8b-6524cb45bd35-telemeter-client-tls\") pod \"telemeter-client-5689b5c5df-r89mj\" (UID: \"8debbfba-a053-4587-8a8b-6524cb45bd35\") " pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" Jun 08 12:09:00.538796 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.538768 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8debbfba-a053-4587-8a8b-6524cb45bd35-secret-telemeter-client\") pod \"telemeter-client-5689b5c5df-r89mj\" (UID: \"8debbfba-a053-4587-8a8b-6524cb45bd35\") " pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" Jun 08 12:09:00.538978 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.538962 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8debbfba-a053-4587-8a8b-6524cb45bd35-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5689b5c5df-r89mj\" (UID: \"8debbfba-a053-4587-8a8b-6524cb45bd35\") " pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" Jun 08 12:09:00.542890 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.542863 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khdrm\" (UniqueName: \"kubernetes.io/projected/8debbfba-a053-4587-8a8b-6524cb45bd35-kube-api-access-khdrm\") pod \"telemeter-client-5689b5c5df-r89mj\" (UID: \"8debbfba-a053-4587-8a8b-6524cb45bd35\") " pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" Jun 08 12:09:00.635913 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.635884 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" Jun 08 12:09:00.779205 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.779178 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5689b5c5df-r89mj"] Jun 08 12:09:00.781929 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:09:00.781904 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8debbfba_a053_4587_8a8b_6524cb45bd35.slice/crio-0a017d68bc264c7ceabef4e445f66a885313caeccdf28ea3f94d13755f899251 WatchSource:0}: Error finding container 0a017d68bc264c7ceabef4e445f66a885313caeccdf28ea3f94d13755f899251: Status 404 returned error can't find the container with id 0a017d68bc264c7ceabef4e445f66a885313caeccdf28ea3f94d13755f899251 Jun 08 12:09:00.964484 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.964406 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" event={"ID":"a44dd565-96e2-442c-a90f-4dc1a38d7b66","Type":"ContainerStarted","Data":"601fcb769154b8839bfb11f9892e99480cbac62e6e7d7119e2675da3e840cf75"} Jun 08 12:09:00.964638 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.964487 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" event={"ID":"a44dd565-96e2-442c-a90f-4dc1a38d7b66","Type":"ContainerStarted","Data":"d541cccaadc6267443c6423b935c6f4f6228f65956872e0f5d702c7f430c9634"} Jun 08 12:09:00.964638 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.964533 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" event={"ID":"a44dd565-96e2-442c-a90f-4dc1a38d7b66","Type":"ContainerStarted","Data":"94a19174bd2ec351b1333280efa1086ae1ef751071fc14432824143b890d78e2"} Jun 08 12:09:00.964638 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.964583 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" Jun 08 12:09:00.965765 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.965735 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" event={"ID":"8debbfba-a053-4587-8a8b-6524cb45bd35","Type":"ContainerStarted","Data":"0a017d68bc264c7ceabef4e445f66a885313caeccdf28ea3f94d13755f899251"} Jun 08 12:09:00.985762 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:00.985714 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" podStartSLOduration=1.2817937609999999 podStartE2EDuration="3.985699101s" totalImagesPullingTime="2.70390534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:08:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:09:00.985184943 +0000 UTC m=+262.313533592" watchObservedRunningTime="2026-06-08 12:09:00.985699101 +0000 UTC m=+262.314047741" Jun 08 12:09:01.164665 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.164626 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:01.259194 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.259111 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:01.344519 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.344486 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 12:09:01.348626 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.348605 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.352296 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.352130 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 08 12:09:01.352296 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.352148 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 08 12:09:01.352473 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.352444 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 08 12:09:01.353001 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.352662 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6nqff\"" Jun 08 12:09:01.353001 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.352848 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 08 12:09:01.353001 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.352901 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 08 12:09:01.353210 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.353184 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 08 12:09:01.353681 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.353416 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 08 12:09:01.353681 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.353437 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 08 12:09:01.353681 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.353455 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 08 12:09:01.353681 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.353473 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3qqmm07svbj5b\"" Jun 08 12:09:01.353681 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.353574 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 08 12:09:01.353991 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.353780 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 08 12:09:01.353991 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.353947 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 08 12:09:01.360983 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.360958 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 08 12:09:01.364710 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.364691 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 08 12:09:01.366059 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.366023 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:01.377153 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.377129 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 12:09:01.442576 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.442554 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.442633 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.442610 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.442665 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.442644 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.442697 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.442674 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.442741 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.442719 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.442791 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.442762 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.442850 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.442835 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.442885 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.442866 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.442914 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.442892 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.442959 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.442919 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.442990 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.442963 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.443026 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.442992 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-config\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.443026 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.443012 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-config-out\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.443155 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.443043 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-web-config\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.443155 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.443062 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.443155 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.443078 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.443155 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.443129 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.443329 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.443160 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.443329 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.443183 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmfzq\" (UniqueName: \"kubernetes.io/projected/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-kube-api-access-hmfzq\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.443329 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.443262 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.459571 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.459550 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:01.544430 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.544365 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.544430 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.544420 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.544608 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.544445 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.544608 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.544470 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.544608 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.544493 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.544608 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.544518 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.544608 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.544552 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.544608 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.544579 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.544608 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.544607 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.544987 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.544633 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.544987 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.544661 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.544987 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.544687 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-config\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.544987 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.544708 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-config-out\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.544987 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.544741 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-web-config\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.544987 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.544748 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.544987 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.544768 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.544987 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.544792 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.544987 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.544825 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.544987 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.544850 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.544987 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.544877 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmfzq\" (UniqueName: \"kubernetes.io/projected/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-kube-api-access-hmfzq\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.544987 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.544936 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.545557 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.545082 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.545557 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.545158 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.545943 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.545693 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.545943 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.545697 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.546149 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.546124 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.546243 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.546220 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.547902 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.547875 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.549450 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.548892 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.549696 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.549491 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.549696 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.549547 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.549696 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.549626 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.550014 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.549991 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.550102 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.550028 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-config\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.550716 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.550695 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-web-config\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.550805 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.550773 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-config-out\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.550921 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.550902 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.550975 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.550961 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.551690 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.551673 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.556203 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.556185 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmfzq\" (UniqueName: \"kubernetes.io/projected/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-kube-api-access-hmfzq\") pod \"prometheus-k8s-0\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.661618 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.661581 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:01.802408 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.802382 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 12:09:01.804573 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:09:01.804547 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ccf84af_f826_4e1e_a73e_ca60f62d1af8.slice/crio-202ae37decb46e0a7787917b40c37ca1726419a841756820e8935b5eb3a84770 WatchSource:0}: Error finding container 202ae37decb46e0a7787917b40c37ca1726419a841756820e8935b5eb3a84770: Status 404 returned error can't find the container with id 202ae37decb46e0a7787917b40c37ca1726419a841756820e8935b5eb3a84770 Jun 08 12:09:01.972380 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.972347 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" event={"ID":"e97d57fe-d882-4489-9bc2-5a1fd534dad8","Type":"ContainerStarted","Data":"d98c2054bae7be63350c7616d9ca216aae6b44261b6ab16be417c623e170a767"} Jun 08 12:09:01.973954 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.973923 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ccf84af-f826-4e1e-a73e-ca60f62d1af8","Type":"ContainerStarted","Data":"202ae37decb46e0a7787917b40c37ca1726419a841756820e8935b5eb3a84770"} Jun 08 12:09:01.988370 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:01.988154 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" podStartSLOduration=1.511743243 podStartE2EDuration="2.988138388s" totalImagesPullingTime="1.476395145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:08:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:09:01.98760847 +0000 UTC m=+263.315957119" watchObservedRunningTime="2026-06-08 12:09:01.988138388 +0000 UTC m=+263.316487036" Jun 08 12:09:02.141929 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:02.141903 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:02.198110 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:02.198082 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:03.982409 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:03.982375 2565 generic.go:356] "Generic (PLEG): container finished" podID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerID="cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e" exitCode=0 Jun 08 12:09:03.982795 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:03.982454 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ccf84af-f826-4e1e-a73e-ca60f62d1af8","Type":"ContainerDied","Data":"cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e"} Jun 08 12:09:03.984569 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:03.984549 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" event={"ID":"8debbfba-a053-4587-8a8b-6524cb45bd35","Type":"ContainerStarted","Data":"0eced39033f85d9de19afc4af4f07be0dc2e6f29ad4e06a5b7946f87d6727825"} Jun 08 12:09:03.984634 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:03.984589 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" event={"ID":"8debbfba-a053-4587-8a8b-6524cb45bd35","Type":"ContainerStarted","Data":"d8ec8337a303b2f41407c03516ede1513615623d10445cbd2a4fe9c58dde7140"} Jun 08 12:09:03.984634 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:03.984607 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" event={"ID":"8debbfba-a053-4587-8a8b-6524cb45bd35","Type":"ContainerStarted","Data":"1df0fb09bbf7464c2a54262de10ce866cd99c39ca2f520f3b037bf4b765b097d"} Jun 08 12:09:04.027399 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:04.027353 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5689b5c5df-r89mj" podStartSLOduration=1.408264127 podStartE2EDuration="4.027340277s" totalImagesPullingTime="2.61907615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:09:04.026377322 +0000 UTC m=+265.354725971" watchObservedRunningTime="2026-06-08 12:09:04.027340277 +0000 UTC m=+265.355688925" Jun 08 12:09:05.407909 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.407862 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" podUID="0311d851-b401-448c-a313-00c2aacc2025" containerName="registry" containerID="cri-o://c76a875a311c9ef21573e08e045d0061659651ce4723fc64b961ec69cc30092b" gracePeriod=30 Jun 08 12:09:05.657997 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.657941 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:09:05.780118 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.780084 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0311d851-b401-448c-a313-00c2aacc2025-trusted-ca\") pod \"0311d851-b401-448c-a313-00c2aacc2025\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " Jun 08 12:09:05.780118 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.780120 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkp27\" (UniqueName: \"kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-kube-api-access-rkp27\") pod \"0311d851-b401-448c-a313-00c2aacc2025\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " Jun 08 12:09:05.780349 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.780144 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0311d851-b401-448c-a313-00c2aacc2025-registry-certificates\") pod \"0311d851-b401-448c-a313-00c2aacc2025\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " Jun 08 12:09:05.780349 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.780175 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0311d851-b401-448c-a313-00c2aacc2025-image-registry-private-configuration\") pod \"0311d851-b401-448c-a313-00c2aacc2025\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " Jun 08 12:09:05.780349 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.780201 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-registry-tls\") pod \"0311d851-b401-448c-a313-00c2aacc2025\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " Jun 08 12:09:05.780349 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.780265 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-bound-sa-token\") pod \"0311d851-b401-448c-a313-00c2aacc2025\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " Jun 08 12:09:05.780349 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.780324 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0311d851-b401-448c-a313-00c2aacc2025-ca-trust-extracted\") pod \"0311d851-b401-448c-a313-00c2aacc2025\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " Jun 08 12:09:05.780588 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.780369 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0311d851-b401-448c-a313-00c2aacc2025-installation-pull-secrets\") pod \"0311d851-b401-448c-a313-00c2aacc2025\" (UID: \"0311d851-b401-448c-a313-00c2aacc2025\") " Jun 08 12:09:05.780588 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.780555 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0311d851-b401-448c-a313-00c2aacc2025-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0311d851-b401-448c-a313-00c2aacc2025" (UID: "0311d851-b401-448c-a313-00c2aacc2025"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:09:05.780588 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.780566 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0311d851-b401-448c-a313-00c2aacc2025-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0311d851-b401-448c-a313-00c2aacc2025" (UID: "0311d851-b401-448c-a313-00c2aacc2025"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:09:05.780721 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.780685 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0311d851-b401-448c-a313-00c2aacc2025-trusted-ca\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:09:05.781021 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.780706 2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0311d851-b401-448c-a313-00c2aacc2025-registry-certificates\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:09:05.783223 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.783111 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0311d851-b401-448c-a313-00c2aacc2025-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0311d851-b401-448c-a313-00c2aacc2025" (UID: "0311d851-b401-448c-a313-00c2aacc2025"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:09:05.783223 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.783209 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0311d851-b401-448c-a313-00c2aacc2025" (UID: "0311d851-b401-448c-a313-00c2aacc2025"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:09:05.783393 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.783240 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-kube-api-access-rkp27" (OuterVolumeSpecName: "kube-api-access-rkp27") pod "0311d851-b401-448c-a313-00c2aacc2025" (UID: "0311d851-b401-448c-a313-00c2aacc2025"). InnerVolumeSpecName "kube-api-access-rkp27". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:09:05.783393 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.783352 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0311d851-b401-448c-a313-00c2aacc2025-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0311d851-b401-448c-a313-00c2aacc2025" (UID: "0311d851-b401-448c-a313-00c2aacc2025"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:09:05.783393 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.783378 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0311d851-b401-448c-a313-00c2aacc2025" (UID: "0311d851-b401-448c-a313-00c2aacc2025"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:09:05.791136 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.791110 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0311d851-b401-448c-a313-00c2aacc2025-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0311d851-b401-448c-a313-00c2aacc2025" (UID: "0311d851-b401-448c-a313-00c2aacc2025"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:09:05.882211 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.882180 2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0311d851-b401-448c-a313-00c2aacc2025-installation-pull-secrets\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:09:05.882211 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.882207 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkp27\" (UniqueName: \"kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-kube-api-access-rkp27\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:09:05.882211 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.882216 2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0311d851-b401-448c-a313-00c2aacc2025-image-registry-private-configuration\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:09:05.882462 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.882227 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-registry-tls\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:09:05.882462 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.882235 2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0311d851-b401-448c-a313-00c2aacc2025-bound-sa-token\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:09:05.882462 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.882243 2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0311d851-b401-448c-a313-00c2aacc2025-ca-trust-extracted\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:09:05.993089 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.993016 2565 generic.go:356] "Generic (PLEG): container finished" podID="0311d851-b401-448c-a313-00c2aacc2025" containerID="c76a875a311c9ef21573e08e045d0061659651ce4723fc64b961ec69cc30092b" exitCode=0 Jun 08 12:09:05.993089 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.993058 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" Jun 08 12:09:05.993251 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.993090 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" event={"ID":"0311d851-b401-448c-a313-00c2aacc2025","Type":"ContainerDied","Data":"c76a875a311c9ef21573e08e045d0061659651ce4723fc64b961ec69cc30092b"} Jun 08 12:09:05.993251 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.993139 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ccb6b87c4-q7xlf" event={"ID":"0311d851-b401-448c-a313-00c2aacc2025","Type":"ContainerDied","Data":"527f57f10cf7fcd5526da90c0cab27045bda53349d6628afdc9a69c8f2e4d81e"} Jun 08 12:09:05.993251 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:05.993159 2565 scope.go:117] "RemoveContainer" containerID="c76a875a311c9ef21573e08e045d0061659651ce4723fc64b961ec69cc30092b" Jun 08 12:09:06.014873 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:06.014844 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7ccb6b87c4-q7xlf"] Jun 08 12:09:06.019067 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:06.019042 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7ccb6b87c4-q7xlf"] Jun 08 12:09:06.980403 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:06.980377 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5b4dd9c845-hj9p5" Jun 08 12:09:06.985276 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:06.985181 2565 scope.go:117] "RemoveContainer" containerID="c76a875a311c9ef21573e08e045d0061659651ce4723fc64b961ec69cc30092b" Jun 08 12:09:06.986178 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:09:06.986079 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c76a875a311c9ef21573e08e045d0061659651ce4723fc64b961ec69cc30092b\": container with ID starting with c76a875a311c9ef21573e08e045d0061659651ce4723fc64b961ec69cc30092b not found: ID does not exist" containerID="c76a875a311c9ef21573e08e045d0061659651ce4723fc64b961ec69cc30092b" Jun 08 12:09:06.986178 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:06.986119 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c76a875a311c9ef21573e08e045d0061659651ce4723fc64b961ec69cc30092b"} err="failed to get container status \"c76a875a311c9ef21573e08e045d0061659651ce4723fc64b961ec69cc30092b\": rpc error: code = NotFound desc = could not find container \"c76a875a311c9ef21573e08e045d0061659651ce4723fc64b961ec69cc30092b\": container with ID starting with c76a875a311c9ef21573e08e045d0061659651ce4723fc64b961ec69cc30092b not found: ID does not exist" Jun 08 12:09:07.124194 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:07.124167 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0311d851-b401-448c-a313-00c2aacc2025" path="/var/lib/kubelet/pods/0311d851-b401-448c-a313-00c2aacc2025/volumes" Jun 08 12:09:08.003382 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:08.003346 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ccf84af-f826-4e1e-a73e-ca60f62d1af8","Type":"ContainerStarted","Data":"cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904"} Jun 08 12:09:08.003721 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:08.003420 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ccf84af-f826-4e1e-a73e-ca60f62d1af8","Type":"ContainerStarted","Data":"8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7"} Jun 08 12:09:08.003721 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:08.003460 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ccf84af-f826-4e1e-a73e-ca60f62d1af8","Type":"ContainerStarted","Data":"ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a"} Jun 08 12:09:08.003721 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:08.003497 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ccf84af-f826-4e1e-a73e-ca60f62d1af8","Type":"ContainerStarted","Data":"fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93"} Jun 08 12:09:08.003721 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:08.003533 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ccf84af-f826-4e1e-a73e-ca60f62d1af8","Type":"ContainerStarted","Data":"7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c"} Jun 08 12:09:08.003721 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:08.003566 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ccf84af-f826-4e1e-a73e-ca60f62d1af8","Type":"ContainerStarted","Data":"2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1"} Jun 08 12:09:08.033706 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:08.033662 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.8685386299999998 podStartE2EDuration="7.033648082s" totalImagesPullingTime="4.142789163s" totalInitContainerRuntime="22.320289ms" isStatefulPod=false podCreationTimestamp="2026-06-08 12:09:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:09:08.032107786 +0000 UTC m=+269.360456486" watchObservedRunningTime="2026-06-08 12:09:08.033648082 +0000 UTC m=+269.361996776" Jun 08 12:09:11.662132 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:11.662095 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:09:15.551337 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:15.551290 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:15.649430 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:15.649406 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:17.172209 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:17.172179 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:17.261666 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:17.261639 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:19.632672 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:09:19.632637 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kcc8l" podUID="e7ae58fd-3b0e-48b3-91bb-e9ee538e8895" Jun 08 12:09:19.734234 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:19.734206 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:19.786889 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:19.786866 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:19.830150 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:19.830129 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" Jun 08 12:09:19.830238 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:19.830185 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" Jun 08 12:09:20.045485 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:20.045420 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kcc8l" Jun 08 12:09:21.049838 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:21.049811 2565 generic.go:356] "Generic (PLEG): container finished" podID="d5ec04a0-580b-44a0-a883-051acfdd1eb6" containerID="c544b0bd1f335af6031b08781266fa7227242bef6e3c1d8cce56bcce66187e90" exitCode=0 Jun 08 12:09:21.050123 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:21.049849 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-hqv87" event={"ID":"d5ec04a0-580b-44a0-a883-051acfdd1eb6","Type":"ContainerDied","Data":"c544b0bd1f335af6031b08781266fa7227242bef6e3c1d8cce56bcce66187e90"} Jun 08 12:09:21.050123 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:21.050100 2565 scope.go:117] "RemoveContainer" containerID="c544b0bd1f335af6031b08781266fa7227242bef6e3c1d8cce56bcce66187e90" Jun 08 12:09:22.054809 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:22.054781 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-hqv87" event={"ID":"d5ec04a0-580b-44a0-a883-051acfdd1eb6","Type":"ContainerStarted","Data":"5e58ff122ec4e7450cb29b425f99d0768bdf528a9b2a3bfc25b8d03a6ae0c876"} Jun 08 12:09:23.006948 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:23.006920 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls\") pod \"dns-default-kcc8l\" (UID: \"e7ae58fd-3b0e-48b3-91bb-e9ee538e8895\") " pod="openshift-dns/dns-default-kcc8l" Jun 08 12:09:23.009075 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:23.009052 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7ae58fd-3b0e-48b3-91bb-e9ee538e8895-metrics-tls\") pod \"dns-default-kcc8l\" (UID: \"e7ae58fd-3b0e-48b3-91bb-e9ee538e8895\") " pod="openshift-dns/dns-default-kcc8l" Jun 08 12:09:23.048823 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:23.048766 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dcszh\"" Jun 08 12:09:23.057175 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:23.057149 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kcc8l" Jun 08 12:09:23.059865 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:23.059845 2565 generic.go:356] "Generic (PLEG): container finished" podID="4aa9c617-6c96-4e5f-94cb-962925e87635" containerID="0526e077af861957fc0885510770e005d0ca086768a347ee965bffe301aa6b85" exitCode=255 Jun 08 12:09:23.059947 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:23.059918 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-769b77c66-nx8rv" event={"ID":"4aa9c617-6c96-4e5f-94cb-962925e87635","Type":"ContainerDied","Data":"0526e077af861957fc0885510770e005d0ca086768a347ee965bffe301aa6b85"} Jun 08 12:09:23.059985 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:23.059957 2565 scope.go:117] "RemoveContainer" containerID="89b326b48f28391046758f4897e120261b4badc7f7780e627a536e90bbd22618" Jun 08 12:09:23.077084 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:23.077066 2565 scope.go:117] "RemoveContainer" containerID="0526e077af861957fc0885510770e005d0ca086768a347ee965bffe301aa6b85" Jun 08 12:09:23.077301 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:09:23.077276 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-769b77c66-nx8rv_open-cluster-management-agent-addon(4aa9c617-6c96-4e5f-94cb-962925e87635)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-769b77c66-nx8rv" podUID="4aa9c617-6c96-4e5f-94cb-962925e87635" Jun 08 12:09:23.181008 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:23.180973 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kcc8l"] Jun 08 12:09:23.183920 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:09:23.183895 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7ae58fd_3b0e_48b3_91bb_e9ee538e8895.slice/crio-888bbb64231a47b911f7bba5c6c59f8645864cac523a79675668cd3bfbcea5e1 WatchSource:0}: Error finding container 888bbb64231a47b911f7bba5c6c59f8645864cac523a79675668cd3bfbcea5e1: Status 404 returned error can't find the container with id 888bbb64231a47b911f7bba5c6c59f8645864cac523a79675668cd3bfbcea5e1 Jun 08 12:09:24.065458 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:24.065420 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kcc8l" event={"ID":"e7ae58fd-3b0e-48b3-91bb-e9ee538e8895","Type":"ContainerStarted","Data":"888bbb64231a47b911f7bba5c6c59f8645864cac523a79675668cd3bfbcea5e1"} Jun 08 12:09:24.126763 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:24.126737 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w4wf6_eee4acbf-8c90-49e2-8573-d2386ae891cc/dns-node-resolver/0.log" Jun 08 12:09:25.072543 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:25.072515 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kcc8l" event={"ID":"e7ae58fd-3b0e-48b3-91bb-e9ee538e8895","Type":"ContainerStarted","Data":"87e11b7763fc6dbc9c99556d0c6a81b3dfb2d8d911c52211e474efba59fc4985"} Jun 08 12:09:25.072925 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:25.072569 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kcc8l" event={"ID":"e7ae58fd-3b0e-48b3-91bb-e9ee538e8895","Type":"ContainerStarted","Data":"75aabc181caf0cf74e3043b0637c601df34e616654e4143762c64c515eb2cbb6"} Jun 08 12:09:25.072925 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:25.072597 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kcc8l" Jun 08 12:09:25.074128 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:25.074109 2565 generic.go:356] "Generic (PLEG): container finished" podID="5ee92154-dbe6-47a2-b9ee-cdfc45a93785" containerID="e2442ce386319db80dae6500fcd083f5178f4b1c087dd0f2c2c24e0f0fb8be7b" exitCode=1 Jun 08 12:09:25.074223 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:25.074167 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" event={"ID":"5ee92154-dbe6-47a2-b9ee-cdfc45a93785","Type":"ContainerDied","Data":"e2442ce386319db80dae6500fcd083f5178f4b1c087dd0f2c2c24e0f0fb8be7b"} Jun 08 12:09:25.074223 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:25.074205 2565 scope.go:117] "RemoveContainer" containerID="2d79feab8173dc585a6dcad6ac08ce9b19ceafe64d4a5f5b64c8dc035ed68850" Jun 08 12:09:25.074526 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:25.074512 2565 scope.go:117] "RemoveContainer" containerID="e2442ce386319db80dae6500fcd083f5178f4b1c087dd0f2c2c24e0f0fb8be7b" Jun 08 12:09:25.074676 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:09:25.074653 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7669f58669-872wd_open-cluster-management-agent-addon(5ee92154-dbe6-47a2-b9ee-cdfc45a93785)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" podUID="5ee92154-dbe6-47a2-b9ee-cdfc45a93785" Jun 08 12:09:25.090723 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:25.090684 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kcc8l" podStartSLOduration=250.670703834 podStartE2EDuration="4m12.090673427s" totalImagesPullingTime="1.419969593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:05:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:09:25.089057219 +0000 UTC m=+286.417405867" watchObservedRunningTime="2026-06-08 12:09:25.090673427 +0000 UTC m=+286.419022076" Jun 08 12:09:25.126258 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:25.126240 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xz292_af53aaaa-69bd-4d1e-9fb7-6eaf4b58fb13/node-ca/0.log" Jun 08 12:09:25.662134 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:25.662112 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" Jun 08 12:09:25.927568 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:25.927511 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t4z7r_3f729f0e-de15-48e8-ae58-d85687aa7a72/serve-healthcheck-canary/0.log" Jun 08 12:09:26.080121 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:26.080096 2565 scope.go:117] "RemoveContainer" containerID="e2442ce386319db80dae6500fcd083f5178f4b1c087dd0f2c2c24e0f0fb8be7b" Jun 08 12:09:26.080547 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:09:26.080245 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7669f58669-872wd_open-cluster-management-agent-addon(5ee92154-dbe6-47a2-b9ee-cdfc45a93785)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" podUID="5ee92154-dbe6-47a2-b9ee-cdfc45a93785" Jun 08 12:09:26.361985 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:26.361960 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:26.462224 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:26.462199 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:27.919928 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:27.919896 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-769b77c66-nx8rv" Jun 08 12:09:27.920276 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:27.920223 2565 scope.go:117] "RemoveContainer" containerID="0526e077af861957fc0885510770e005d0ca086768a347ee965bffe301aa6b85" Jun 08 12:09:27.920425 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:09:27.920404 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-769b77c66-nx8rv_open-cluster-management-agent-addon(4aa9c617-6c96-4e5f-94cb-962925e87635)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-769b77c66-nx8rv" podUID="4aa9c617-6c96-4e5f-94cb-962925e87635" Jun 08 12:09:27.930346 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:27.930323 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" Jun 08 12:09:27.930615 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:27.930603 2565 scope.go:117] "RemoveContainer" containerID="e2442ce386319db80dae6500fcd083f5178f4b1c087dd0f2c2c24e0f0fb8be7b" Jun 08 12:09:27.930735 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:09:27.930719 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7669f58669-872wd_open-cluster-management-agent-addon(5ee92154-dbe6-47a2-b9ee-cdfc45a93785)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" podUID="5ee92154-dbe6-47a2-b9ee-cdfc45a93785" Jun 08 12:09:29.735549 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:29.735511 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:35.082186 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:35.082150 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kcc8l" Jun 08 12:09:38.118744 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:38.118715 2565 scope.go:117] "RemoveContainer" containerID="e2442ce386319db80dae6500fcd083f5178f4b1c087dd0f2c2c24e0f0fb8be7b" Jun 08 12:09:38.153935 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:38.153901 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:38.255666 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:38.255639 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:38.310676 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:38.310640 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:39.072399 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:39.072374 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94jtj_c96f0d0b-bdfb-42c4-a74f-183f2cf4876f/ovn-acl-logging/0.log" Jun 08 12:09:39.073957 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:39.073940 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94jtj_c96f0d0b-bdfb-42c4-a74f-183f2cf4876f/ovn-acl-logging/0.log" Jun 08 12:09:39.078272 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:39.078255 2565 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 12:09:39.135066 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:39.134946 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" event={"ID":"5ee92154-dbe6-47a2-b9ee-cdfc45a93785","Type":"ContainerStarted","Data":"b1fd117d2dd2fc145ffa7bc0eea8cb8d3c67ccbc71453d3976496c817cddd8b6"} Jun 08 12:09:39.275956 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:39.135263 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" Jun 08 12:09:39.275956 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:39.136729 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7669f58669-872wd" Jun 08 12:09:39.275956 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:39.259711 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:39.308824 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:39.308792 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:39.834656 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:39.834620 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" Jun 08 12:09:39.838244 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:39.838220 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5cbdc5b888-98rw8" Jun 08 12:09:40.028372 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:40.028345 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:40.093200 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:40.093136 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:40.394528 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:40.394443 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:40.495854 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:40.495823 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:42.124146 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:42.124124 2565 scope.go:117] "RemoveContainer" containerID="0526e077af861957fc0885510770e005d0ca086768a347ee965bffe301aa6b85" Jun 08 12:09:43.155753 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:43.155717 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-769b77c66-nx8rv" event={"ID":"4aa9c617-6c96-4e5f-94cb-962925e87635","Type":"ContainerStarted","Data":"0ef49b173e004c4af4e7e93bbfa36e49f5ab70c4f26ecad795cc293df6562964"} Jun 08 12:09:43.606023 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:43.605992 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:43.706628 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:43.706598 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:44.267267 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:44.267238 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:44.357692 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:44.357665 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:46.146837 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:46.146804 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:46.247907 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:46.247879 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:53.244141 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:53.244109 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:53.301715 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:53.301688 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:54.753282 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:54.753252 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:09:54.855149 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:09:54.855118 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:01.137054 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:01.137007 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:01.232978 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:01.232948 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:01.662250 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:01.662221 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:01.681790 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:01.681768 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:02.260697 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:02.260674 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:03.833861 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:03.833832 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:03.934811 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:03.934783 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:05.244513 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:05.244483 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:05.372133 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:05.372107 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:08.546589 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:08.546557 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:08.608904 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:08.608878 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:08.708088 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:08.708051 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:08.767624 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:08.767601 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:11.163203 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:11.163173 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:11.263845 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:11.263817 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:18.128394 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:18.128325 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:18.191278 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:18.191254 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:19.734904 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:19.734875 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 12:10:19.735279 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:19.735148 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerName="prometheus" containerID="cri-o://2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1" gracePeriod=600 Jun 08 12:10:19.735279 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:19.735173 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerName="kube-rbac-proxy-web" containerID="cri-o://ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a" gracePeriod=600 Jun 08 12:10:19.735279 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:19.735196 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerName="config-reloader" containerID="cri-o://7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c" gracePeriod=600 Jun 08 12:10:19.735279 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:19.735201 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerName="kube-rbac-proxy-thanos" containerID="cri-o://cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904" gracePeriod=600 Jun 08 12:10:19.735279 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:19.735152 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerName="kube-rbac-proxy" containerID="cri-o://8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7" gracePeriod=600 Jun 08 12:10:19.735279 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:19.735225 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerName="thanos-sidecar" containerID="cri-o://fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93" gracePeriod=600 Jun 08 12:10:19.968398 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:19.968375 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.009698 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.009645 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-config-out\") pod \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " Jun 08 12:10:20.009698 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.009672 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-configmap-serving-certs-ca-bundle\") pod \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " Jun 08 12:10:20.009698 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.009691 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-grpc-tls\") pod \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " Jun 08 12:10:20.009958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.009707 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-trusted-ca-bundle\") pod \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " Jun 08 12:10:20.009958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.009724 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-k8s-rulefiles-1\") pod \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " Jun 08 12:10:20.009958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.009745 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-config\") pod \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " Jun 08 12:10:20.009958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.009762 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " Jun 08 12:10:20.009958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.009791 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " Jun 08 12:10:20.009958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.009845 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-web-config\") pod \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " Jun 08 12:10:20.009958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.009894 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-metrics-client-certs\") pod \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " Jun 08 12:10:20.009958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.009921 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-configmap-kubelet-serving-ca-bundle\") pod \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " Jun 08 12:10:20.009958 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.009938 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-tls-assets\") pod \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " Jun 08 12:10:20.010415 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.009968 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-k8s-rulefiles-0\") pod \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " Jun 08 12:10:20.010415 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.010021 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-prometheus-k8s-tls\") pod \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " Jun 08 12:10:20.010415 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.010061 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-k8s-db\") pod \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " Jun 08 12:10:20.010415 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.010095 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-thanos-prometheus-http-client-file\") pod \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " Jun 08 12:10:20.010415 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.010109 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "0ccf84af-f826-4e1e-a73e-ca60f62d1af8" (UID: "0ccf84af-f826-4e1e-a73e-ca60f62d1af8"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:10:20.010415 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.010127 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-k8s-rulefiles-2\") pod \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " Jun 08 12:10:20.010415 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.010136 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "0ccf84af-f826-4e1e-a73e-ca60f62d1af8" (UID: "0ccf84af-f826-4e1e-a73e-ca60f62d1af8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:10:20.010415 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.010153 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmfzq\" (UniqueName: \"kubernetes.io/projected/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-kube-api-access-hmfzq\") pod \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " Jun 08 12:10:20.010415 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.010152 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "0ccf84af-f826-4e1e-a73e-ca60f62d1af8" (UID: "0ccf84af-f826-4e1e-a73e-ca60f62d1af8"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:10:20.010840 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.010598 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "0ccf84af-f826-4e1e-a73e-ca60f62d1af8" (UID: "0ccf84af-f826-4e1e-a73e-ca60f62d1af8"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:10:20.011358 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.011043 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-kube-rbac-proxy\") pod \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " Jun 08 12:10:20.011358 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.011094 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-configmap-metrics-client-ca\") pod \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\" (UID: \"0ccf84af-f826-4e1e-a73e-ca60f62d1af8\") " Jun 08 12:10:20.011505 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.011389 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:10:20.011505 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.011408 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:10:20.011505 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.011422 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:10:20.011505 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.011436 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:10:20.011803 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.011777 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "0ccf84af-f826-4e1e-a73e-ca60f62d1af8" (UID: "0ccf84af-f826-4e1e-a73e-ca60f62d1af8"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:10:20.011947 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.011921 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "0ccf84af-f826-4e1e-a73e-ca60f62d1af8" (UID: "0ccf84af-f826-4e1e-a73e-ca60f62d1af8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:10:20.012622 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.012585 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "0ccf84af-f826-4e1e-a73e-ca60f62d1af8" (UID: "0ccf84af-f826-4e1e-a73e-ca60f62d1af8"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:10:20.012851 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.012798 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "0ccf84af-f826-4e1e-a73e-ca60f62d1af8" (UID: "0ccf84af-f826-4e1e-a73e-ca60f62d1af8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:10:20.013000 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.012977 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-config" (OuterVolumeSpecName: "config") pod "0ccf84af-f826-4e1e-a73e-ca60f62d1af8" (UID: "0ccf84af-f826-4e1e-a73e-ca60f62d1af8"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:10:20.013084 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.013065 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "0ccf84af-f826-4e1e-a73e-ca60f62d1af8" (UID: "0ccf84af-f826-4e1e-a73e-ca60f62d1af8"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:10:20.014122 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.014057 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "0ccf84af-f826-4e1e-a73e-ca60f62d1af8" (UID: "0ccf84af-f826-4e1e-a73e-ca60f62d1af8"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:10:20.014328 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.014291 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "0ccf84af-f826-4e1e-a73e-ca60f62d1af8" (UID: "0ccf84af-f826-4e1e-a73e-ca60f62d1af8"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:10:20.014413 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.014343 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-kube-api-access-hmfzq" (OuterVolumeSpecName: "kube-api-access-hmfzq") pod "0ccf84af-f826-4e1e-a73e-ca60f62d1af8" (UID: "0ccf84af-f826-4e1e-a73e-ca60f62d1af8"). InnerVolumeSpecName "kube-api-access-hmfzq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:10:20.014474 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.014456 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "0ccf84af-f826-4e1e-a73e-ca60f62d1af8" (UID: "0ccf84af-f826-4e1e-a73e-ca60f62d1af8"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:10:20.014523 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.014472 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "0ccf84af-f826-4e1e-a73e-ca60f62d1af8" (UID: "0ccf84af-f826-4e1e-a73e-ca60f62d1af8"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:10:20.014686 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.014670 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-config-out" (OuterVolumeSpecName: "config-out") pod "0ccf84af-f826-4e1e-a73e-ca60f62d1af8" (UID: "0ccf84af-f826-4e1e-a73e-ca60f62d1af8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:10:20.014737 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.014679 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "0ccf84af-f826-4e1e-a73e-ca60f62d1af8" (UID: "0ccf84af-f826-4e1e-a73e-ca60f62d1af8"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:10:20.014915 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.014894 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0ccf84af-f826-4e1e-a73e-ca60f62d1af8" (UID: "0ccf84af-f826-4e1e-a73e-ca60f62d1af8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:10:20.015608 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.015587 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "0ccf84af-f826-4e1e-a73e-ca60f62d1af8" (UID: "0ccf84af-f826-4e1e-a73e-ca60f62d1af8"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:10:20.023326 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.023281 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-web-config" (OuterVolumeSpecName: "web-config") pod "0ccf84af-f826-4e1e-a73e-ca60f62d1af8" (UID: "0ccf84af-f826-4e1e-a73e-ca60f62d1af8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:10:20.111836 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.111809 2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-config-out\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:10:20.111836 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.111833 2565 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-grpc-tls\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:10:20.111836 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.111841 2565 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-config\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:10:20.112032 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.111850 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:10:20.112032 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.111858 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:10:20.112032 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.111867 2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-web-config\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:10:20.112032 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.111875 2565 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-metrics-client-certs\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:10:20.112032 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.111882 2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-tls-assets\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:10:20.112032 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.111891 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:10:20.112032 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.111899 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:10:20.112032 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.111907 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-k8s-db\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:10:20.112032 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.111915 2565 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:10:20.112032 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.111923 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:10:20.112032 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.111930 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmfzq\" (UniqueName: \"kubernetes.io/projected/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-kube-api-access-hmfzq\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:10:20.112032 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.111940 2565 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-secret-kube-rbac-proxy\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:10:20.112032 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.111949 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ccf84af-f826-4e1e-a73e-ca60f62d1af8-configmap-metrics-client-ca\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:10:20.312430 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.312401 2565 generic.go:356] "Generic (PLEG): container finished" podID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerID="cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904" exitCode=0 Jun 08 12:10:20.312430 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.312424 2565 generic.go:356] "Generic (PLEG): container finished" podID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerID="8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7" exitCode=0 Jun 08 12:10:20.312430 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.312430 2565 generic.go:356] "Generic (PLEG): container finished" podID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerID="ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a" exitCode=0 Jun 08 12:10:20.312430 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.312436 2565 generic.go:356] "Generic (PLEG): container finished" podID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerID="fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93" exitCode=0 Jun 08 12:10:20.312661 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.312441 2565 generic.go:356] "Generic (PLEG): container finished" podID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerID="7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c" exitCode=0 Jun 08 12:10:20.312661 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.312446 2565 generic.go:356] "Generic (PLEG): container finished" podID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerID="2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1" exitCode=0 Jun 08 12:10:20.312661 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.312472 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.312661 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.312484 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ccf84af-f826-4e1e-a73e-ca60f62d1af8","Type":"ContainerDied","Data":"cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904"} Jun 08 12:10:20.312661 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.312544 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ccf84af-f826-4e1e-a73e-ca60f62d1af8","Type":"ContainerDied","Data":"8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7"} Jun 08 12:10:20.312661 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.312572 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ccf84af-f826-4e1e-a73e-ca60f62d1af8","Type":"ContainerDied","Data":"ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a"} Jun 08 12:10:20.312661 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.312598 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ccf84af-f826-4e1e-a73e-ca60f62d1af8","Type":"ContainerDied","Data":"fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93"} Jun 08 12:10:20.312661 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.312613 2565 scope.go:117] "RemoveContainer" containerID="cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904" Jun 08 12:10:20.312661 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.312621 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ccf84af-f826-4e1e-a73e-ca60f62d1af8","Type":"ContainerDied","Data":"7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c"} Jun 08 12:10:20.312661 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.312645 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ccf84af-f826-4e1e-a73e-ca60f62d1af8","Type":"ContainerDied","Data":"2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1"} Jun 08 12:10:20.313010 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.312670 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ccf84af-f826-4e1e-a73e-ca60f62d1af8","Type":"ContainerDied","Data":"202ae37decb46e0a7787917b40c37ca1726419a841756820e8935b5eb3a84770"} Jun 08 12:10:20.320055 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.320038 2565 scope.go:117] "RemoveContainer" containerID="8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7" Jun 08 12:10:20.326977 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.326962 2565 scope.go:117] "RemoveContainer" containerID="ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a" Jun 08 12:10:20.333132 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.333114 2565 scope.go:117] "RemoveContainer" containerID="fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93" Jun 08 12:10:20.336212 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.336191 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 12:10:20.340208 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.340122 2565 scope.go:117] "RemoveContainer" containerID="7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c" Jun 08 12:10:20.342001 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.341985 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 12:10:20.346638 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.346617 2565 scope.go:117] "RemoveContainer" containerID="2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1" Jun 08 12:10:20.353150 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.353133 2565 scope.go:117] "RemoveContainer" containerID="cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e" Jun 08 12:10:20.359408 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.359393 2565 scope.go:117] "RemoveContainer" containerID="cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904" Jun 08 12:10:20.359647 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:10:20.359629 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904\": container with ID starting with cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904 not found: ID does not exist" containerID="cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904" Jun 08 12:10:20.359712 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.359658 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904"} err="failed to get container status \"cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904\": rpc error: code = NotFound desc = could not find container \"cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904\": container with ID starting with cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904 not found: ID does not exist" Jun 08 12:10:20.359712 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.359679 2565 scope.go:117] "RemoveContainer" containerID="8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7" Jun 08 12:10:20.359914 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:10:20.359897 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7\": container with ID starting with 8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7 not found: ID does not exist" containerID="8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7" Jun 08 12:10:20.359951 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.359919 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7"} err="failed to get container status \"8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7\": rpc error: code = NotFound desc = could not find container \"8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7\": container with ID starting with 8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7 not found: ID does not exist" Jun 08 12:10:20.359951 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.359934 2565 scope.go:117] "RemoveContainer" containerID="ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a" Jun 08 12:10:20.360145 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:10:20.360127 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a\": container with ID starting with ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a not found: ID does not exist" containerID="ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a" Jun 08 12:10:20.360208 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.360152 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a"} err="failed to get container status \"ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a\": rpc error: code = NotFound desc = could not find container \"ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a\": container with ID starting with ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a not found: ID does not exist" Jun 08 12:10:20.360208 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.360170 2565 scope.go:117] "RemoveContainer" containerID="fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93" Jun 08 12:10:20.360424 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:10:20.360407 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93\": container with ID starting with fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93 not found: ID does not exist" containerID="fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93" Jun 08 12:10:20.360511 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.360432 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93"} err="failed to get container status \"fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93\": rpc error: code = NotFound desc = could not find container \"fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93\": container with ID starting with fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93 not found: ID does not exist" Jun 08 12:10:20.360511 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.360452 2565 scope.go:117] "RemoveContainer" containerID="7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c" Jun 08 12:10:20.360673 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:10:20.360659 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c\": container with ID starting with 7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c not found: ID does not exist" containerID="7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c" Jun 08 12:10:20.360733 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.360679 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c"} err="failed to get container status \"7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c\": rpc error: code = NotFound desc = could not find container \"7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c\": container with ID starting with 7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c not found: ID does not exist" Jun 08 12:10:20.360733 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.360696 2565 scope.go:117] "RemoveContainer" containerID="2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1" Jun 08 12:10:20.360913 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:10:20.360896 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1\": container with ID starting with 2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1 not found: ID does not exist" containerID="2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1" Jun 08 12:10:20.360957 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.360916 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1"} err="failed to get container status \"2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1\": rpc error: code = NotFound desc = could not find container \"2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1\": container with ID starting with 2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1 not found: ID does not exist" Jun 08 12:10:20.360957 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.360930 2565 scope.go:117] "RemoveContainer" containerID="cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e" Jun 08 12:10:20.361204 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:10:20.361186 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e\": container with ID starting with cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e not found: ID does not exist" containerID="cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e" Jun 08 12:10:20.361275 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.361206 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e"} err="failed to get container status \"cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e\": rpc error: code = NotFound desc = could not find container \"cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e\": container with ID starting with cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e not found: ID does not exist" Jun 08 12:10:20.361275 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.361220 2565 scope.go:117] "RemoveContainer" containerID="cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904" Jun 08 12:10:20.361557 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.361533 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904"} err="failed to get container status \"cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904\": rpc error: code = NotFound desc = could not find container \"cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904\": container with ID starting with cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904 not found: ID does not exist" Jun 08 12:10:20.361610 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.361558 2565 scope.go:117] "RemoveContainer" containerID="8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7" Jun 08 12:10:20.361762 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.361743 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7"} err="failed to get container status \"8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7\": rpc error: code = NotFound desc = could not find container \"8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7\": container with ID starting with 8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7 not found: ID does not exist" Jun 08 12:10:20.361834 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.361764 2565 scope.go:117] "RemoveContainer" containerID="ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a" Jun 08 12:10:20.361948 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.361931 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a"} err="failed to get container status \"ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a\": rpc error: code = NotFound desc = could not find container \"ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a\": container with ID starting with ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a not found: ID does not exist" Jun 08 12:10:20.362005 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.361950 2565 scope.go:117] "RemoveContainer" containerID="fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93" Jun 08 12:10:20.362208 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.362192 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93"} err="failed to get container status \"fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93\": rpc error: code = NotFound desc = could not find container \"fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93\": container with ID starting with fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93 not found: ID does not exist" Jun 08 12:10:20.362259 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.362215 2565 scope.go:117] "RemoveContainer" containerID="7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c" Jun 08 12:10:20.362465 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.362447 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c"} err="failed to get container status \"7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c\": rpc error: code = NotFound desc = could not find container \"7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c\": container with ID starting with 7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c not found: ID does not exist" Jun 08 12:10:20.362540 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.362467 2565 scope.go:117] "RemoveContainer" containerID="2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1" Jun 08 12:10:20.362715 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.362697 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1"} err="failed to get container status \"2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1\": rpc error: code = NotFound desc = could not find container \"2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1\": container with ID starting with 2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1 not found: ID does not exist" Jun 08 12:10:20.362766 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.362715 2565 scope.go:117] "RemoveContainer" containerID="cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e" Jun 08 12:10:20.362933 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.362915 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e"} err="failed to get container status \"cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e\": rpc error: code = NotFound desc = could not find container \"cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e\": container with ID starting with cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e not found: ID does not exist" Jun 08 12:10:20.362933 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.362931 2565 scope.go:117] "RemoveContainer" containerID="cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904" Jun 08 12:10:20.363130 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.363106 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904"} err="failed to get container status \"cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904\": rpc error: code = NotFound desc = could not find container \"cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904\": container with ID starting with cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904 not found: ID does not exist" Jun 08 12:10:20.363130 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.363128 2565 scope.go:117] "RemoveContainer" containerID="8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7" Jun 08 12:10:20.363363 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.363346 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7"} err="failed to get container status \"8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7\": rpc error: code = NotFound desc = could not find container \"8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7\": container with ID starting with 8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7 not found: ID does not exist" Jun 08 12:10:20.363363 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.363363 2565 scope.go:117] "RemoveContainer" containerID="ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a" Jun 08 12:10:20.363576 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.363561 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a"} err="failed to get container status \"ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a\": rpc error: code = NotFound desc = could not find container \"ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a\": container with ID starting with ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a not found: ID does not exist" Jun 08 12:10:20.363576 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.363576 2565 scope.go:117] "RemoveContainer" containerID="fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93" Jun 08 12:10:20.363815 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.363797 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93"} err="failed to get container status \"fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93\": rpc error: code = NotFound desc = could not find container \"fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93\": container with ID starting with fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93 not found: ID does not exist" Jun 08 12:10:20.363868 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.363817 2565 scope.go:117] "RemoveContainer" containerID="7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c" Jun 08 12:10:20.364054 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.364033 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c"} err="failed to get container status \"7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c\": rpc error: code = NotFound desc = could not find container \"7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c\": container with ID starting with 7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c not found: ID does not exist" Jun 08 12:10:20.364054 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.364053 2565 scope.go:117] "RemoveContainer" containerID="2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1" Jun 08 12:10:20.364249 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.364232 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1"} err="failed to get container status \"2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1\": rpc error: code = NotFound desc = could not find container \"2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1\": container with ID starting with 2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1 not found: ID does not exist" Jun 08 12:10:20.364297 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.364250 2565 scope.go:117] "RemoveContainer" containerID="cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e" Jun 08 12:10:20.364450 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.364435 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e"} err="failed to get container status \"cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e\": rpc error: code = NotFound desc = could not find container \"cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e\": container with ID starting with cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e not found: ID does not exist" Jun 08 12:10:20.364502 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.364450 2565 scope.go:117] "RemoveContainer" containerID="cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904" Jun 08 12:10:20.364616 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.364602 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904"} err="failed to get container status \"cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904\": rpc error: code = NotFound desc = could not find container \"cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904\": container with ID starting with cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904 not found: ID does not exist" Jun 08 12:10:20.364661 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.364617 2565 scope.go:117] "RemoveContainer" containerID="8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7" Jun 08 12:10:20.364812 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.364794 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7"} err="failed to get container status \"8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7\": rpc error: code = NotFound desc = could not find container \"8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7\": container with ID starting with 8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7 not found: ID does not exist" Jun 08 12:10:20.364878 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.364813 2565 scope.go:117] "RemoveContainer" containerID="ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a" Jun 08 12:10:20.365026 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.365002 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a"} err="failed to get container status \"ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a\": rpc error: code = NotFound desc = could not find container \"ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a\": container with ID starting with ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a not found: ID does not exist" Jun 08 12:10:20.365078 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.365026 2565 scope.go:117] "RemoveContainer" containerID="fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93" Jun 08 12:10:20.365209 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.365192 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93"} err="failed to get container status \"fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93\": rpc error: code = NotFound desc = could not find container \"fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93\": container with ID starting with fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93 not found: ID does not exist" Jun 08 12:10:20.365266 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.365210 2565 scope.go:117] "RemoveContainer" containerID="7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c" Jun 08 12:10:20.365441 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.365424 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c"} err="failed to get container status \"7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c\": rpc error: code = NotFound desc = could not find container \"7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c\": container with ID starting with 7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c not found: ID does not exist" Jun 08 12:10:20.365503 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.365443 2565 scope.go:117] "RemoveContainer" containerID="2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1" Jun 08 12:10:20.365640 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.365625 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1"} err="failed to get container status \"2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1\": rpc error: code = NotFound desc = could not find container \"2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1\": container with ID starting with 2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1 not found: ID does not exist" Jun 08 12:10:20.365681 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.365639 2565 scope.go:117] "RemoveContainer" containerID="cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e" Jun 08 12:10:20.365828 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.365813 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e"} err="failed to get container status \"cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e\": rpc error: code = NotFound desc = could not find container \"cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e\": container with ID starting with cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e not found: ID does not exist" Jun 08 12:10:20.365869 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.365828 2565 scope.go:117] "RemoveContainer" containerID="cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904" Jun 08 12:10:20.366034 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.366015 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904"} err="failed to get container status \"cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904\": rpc error: code = NotFound desc = could not find container \"cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904\": container with ID starting with cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904 not found: ID does not exist" Jun 08 12:10:20.366034 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.366033 2565 scope.go:117] "RemoveContainer" containerID="8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7" Jun 08 12:10:20.366246 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.366230 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7"} err="failed to get container status \"8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7\": rpc error: code = NotFound desc = could not find container \"8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7\": container with ID starting with 8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7 not found: ID does not exist" Jun 08 12:10:20.366246 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.366246 2565 scope.go:117] "RemoveContainer" containerID="ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a" Jun 08 12:10:20.366474 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.366458 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a"} err="failed to get container status \"ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a\": rpc error: code = NotFound desc = could not find container \"ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a\": container with ID starting with ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a not found: ID does not exist" Jun 08 12:10:20.366524 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.366474 2565 scope.go:117] "RemoveContainer" containerID="fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93" Jun 08 12:10:20.366702 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.366685 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93"} err="failed to get container status \"fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93\": rpc error: code = NotFound desc = could not find container \"fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93\": container with ID starting with fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93 not found: ID does not exist" Jun 08 12:10:20.366748 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.366703 2565 scope.go:117] "RemoveContainer" containerID="7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c" Jun 08 12:10:20.366879 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.366863 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c"} err="failed to get container status \"7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c\": rpc error: code = NotFound desc = could not find container \"7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c\": container with ID starting with 7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c not found: ID does not exist" Jun 08 12:10:20.366928 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.366879 2565 scope.go:117] "RemoveContainer" containerID="2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1" Jun 08 12:10:20.367090 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.367071 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1"} err="failed to get container status \"2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1\": rpc error: code = NotFound desc = could not find container \"2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1\": container with ID starting with 2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1 not found: ID does not exist" Jun 08 12:10:20.367090 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.367089 2565 scope.go:117] "RemoveContainer" containerID="cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e" Jun 08 12:10:20.367298 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.367282 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e"} err="failed to get container status \"cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e\": rpc error: code = NotFound desc = could not find container \"cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e\": container with ID starting with cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e not found: ID does not exist" Jun 08 12:10:20.367368 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.367299 2565 scope.go:117] "RemoveContainer" containerID="cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904" Jun 08 12:10:20.367519 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.367504 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904"} err="failed to get container status \"cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904\": rpc error: code = NotFound desc = could not find container \"cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904\": container with ID starting with cd86d6a395393f53eb6cbdeaa99f79baa932398c052b1828ad9525ca75481904 not found: ID does not exist" Jun 08 12:10:20.367556 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.367521 2565 scope.go:117] "RemoveContainer" containerID="8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7" Jun 08 12:10:20.367713 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.367698 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7"} err="failed to get container status \"8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7\": rpc error: code = NotFound desc = could not find container \"8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7\": container with ID starting with 8c6716b712a100d493c73beb1c104212be70a3a13781db0fbb2cffa9346667c7 not found: ID does not exist" Jun 08 12:10:20.367750 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.367713 2565 scope.go:117] "RemoveContainer" containerID="ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a" Jun 08 12:10:20.367859 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.367843 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a"} err="failed to get container status \"ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a\": rpc error: code = NotFound desc = could not find container \"ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a\": container with ID starting with ab87b0cc8a493d892a86388b9d56a18658242443177c9b32a3387a87248a4b1a not found: ID does not exist" Jun 08 12:10:20.367918 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.367859 2565 scope.go:117] "RemoveContainer" containerID="fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93" Jun 08 12:10:20.368052 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.368038 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93"} err="failed to get container status \"fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93\": rpc error: code = NotFound desc = could not find container \"fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93\": container with ID starting with fc5b4fd5723899cc0f62c6fcc79a06e18c2844ce9e40e93a4f50bfeb02950a93 not found: ID does not exist" Jun 08 12:10:20.368108 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.368052 2565 scope.go:117] "RemoveContainer" containerID="7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c" Jun 08 12:10:20.368230 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.368215 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c"} err="failed to get container status \"7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c\": rpc error: code = NotFound desc = could not find container \"7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c\": container with ID starting with 7a908077a9acf8320f1b00cb76c012ce0df4872f95620ca4eb45480d604bd35c not found: ID does not exist" Jun 08 12:10:20.368279 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.368230 2565 scope.go:117] "RemoveContainer" containerID="2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1" Jun 08 12:10:20.368445 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.368429 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1"} err="failed to get container status \"2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1\": rpc error: code = NotFound desc = could not find container \"2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1\": container with ID starting with 2c29bcadefaa420c4be91ab1613301a2ef95ab472f2aef9c93e356826fbf87d1 not found: ID does not exist" Jun 08 12:10:20.368445 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.368444 2565 scope.go:117] "RemoveContainer" containerID="cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e" Jun 08 12:10:20.368618 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.368603 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e"} err="failed to get container status \"cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e\": rpc error: code = NotFound desc = could not find container \"cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e\": container with ID starting with cee9c022e02e8cbc4294e31add7ed45135ee466d946ec0639ac973d6f7942e3e not found: ID does not exist" Jun 08 12:10:20.372716 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.372698 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 12:10:20.372947 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.372936 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerName="prometheus" Jun 08 12:10:20.372981 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.372949 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerName="prometheus" Jun 08 12:10:20.372981 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.372958 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0311d851-b401-448c-a313-00c2aacc2025" containerName="registry" Jun 08 12:10:20.372981 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.372963 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0311d851-b401-448c-a313-00c2aacc2025" containerName="registry" Jun 08 12:10:20.372981 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.372971 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerName="kube-rbac-proxy-web" Jun 08 12:10:20.372981 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.372976 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerName="kube-rbac-proxy-web" Jun 08 12:10:20.373140 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.372986 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerName="config-reloader" Jun 08 12:10:20.373140 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.372991 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerName="config-reloader" Jun 08 12:10:20.373140 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.372996 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerName="thanos-sidecar" Jun 08 12:10:20.373140 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.373001 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerName="thanos-sidecar" Jun 08 12:10:20.373140 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.373009 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerName="init-config-reloader" Jun 08 12:10:20.373140 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.373020 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerName="init-config-reloader" Jun 08 12:10:20.373140 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.373029 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerName="kube-rbac-proxy" Jun 08 12:10:20.373140 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.373034 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerName="kube-rbac-proxy" Jun 08 12:10:20.373140 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.373039 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerName="kube-rbac-proxy-thanos" Jun 08 12:10:20.373140 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.373043 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerName="kube-rbac-proxy-thanos" Jun 08 12:10:20.373140 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.373084 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerName="thanos-sidecar" Jun 08 12:10:20.373140 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.373092 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerName="kube-rbac-proxy" Jun 08 12:10:20.373140 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.373098 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerName="kube-rbac-proxy-web" Jun 08 12:10:20.373140 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.373103 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerName="kube-rbac-proxy-thanos" Jun 08 12:10:20.373140 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.373108 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerName="config-reloader" Jun 08 12:10:20.373140 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.373113 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" containerName="prometheus" Jun 08 12:10:20.373140 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.373118 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0311d851-b401-448c-a313-00c2aacc2025" containerName="registry" Jun 08 12:10:20.376029 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.376016 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.379181 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.378520 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 08 12:10:20.379181 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.378721 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 08 12:10:20.379181 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.378776 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3qqmm07svbj5b\"" Jun 08 12:10:20.379181 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.378940 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 08 12:10:20.379181 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.379126 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 08 12:10:20.382590 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.382040 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 08 12:10:20.382590 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.382151 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6nqff\"" Jun 08 12:10:20.382590 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.382329 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 08 12:10:20.382590 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.382400 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 08 12:10:20.382590 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.382424 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 08 12:10:20.382590 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.382434 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 08 12:10:20.382590 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.382443 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 08 12:10:20.382590 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.382482 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 08 12:10:20.383421 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.383394 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 08 12:10:20.385000 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.384982 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 08 12:10:20.387030 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.387013 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 08 12:10:20.398921 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.398898 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 12:10:20.515492 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.515469 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.515580 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.515504 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-config\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.515580 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.515522 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.515580 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.515565 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.515724 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.515593 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.515724 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.515612 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-config-out\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.515724 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.515645 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.515724 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.515667 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.515724 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.515688 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.515724 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.515710 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.515892 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.515726 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.515892 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.515743 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.515892 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.515784 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.515892 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.515808 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.515892 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.515837 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.515892 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.515866 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.515892 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.515891 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.516109 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.515954 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.516109 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.515972 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk9hw\" (UniqueName: \"kubernetes.io/projected/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-kube-api-access-zk9hw\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.516109 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.515997 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-web-config\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.616501 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.616452 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.616501 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.616481 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.616501 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.616496 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk9hw\" (UniqueName: \"kubernetes.io/projected/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-kube-api-access-zk9hw\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.616671 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.616519 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-web-config\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.616671 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.616545 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.616671 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.616568 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-config\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.616671 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.616611 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.616671 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.616638 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.616671 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.616662 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.616945 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.616689 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-config-out\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.616945 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.616715 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.616945 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.616743 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.616945 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.616769 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.616945 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.616797 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.616945 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.616824 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.616945 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.616853 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.616945 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.616879 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.616945 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.616902 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.616945 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.616928 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.617461 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.616976 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.617461 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.617185 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.617461 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.617201 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.617461 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.617233 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.617461 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.617424 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.619638 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.619614 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.620903 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.619785 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-web-config\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.620903 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.619854 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.620903 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.620191 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.620903 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.620198 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.620903 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.620660 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.620903 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.620777 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.620903 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.620825 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.621347 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.620943 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-config-out\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.621347 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.620971 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-config\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.621347 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.621322 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.621534 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.621515 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.621864 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.621848 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.622021 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.622006 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.622172 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.622156 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.624602 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.624579 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk9hw\" (UniqueName: \"kubernetes.io/projected/2bd9f54c-93f0-4af1-82f6-5b432a268dbc-kube-api-access-zk9hw\") pod \"prometheus-k8s-0\" (UID: \"2bd9f54c-93f0-4af1-82f6-5b432a268dbc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.687142 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.687119 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:20.828506 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:20.828480 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 12:10:20.830344 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:10:20.830319 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bd9f54c_93f0_4af1_82f6_5b432a268dbc.slice/crio-14a5c2052d1689086eaa9bab385488123a526bb37a356a35b78f382102286a9a WatchSource:0}: Error finding container 14a5c2052d1689086eaa9bab385488123a526bb37a356a35b78f382102286a9a: Status 404 returned error can't find the container with id 14a5c2052d1689086eaa9bab385488123a526bb37a356a35b78f382102286a9a Jun 08 12:10:21.123059 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:21.123004 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ccf84af-f826-4e1e-a73e-ca60f62d1af8" path="/var/lib/kubelet/pods/0ccf84af-f826-4e1e-a73e-ca60f62d1af8/volumes" Jun 08 12:10:21.317403 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:21.317380 2565 generic.go:356] "Generic (PLEG): container finished" podID="2bd9f54c-93f0-4af1-82f6-5b432a268dbc" containerID="66df78620bf229dd3a2ed7e3f93e25a8492a47edf3cac65e3a2b02fbd42675c2" exitCode=0 Jun 08 12:10:21.317517 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:21.317468 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bd9f54c-93f0-4af1-82f6-5b432a268dbc","Type":"ContainerDied","Data":"66df78620bf229dd3a2ed7e3f93e25a8492a47edf3cac65e3a2b02fbd42675c2"} Jun 08 12:10:21.317575 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:21.317528 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bd9f54c-93f0-4af1-82f6-5b432a268dbc","Type":"ContainerStarted","Data":"14a5c2052d1689086eaa9bab385488123a526bb37a356a35b78f382102286a9a"} Jun 08 12:10:22.325227 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:22.325198 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bd9f54c-93f0-4af1-82f6-5b432a268dbc","Type":"ContainerStarted","Data":"36eb21b848fcaeeef607878a35bfb7daa7e5ae982f0b577eabcfc9d5e040c3b8"} Jun 08 12:10:22.325577 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:22.325253 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bd9f54c-93f0-4af1-82f6-5b432a268dbc","Type":"ContainerStarted","Data":"af0c81dfa40b8f1cb49b72605053d27d0d1a4160849ebf6268aeb41bb6858ea9"} Jun 08 12:10:22.325577 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:22.325281 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bd9f54c-93f0-4af1-82f6-5b432a268dbc","Type":"ContainerStarted","Data":"e685c5191c813115e7018cc60f741f02179e0a2584dfd4fcc5a2476e3fff8a3c"} Jun 08 12:10:22.325577 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:22.325328 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bd9f54c-93f0-4af1-82f6-5b432a268dbc","Type":"ContainerStarted","Data":"65000cd52ec2c4c0c10287a4e06ea0bf1a84f026030898f132b3c0370cbd3087"} Jun 08 12:10:22.325577 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:22.325352 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bd9f54c-93f0-4af1-82f6-5b432a268dbc","Type":"ContainerStarted","Data":"19c5341483bd1f04a7622b1e3ddfac191ae41a4faa7dd70871f51f6fd4013af7"} Jun 08 12:10:22.325577 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:22.325375 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bd9f54c-93f0-4af1-82f6-5b432a268dbc","Type":"ContainerStarted","Data":"abcfbaa19874bc39301387205ce657abafad2303ae53cd93da7a44dc14ff5972"} Jun 08 12:10:22.354866 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:22.354819 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.332355872 podStartE2EDuration="2.35480622s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.450348ms" isStatefulPod=false podCreationTimestamp="2026-06-08 12:10:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:10:22.352988196 +0000 UTC m=+343.681336849" watchObservedRunningTime="2026-06-08 12:10:22.35480622 +0000 UTC m=+343.683154900" Jun 08 12:10:25.687922 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:25.687893 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:10:31.135227 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:31.135154 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:31.236327 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:31.236281 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:31.338522 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:31.338490 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:42.112401 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:42.112366 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:52.116155 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:52.116117 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:52.174069 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:52.174039 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:52.975950 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:52.975921 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:53.058116 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:53.058082 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:53.168446 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:10:53.168414 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:11:08.085747 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:11:08.085697 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:11:08.186732 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:11:08.186695 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:11:11.239784 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:11:11.239754 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:11:20.688076 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:11:20.688041 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:11:20.702346 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:11:20.702298 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:11:21.552903 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:11:21.552876 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 12:11:35.166466 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:11:35.166433 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:11:36.186028 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:11:36.185994 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:11:38.990880 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:11:38.990849 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:11:39.095990 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:11:39.095960 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:11:41.054495 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:11:41.054463 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:11:41.149605 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:11:41.149574 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:11:41.513262 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:11:41.513230 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:11:41.624851 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:11:41.624824 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:11:44.483709 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:11:44.483679 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:11:44.929619 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:11:44.929582 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:11:45.976193 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:11:45.976162 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:11:46.076806 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:11:46.076777 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:11:52.085529 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:11:52.085491 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:11:52.187596 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:11:52.187568 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:11:52.288833 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:11:52.288806 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:11:57.664601 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:11:57.664568 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:11:57.766011 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:11:57.765979 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:11:59.815199 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:11:59.815124 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:15.042830 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:15.042794 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:15.126772 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:15.126740 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:16.417785 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:16.417753 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:16.519094 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:16.519063 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:21.580213 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:21.580181 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:22.209997 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.209962 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:22.358322 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.358282 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:22.512283 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.512176 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-854df88b87-7nztq"] Jun 08 12:12:22.514616 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.514593 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-7nztq" Jun 08 12:12:22.516776 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.516754 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 08 12:12:22.516933 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.516915 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 08 12:12:22.517032 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.516921 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qzhzf\"" Jun 08 12:12:22.517032 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.517000 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 08 12:12:22.517134 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.517094 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 08 12:12:22.530707 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.530685 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f1e5fd5-f28c-44ea-a9b5-748ced270b99-webhook-cert\") pod \"opendatahub-operator-controller-manager-854df88b87-7nztq\" (UID: \"2f1e5fd5-f28c-44ea-a9b5-748ced270b99\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-7nztq" Jun 08 12:12:22.530807 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.530719 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2f1e5fd5-f28c-44ea-a9b5-748ced270b99-manifests\") pod \"opendatahub-operator-controller-manager-854df88b87-7nztq\" (UID: \"2f1e5fd5-f28c-44ea-a9b5-748ced270b99\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-7nztq" Jun 08 12:12:22.530807 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.530750 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gcfr\" (UniqueName: \"kubernetes.io/projected/2f1e5fd5-f28c-44ea-a9b5-748ced270b99-kube-api-access-2gcfr\") pod \"opendatahub-operator-controller-manager-854df88b87-7nztq\" (UID: \"2f1e5fd5-f28c-44ea-a9b5-748ced270b99\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-7nztq" Jun 08 12:12:22.530890 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.530814 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2f1e5fd5-f28c-44ea-a9b5-748ced270b99-apiservice-cert\") pod \"opendatahub-operator-controller-manager-854df88b87-7nztq\" (UID: \"2f1e5fd5-f28c-44ea-a9b5-748ced270b99\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-7nztq" Jun 08 12:12:22.530930 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.530900 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f1e5fd5-f28c-44ea-a9b5-748ced270b99-tmp\") pod \"opendatahub-operator-controller-manager-854df88b87-7nztq\" (UID: \"2f1e5fd5-f28c-44ea-a9b5-748ced270b99\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-7nztq" Jun 08 12:12:22.536728 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.536705 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-854df88b87-7nztq"] Jun 08 12:12:22.632192 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.632158 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f1e5fd5-f28c-44ea-a9b5-748ced270b99-webhook-cert\") pod \"opendatahub-operator-controller-manager-854df88b87-7nztq\" (UID: \"2f1e5fd5-f28c-44ea-a9b5-748ced270b99\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-7nztq" Jun 08 12:12:22.632612 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.632201 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2f1e5fd5-f28c-44ea-a9b5-748ced270b99-manifests\") pod \"opendatahub-operator-controller-manager-854df88b87-7nztq\" (UID: \"2f1e5fd5-f28c-44ea-a9b5-748ced270b99\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-7nztq" Jun 08 12:12:22.632612 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.632349 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gcfr\" (UniqueName: \"kubernetes.io/projected/2f1e5fd5-f28c-44ea-a9b5-748ced270b99-kube-api-access-2gcfr\") pod \"opendatahub-operator-controller-manager-854df88b87-7nztq\" (UID: \"2f1e5fd5-f28c-44ea-a9b5-748ced270b99\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-7nztq" Jun 08 12:12:22.632612 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.632394 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2f1e5fd5-f28c-44ea-a9b5-748ced270b99-apiservice-cert\") pod \"opendatahub-operator-controller-manager-854df88b87-7nztq\" (UID: \"2f1e5fd5-f28c-44ea-a9b5-748ced270b99\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-7nztq" Jun 08 12:12:22.632612 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.632461 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f1e5fd5-f28c-44ea-a9b5-748ced270b99-tmp\") pod \"opendatahub-operator-controller-manager-854df88b87-7nztq\" (UID: \"2f1e5fd5-f28c-44ea-a9b5-748ced270b99\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-7nztq" Jun 08 12:12:22.632612 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.632569 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2f1e5fd5-f28c-44ea-a9b5-748ced270b99-manifests\") pod \"opendatahub-operator-controller-manager-854df88b87-7nztq\" (UID: \"2f1e5fd5-f28c-44ea-a9b5-748ced270b99\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-7nztq" Jun 08 12:12:22.634565 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.634536 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f1e5fd5-f28c-44ea-a9b5-748ced270b99-tmp\") pod \"opendatahub-operator-controller-manager-854df88b87-7nztq\" (UID: \"2f1e5fd5-f28c-44ea-a9b5-748ced270b99\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-7nztq" Jun 08 12:12:22.634857 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.634837 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2f1e5fd5-f28c-44ea-a9b5-748ced270b99-apiservice-cert\") pod \"opendatahub-operator-controller-manager-854df88b87-7nztq\" (UID: \"2f1e5fd5-f28c-44ea-a9b5-748ced270b99\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-7nztq" Jun 08 12:12:22.635030 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.635009 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f1e5fd5-f28c-44ea-a9b5-748ced270b99-webhook-cert\") pod \"opendatahub-operator-controller-manager-854df88b87-7nztq\" (UID: \"2f1e5fd5-f28c-44ea-a9b5-748ced270b99\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-7nztq" Jun 08 12:12:22.636041 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.635992 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:22.641576 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.641552 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gcfr\" (UniqueName: \"kubernetes.io/projected/2f1e5fd5-f28c-44ea-a9b5-748ced270b99-kube-api-access-2gcfr\") pod \"opendatahub-operator-controller-manager-854df88b87-7nztq\" (UID: \"2f1e5fd5-f28c-44ea-a9b5-748ced270b99\") " pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-7nztq" Jun 08 12:12:22.746951 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.746917 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:22.825475 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.825439 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-7nztq" Jun 08 12:12:22.846962 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.846927 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:22.946121 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.946087 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:22.959074 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.959041 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-854df88b87-7nztq"] Jun 08 12:12:22.961405 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:12:22.961377 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f1e5fd5_f28c_44ea_a9b5_748ced270b99.slice/crio-5447f8415928e79b9ce8f9ab1f327dc402c6caf20dc1cf76ebbbb3cb6311ce3c WatchSource:0}: Error finding container 5447f8415928e79b9ce8f9ab1f327dc402c6caf20dc1cf76ebbbb3cb6311ce3c: Status 404 returned error can't find the container with id 5447f8415928e79b9ce8f9ab1f327dc402c6caf20dc1cf76ebbbb3cb6311ce3c Jun 08 12:12:22.963130 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:22.963115 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 12:12:23.044420 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:23.044393 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:23.767326 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:23.767276 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-7nztq" event={"ID":"2f1e5fd5-f28c-44ea-a9b5-748ced270b99","Type":"ContainerStarted","Data":"5447f8415928e79b9ce8f9ab1f327dc402c6caf20dc1cf76ebbbb3cb6311ce3c"} Jun 08 12:12:24.754948 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:24.754912 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:24.860921 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:24.860890 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:26.784734 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:26.784700 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-7nztq" event={"ID":"2f1e5fd5-f28c-44ea-a9b5-748ced270b99","Type":"ContainerStarted","Data":"b59ef9fdfa9c0f99ca83bd59ea340c25db7b9f6d65b18c7259d5e2e1718e4118"} Jun 08 12:12:27.790373 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:27.790334 2565 generic.go:356] "Generic (PLEG): container finished" podID="2f1e5fd5-f28c-44ea-a9b5-748ced270b99" containerID="b59ef9fdfa9c0f99ca83bd59ea340c25db7b9f6d65b18c7259d5e2e1718e4118" exitCode=0 Jun 08 12:12:27.790754 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:27.790440 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-7nztq" event={"ID":"2f1e5fd5-f28c-44ea-a9b5-748ced270b99","Type":"ContainerDied","Data":"b59ef9fdfa9c0f99ca83bd59ea340c25db7b9f6d65b18c7259d5e2e1718e4118"} Jun 08 12:12:28.796416 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:28.796373 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-7nztq" event={"ID":"2f1e5fd5-f28c-44ea-a9b5-748ced270b99","Type":"ContainerStarted","Data":"e4ed5865e2ecc73f4eddd74aa2896263ec1fb7a446ba72c5492e3a6d9556a16e"} Jun 08 12:12:28.796797 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:28.796547 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-7nztq" Jun 08 12:12:28.817689 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:28.817632 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-7nztq" podStartSLOduration=2.7196986560000003 podStartE2EDuration="6.817614334s" totalImagesPullingTime="3.100633214s" totalInitContainerRuntime="997.282464ms" isStatefulPod=false podCreationTimestamp="2026-06-08 12:12:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:12:28.816854103 +0000 UTC m=+470.145202785" watchObservedRunningTime="2026-06-08 12:12:28.817614334 +0000 UTC m=+470.145962983" Jun 08 12:12:36.361428 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:36.361393 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:36.463728 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:36.463697 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:39.803061 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:39.803031 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-854df88b87-7nztq" Jun 08 12:12:41.403466 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:41.403431 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:41.559987 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:41.559955 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:41.901465 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:41.901433 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:42.098927 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:42.098895 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:42.219387 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:42.219293 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:42.321408 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:42.321347 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:42.399477 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:42.399445 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:42.586087 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:42.586050 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:42.868123 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:42.868022 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:42.875196 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:42.875155 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-8rtcw"] Jun 08 12:12:42.885043 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:42.885017 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-8rtcw" Jun 08 12:12:42.887105 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:42.887080 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 08 12:12:42.887239 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:42.887113 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-h5s6q\"" Jun 08 12:12:42.893107 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:42.893076 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-8rtcw"] Jun 08 12:12:43.015493 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:43.015459 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9db910d5-0a1c-4f21-8203-8a8f1e2784f9-tls-certs\") pod \"model-serving-api-5dd488fc48-8rtcw\" (UID: \"9db910d5-0a1c-4f21-8203-8a8f1e2784f9\") " pod="opendatahub/model-serving-api-5dd488fc48-8rtcw" Jun 08 12:12:43.015673 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:43.015563 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m6kx\" (UniqueName: \"kubernetes.io/projected/9db910d5-0a1c-4f21-8203-8a8f1e2784f9-kube-api-access-2m6kx\") pod \"model-serving-api-5dd488fc48-8rtcw\" (UID: \"9db910d5-0a1c-4f21-8203-8a8f1e2784f9\") " pod="opendatahub/model-serving-api-5dd488fc48-8rtcw" Jun 08 12:12:43.068485 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:43.068452 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:43.116187 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:43.116157 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m6kx\" (UniqueName: \"kubernetes.io/projected/9db910d5-0a1c-4f21-8203-8a8f1e2784f9-kube-api-access-2m6kx\") pod \"model-serving-api-5dd488fc48-8rtcw\" (UID: \"9db910d5-0a1c-4f21-8203-8a8f1e2784f9\") " pod="opendatahub/model-serving-api-5dd488fc48-8rtcw" Jun 08 12:12:43.116360 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:43.116206 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9db910d5-0a1c-4f21-8203-8a8f1e2784f9-tls-certs\") pod \"model-serving-api-5dd488fc48-8rtcw\" (UID: \"9db910d5-0a1c-4f21-8203-8a8f1e2784f9\") " pod="opendatahub/model-serving-api-5dd488fc48-8rtcw" Jun 08 12:12:43.118774 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:43.118714 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9db910d5-0a1c-4f21-8203-8a8f1e2784f9-tls-certs\") pod \"model-serving-api-5dd488fc48-8rtcw\" (UID: \"9db910d5-0a1c-4f21-8203-8a8f1e2784f9\") " pod="opendatahub/model-serving-api-5dd488fc48-8rtcw" Jun 08 12:12:43.127800 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:43.127779 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m6kx\" (UniqueName: \"kubernetes.io/projected/9db910d5-0a1c-4f21-8203-8a8f1e2784f9-kube-api-access-2m6kx\") pod \"model-serving-api-5dd488fc48-8rtcw\" (UID: \"9db910d5-0a1c-4f21-8203-8a8f1e2784f9\") " pod="opendatahub/model-serving-api-5dd488fc48-8rtcw" Jun 08 12:12:43.195828 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:43.195795 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-8rtcw" Jun 08 12:12:43.322407 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:43.322260 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-8rtcw"] Jun 08 12:12:43.325007 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:12:43.324968 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9db910d5_0a1c_4f21_8203_8a8f1e2784f9.slice/crio-463f244280ffa06e8f65f4794089f54240f0a72373ba4ba7dc0ed6f5cede52da WatchSource:0}: Error finding container 463f244280ffa06e8f65f4794089f54240f0a72373ba4ba7dc0ed6f5cede52da: Status 404 returned error can't find the container with id 463f244280ffa06e8f65f4794089f54240f0a72373ba4ba7dc0ed6f5cede52da Jun 08 12:12:43.860103 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:43.860064 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-8rtcw" event={"ID":"9db910d5-0a1c-4f21-8203-8a8f1e2784f9","Type":"ContainerStarted","Data":"463f244280ffa06e8f65f4794089f54240f0a72373ba4ba7dc0ed6f5cede52da"} Jun 08 12:12:45.871263 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:45.871229 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-8rtcw" event={"ID":"9db910d5-0a1c-4f21-8203-8a8f1e2784f9","Type":"ContainerStarted","Data":"547cea9ca9e64db232b9ef0314d8196e353aa672424e1f2e1771b3556fecbc91"} Jun 08 12:12:45.871683 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:45.871345 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-8rtcw" Jun 08 12:12:45.888291 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:45.888236 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-8rtcw" podStartSLOduration=1.694476356 podStartE2EDuration="3.888219124s" totalImagesPullingTime="2.193742768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:12:45.887258293 +0000 UTC m=+487.215606946" watchObservedRunningTime="2026-06-08 12:12:45.888219124 +0000 UTC m=+487.216567773" Jun 08 12:12:50.386160 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:50.386125 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-59f754cb69-mtzhk"] Jun 08 12:12:50.392174 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:50.391365 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59f754cb69-mtzhk" Jun 08 12:12:50.394126 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:50.394102 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:12:50.394371 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:50.394343 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 08 12:12:50.394467 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:50.394346 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 08 12:12:50.394467 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:50.394350 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 08 12:12:50.394580 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:50.394451 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ncxrn\"" Jun 08 12:12:50.394633 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:50.394589 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 08 12:12:50.405998 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:50.405974 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59f754cb69-mtzhk"] Jun 08 12:12:50.483556 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:50.483518 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f454530-5f00-4bc5-a8c8-2ae2f18aff01-metrics-cert\") pod \"lws-controller-manager-59f754cb69-mtzhk\" (UID: \"2f454530-5f00-4bc5-a8c8-2ae2f18aff01\") " pod="openshift-lws-operator/lws-controller-manager-59f754cb69-mtzhk" Jun 08 12:12:50.483743 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:50.483585 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2f454530-5f00-4bc5-a8c8-2ae2f18aff01-manager-config\") pod \"lws-controller-manager-59f754cb69-mtzhk\" (UID: \"2f454530-5f00-4bc5-a8c8-2ae2f18aff01\") " pod="openshift-lws-operator/lws-controller-manager-59f754cb69-mtzhk" Jun 08 12:12:50.483743 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:50.483631 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd4hm\" (UniqueName: \"kubernetes.io/projected/2f454530-5f00-4bc5-a8c8-2ae2f18aff01-kube-api-access-gd4hm\") pod \"lws-controller-manager-59f754cb69-mtzhk\" (UID: \"2f454530-5f00-4bc5-a8c8-2ae2f18aff01\") " pod="openshift-lws-operator/lws-controller-manager-59f754cb69-mtzhk" Jun 08 12:12:50.483743 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:50.483657 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f454530-5f00-4bc5-a8c8-2ae2f18aff01-cert\") pod \"lws-controller-manager-59f754cb69-mtzhk\" (UID: \"2f454530-5f00-4bc5-a8c8-2ae2f18aff01\") " pod="openshift-lws-operator/lws-controller-manager-59f754cb69-mtzhk" Jun 08 12:12:50.584825 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:50.584789 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2f454530-5f00-4bc5-a8c8-2ae2f18aff01-manager-config\") pod \"lws-controller-manager-59f754cb69-mtzhk\" (UID: \"2f454530-5f00-4bc5-a8c8-2ae2f18aff01\") " pod="openshift-lws-operator/lws-controller-manager-59f754cb69-mtzhk" Jun 08 12:12:50.584952 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:50.584852 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd4hm\" (UniqueName: \"kubernetes.io/projected/2f454530-5f00-4bc5-a8c8-2ae2f18aff01-kube-api-access-gd4hm\") pod \"lws-controller-manager-59f754cb69-mtzhk\" (UID: \"2f454530-5f00-4bc5-a8c8-2ae2f18aff01\") " pod="openshift-lws-operator/lws-controller-manager-59f754cb69-mtzhk" Jun 08 12:12:50.584952 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:50.584879 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f454530-5f00-4bc5-a8c8-2ae2f18aff01-cert\") pod \"lws-controller-manager-59f754cb69-mtzhk\" (UID: \"2f454530-5f00-4bc5-a8c8-2ae2f18aff01\") " pod="openshift-lws-operator/lws-controller-manager-59f754cb69-mtzhk" Jun 08 12:12:50.584952 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:50.584900 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f454530-5f00-4bc5-a8c8-2ae2f18aff01-metrics-cert\") pod \"lws-controller-manager-59f754cb69-mtzhk\" (UID: \"2f454530-5f00-4bc5-a8c8-2ae2f18aff01\") " pod="openshift-lws-operator/lws-controller-manager-59f754cb69-mtzhk" Jun 08 12:12:50.585609 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:50.585584 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2f454530-5f00-4bc5-a8c8-2ae2f18aff01-manager-config\") pod \"lws-controller-manager-59f754cb69-mtzhk\" (UID: \"2f454530-5f00-4bc5-a8c8-2ae2f18aff01\") " pod="openshift-lws-operator/lws-controller-manager-59f754cb69-mtzhk" Jun 08 12:12:50.587448 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:50.587429 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f454530-5f00-4bc5-a8c8-2ae2f18aff01-cert\") pod \"lws-controller-manager-59f754cb69-mtzhk\" (UID: \"2f454530-5f00-4bc5-a8c8-2ae2f18aff01\") " pod="openshift-lws-operator/lws-controller-manager-59f754cb69-mtzhk" Jun 08 12:12:50.587562 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:50.587546 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f454530-5f00-4bc5-a8c8-2ae2f18aff01-metrics-cert\") pod \"lws-controller-manager-59f754cb69-mtzhk\" (UID: \"2f454530-5f00-4bc5-a8c8-2ae2f18aff01\") " pod="openshift-lws-operator/lws-controller-manager-59f754cb69-mtzhk" Jun 08 12:12:50.602786 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:50.602727 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd4hm\" (UniqueName: \"kubernetes.io/projected/2f454530-5f00-4bc5-a8c8-2ae2f18aff01-kube-api-access-gd4hm\") pod \"lws-controller-manager-59f754cb69-mtzhk\" (UID: \"2f454530-5f00-4bc5-a8c8-2ae2f18aff01\") " pod="openshift-lws-operator/lws-controller-manager-59f754cb69-mtzhk" Jun 08 12:12:50.701236 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:50.701134 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59f754cb69-mtzhk" Jun 08 12:12:50.835576 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:50.835545 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59f754cb69-mtzhk"] Jun 08 12:12:50.838331 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:12:50.838293 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f454530_5f00_4bc5_a8c8_2ae2f18aff01.slice/crio-2e2c93f193111b7127e5e21931e8b32ce2bcaa92f79b1fe44705e053e32cf841 WatchSource:0}: Error finding container 2e2c93f193111b7127e5e21931e8b32ce2bcaa92f79b1fe44705e053e32cf841: Status 404 returned error can't find the container with id 2e2c93f193111b7127e5e21931e8b32ce2bcaa92f79b1fe44705e053e32cf841 Jun 08 12:12:50.893133 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:50.893096 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59f754cb69-mtzhk" event={"ID":"2f454530-5f00-4bc5-a8c8-2ae2f18aff01","Type":"ContainerStarted","Data":"2e2c93f193111b7127e5e21931e8b32ce2bcaa92f79b1fe44705e053e32cf841"} Jun 08 12:12:52.619648 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:52.619573 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:52.736542 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:52.736501 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:52.857146 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:52.857100 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:53.053225 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:53.053151 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:53.918877 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:53.918840 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:54.030205 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:54.030165 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:54.913971 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:54.913939 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59f754cb69-mtzhk" event={"ID":"2f454530-5f00-4bc5-a8c8-2ae2f18aff01","Type":"ContainerStarted","Data":"9eefacbf80b306225031b43fd7de70ae7969b524c8b053945fe32bf838e28b4c"} Jun 08 12:12:54.914152 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:54.914126 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-59f754cb69-mtzhk" Jun 08 12:12:55.372423 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:55.372394 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:55.485038 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:55.484993 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:56.721534 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:56.721492 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:56.879575 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:56.879525 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:56.880214 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:56.880196 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-8rtcw" Jun 08 12:12:56.935071 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:56.935015 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-59f754cb69-mtzhk" podStartSLOduration=3.405352689 podStartE2EDuration="6.934998329s" totalImagesPullingTime="3.52964564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:12:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:12:54.930207099 +0000 UTC m=+496.258555772" watchObservedRunningTime="2026-06-08 12:12:56.934998329 +0000 UTC m=+498.263346979" Jun 08 12:12:57.443039 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:57.443006 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:57.854084 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:57.854046 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:12:58.108815 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:12:58.108730 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:04.756200 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:04.756161 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:04.825938 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:04.825907 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:05.304963 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:05.304930 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:05.920381 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:05.920354 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-59f754cb69-mtzhk" Jun 08 12:13:08.655333 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:08.655283 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:08.756820 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:08.756789 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:09.539565 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.539535 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p"] Jun 08 12:13:09.542879 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.542863 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:09.545077 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.545054 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-7d5gl\"" Jun 08 12:13:09.545216 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.545061 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 08 12:13:09.545337 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.545319 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 08 12:13:09.545466 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.545451 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 08 12:13:09.556648 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.556627 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p"] Jun 08 12:13:09.581618 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.581587 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:09.643932 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.643898 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13418ac1-9288-43c8-b4a5-8b3c3b77e00e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qj85p\" (UID: \"13418ac1-9288-43c8-b4a5-8b3c3b77e00e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:09.644090 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.643948 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13418ac1-9288-43c8-b4a5-8b3c3b77e00e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qj85p\" (UID: \"13418ac1-9288-43c8-b4a5-8b3c3b77e00e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:09.644090 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.644026 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13418ac1-9288-43c8-b4a5-8b3c3b77e00e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qj85p\" (UID: \"13418ac1-9288-43c8-b4a5-8b3c3b77e00e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:09.644090 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.644047 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13418ac1-9288-43c8-b4a5-8b3c3b77e00e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qj85p\" (UID: \"13418ac1-9288-43c8-b4a5-8b3c3b77e00e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:09.644090 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.644074 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13418ac1-9288-43c8-b4a5-8b3c3b77e00e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qj85p\" (UID: \"13418ac1-9288-43c8-b4a5-8b3c3b77e00e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:09.644243 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.644100 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13418ac1-9288-43c8-b4a5-8b3c3b77e00e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qj85p\" (UID: \"13418ac1-9288-43c8-b4a5-8b3c3b77e00e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:09.644243 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.644118 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13418ac1-9288-43c8-b4a5-8b3c3b77e00e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qj85p\" (UID: \"13418ac1-9288-43c8-b4a5-8b3c3b77e00e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:09.644243 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.644132 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13418ac1-9288-43c8-b4a5-8b3c3b77e00e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qj85p\" (UID: \"13418ac1-9288-43c8-b4a5-8b3c3b77e00e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:09.644243 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.644181 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqn5g\" (UniqueName: \"kubernetes.io/projected/13418ac1-9288-43c8-b4a5-8b3c3b77e00e-kube-api-access-wqn5g\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qj85p\" (UID: \"13418ac1-9288-43c8-b4a5-8b3c3b77e00e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:09.745168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.745127 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13418ac1-9288-43c8-b4a5-8b3c3b77e00e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qj85p\" (UID: \"13418ac1-9288-43c8-b4a5-8b3c3b77e00e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:09.745168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.745168 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13418ac1-9288-43c8-b4a5-8b3c3b77e00e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qj85p\" (UID: \"13418ac1-9288-43c8-b4a5-8b3c3b77e00e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:09.745693 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.745192 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13418ac1-9288-43c8-b4a5-8b3c3b77e00e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qj85p\" (UID: \"13418ac1-9288-43c8-b4a5-8b3c3b77e00e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:09.745693 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.745220 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqn5g\" (UniqueName: \"kubernetes.io/projected/13418ac1-9288-43c8-b4a5-8b3c3b77e00e-kube-api-access-wqn5g\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qj85p\" (UID: \"13418ac1-9288-43c8-b4a5-8b3c3b77e00e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:09.745693 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.745271 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13418ac1-9288-43c8-b4a5-8b3c3b77e00e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qj85p\" (UID: \"13418ac1-9288-43c8-b4a5-8b3c3b77e00e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:09.745693 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.745354 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13418ac1-9288-43c8-b4a5-8b3c3b77e00e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qj85p\" (UID: \"13418ac1-9288-43c8-b4a5-8b3c3b77e00e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:09.745693 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.745425 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13418ac1-9288-43c8-b4a5-8b3c3b77e00e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qj85p\" (UID: \"13418ac1-9288-43c8-b4a5-8b3c3b77e00e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:09.745693 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.745450 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13418ac1-9288-43c8-b4a5-8b3c3b77e00e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qj85p\" (UID: \"13418ac1-9288-43c8-b4a5-8b3c3b77e00e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:09.745693 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.745487 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13418ac1-9288-43c8-b4a5-8b3c3b77e00e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qj85p\" (UID: \"13418ac1-9288-43c8-b4a5-8b3c3b77e00e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:09.745693 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.745555 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13418ac1-9288-43c8-b4a5-8b3c3b77e00e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qj85p\" (UID: \"13418ac1-9288-43c8-b4a5-8b3c3b77e00e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:09.746103 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.745850 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13418ac1-9288-43c8-b4a5-8b3c3b77e00e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qj85p\" (UID: \"13418ac1-9288-43c8-b4a5-8b3c3b77e00e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:09.746103 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.745882 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13418ac1-9288-43c8-b4a5-8b3c3b77e00e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qj85p\" (UID: \"13418ac1-9288-43c8-b4a5-8b3c3b77e00e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:09.746103 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.745920 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13418ac1-9288-43c8-b4a5-8b3c3b77e00e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qj85p\" (UID: \"13418ac1-9288-43c8-b4a5-8b3c3b77e00e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:09.746239 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.746120 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13418ac1-9288-43c8-b4a5-8b3c3b77e00e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qj85p\" (UID: \"13418ac1-9288-43c8-b4a5-8b3c3b77e00e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:09.747628 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.747607 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13418ac1-9288-43c8-b4a5-8b3c3b77e00e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qj85p\" (UID: \"13418ac1-9288-43c8-b4a5-8b3c3b77e00e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:09.747879 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.747862 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13418ac1-9288-43c8-b4a5-8b3c3b77e00e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qj85p\" (UID: \"13418ac1-9288-43c8-b4a5-8b3c3b77e00e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:09.756395 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.756368 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13418ac1-9288-43c8-b4a5-8b3c3b77e00e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qj85p\" (UID: \"13418ac1-9288-43c8-b4a5-8b3c3b77e00e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:09.756537 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.756520 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqn5g\" (UniqueName: \"kubernetes.io/projected/13418ac1-9288-43c8-b4a5-8b3c3b77e00e-kube-api-access-wqn5g\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qj85p\" (UID: \"13418ac1-9288-43c8-b4a5-8b3c3b77e00e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:09.779390 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.779357 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:09.853268 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.853236 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:09.941176 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.941145 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:09.987029 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:09.986991 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p"] Jun 08 12:13:09.989631 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:13:09.989597 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13418ac1_9288_43c8_b4a5_8b3c3b77e00e.slice/crio-91381e95307c01eba09d0c87e1e485db7d720242528f4ad687a5b60e720c608b WatchSource:0}: Error finding container 91381e95307c01eba09d0c87e1e485db7d720242528f4ad687a5b60e720c608b: Status 404 returned error can't find the container with id 91381e95307c01eba09d0c87e1e485db7d720242528f4ad687a5b60e720c608b Jun 08 12:13:10.991947 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:10.991805 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" event={"ID":"13418ac1-9288-43c8-b4a5-8b3c3b77e00e","Type":"ContainerStarted","Data":"91381e95307c01eba09d0c87e1e485db7d720242528f4ad687a5b60e720c608b"} Jun 08 12:13:14.480640 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:14.480592 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 12:13:14.480929 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:14.480671 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 12:13:14.480929 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:14.480698 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 12:13:15.010773 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:15.010736 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" event={"ID":"13418ac1-9288-43c8-b4a5-8b3c3b77e00e","Type":"ContainerStarted","Data":"1dfb81bbe55bf178b7dab922c2b077f6bb44e112f488cf92cc57c47c5ff1df60"} Jun 08 12:13:15.046167 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:15.046106 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" podStartSLOduration=1.5573687619999999 podStartE2EDuration="6.046085397s" totalImagesPullingTime="4.488716635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:13:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:13:15.045495524 +0000 UTC m=+516.373844184" watchObservedRunningTime="2026-06-08 12:13:15.046085397 +0000 UTC m=+516.374434049" Jun 08 12:13:15.514363 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:15.514323 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6b6d49959d-r5trc"] Jun 08 12:13:15.517664 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:15.517643 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6b6d49959d-r5trc" Jun 08 12:13:15.521092 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:15.521069 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 08 12:13:15.522892 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:15.522866 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-q2ptp\"" Jun 08 12:13:15.548163 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:15.548136 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6b6d49959d-r5trc"] Jun 08 12:13:15.601696 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:15.601654 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mjjd\" (UniqueName: \"kubernetes.io/projected/17104e02-d81f-4d96-b951-7b2ab65b0c4c-kube-api-access-5mjjd\") pod \"dashboard-redirect-6b6d49959d-r5trc\" (UID: \"17104e02-d81f-4d96-b951-7b2ab65b0c4c\") " pod="opendatahub/dashboard-redirect-6b6d49959d-r5trc" Jun 08 12:13:15.601859 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:15.601744 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/17104e02-d81f-4d96-b951-7b2ab65b0c4c-redirect-config\") pod \"dashboard-redirect-6b6d49959d-r5trc\" (UID: \"17104e02-d81f-4d96-b951-7b2ab65b0c4c\") " pod="opendatahub/dashboard-redirect-6b6d49959d-r5trc" Jun 08 12:13:15.633754 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:15.633718 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:15.702443 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:15.702413 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/17104e02-d81f-4d96-b951-7b2ab65b0c4c-redirect-config\") pod \"dashboard-redirect-6b6d49959d-r5trc\" (UID: \"17104e02-d81f-4d96-b951-7b2ab65b0c4c\") " pod="opendatahub/dashboard-redirect-6b6d49959d-r5trc" Jun 08 12:13:15.702606 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:15.702479 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mjjd\" (UniqueName: \"kubernetes.io/projected/17104e02-d81f-4d96-b951-7b2ab65b0c4c-kube-api-access-5mjjd\") pod \"dashboard-redirect-6b6d49959d-r5trc\" (UID: \"17104e02-d81f-4d96-b951-7b2ab65b0c4c\") " pod="opendatahub/dashboard-redirect-6b6d49959d-r5trc" Jun 08 12:13:15.703119 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:15.703094 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/17104e02-d81f-4d96-b951-7b2ab65b0c4c-redirect-config\") pod \"dashboard-redirect-6b6d49959d-r5trc\" (UID: \"17104e02-d81f-4d96-b951-7b2ab65b0c4c\") " pod="opendatahub/dashboard-redirect-6b6d49959d-r5trc" Jun 08 12:13:15.715130 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:15.715107 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mjjd\" (UniqueName: \"kubernetes.io/projected/17104e02-d81f-4d96-b951-7b2ab65b0c4c-kube-api-access-5mjjd\") pod \"dashboard-redirect-6b6d49959d-r5trc\" (UID: \"17104e02-d81f-4d96-b951-7b2ab65b0c4c\") " pod="opendatahub/dashboard-redirect-6b6d49959d-r5trc" Jun 08 12:13:15.828821 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:15.828789 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6b6d49959d-r5trc" Jun 08 12:13:15.854116 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:15.854079 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:15.858950 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:15.858926 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:15.962957 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:15.962926 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6b6d49959d-r5trc"] Jun 08 12:13:15.966579 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:13:15.966554 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17104e02_d81f_4d96_b951_7b2ab65b0c4c.slice/crio-df01abc73ac68c41ca52008ecd56ed34c066dd7cdb1d58326e519fe3179bd9e6 WatchSource:0}: Error finding container df01abc73ac68c41ca52008ecd56ed34c066dd7cdb1d58326e519fe3179bd9e6: Status 404 returned error can't find the container with id df01abc73ac68c41ca52008ecd56ed34c066dd7cdb1d58326e519fe3179bd9e6 Jun 08 12:13:16.016260 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:16.016226 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6b6d49959d-r5trc" event={"ID":"17104e02-d81f-4d96-b951-7b2ab65b0c4c","Type":"ContainerStarted","Data":"df01abc73ac68c41ca52008ecd56ed34c066dd7cdb1d58326e519fe3179bd9e6"} Jun 08 12:13:16.016570 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:16.016552 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:16.017649 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:16.017627 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qj85p" Jun 08 12:13:18.027489 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:18.027451 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6b6d49959d-r5trc" event={"ID":"17104e02-d81f-4d96-b951-7b2ab65b0c4c","Type":"ContainerStarted","Data":"6ed3e72e218f5c208f7a93e145474c00ba1ba475d14eb7bbdd6f6b4739335045"} Jun 08 12:13:18.043656 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:18.043609 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6b6d49959d-r5trc" podStartSLOduration=1.104161771 podStartE2EDuration="3.043593757s" totalImagesPullingTime="1.939431986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:13:18.042835048 +0000 UTC m=+519.371183700" watchObservedRunningTime="2026-06-08 12:13:18.043593757 +0000 UTC m=+519.371942433" Jun 08 12:13:42.934760 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:42.934675 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:43.035663 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:43.035634 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:43.043488 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:43.043453 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lzkh2"] Jun 08 12:13:43.046853 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:43.046832 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lzkh2" Jun 08 12:13:43.048714 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:43.048691 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 12:13:43.048846 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:43.048729 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 12:13:43.057553 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:43.057526 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lzkh2"] Jun 08 12:13:43.105457 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:43.105427 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:43.158161 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:43.158128 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf28h\" (UniqueName: \"kubernetes.io/projected/2925787b-5cbe-44b1-9f92-ccc61c238e85-kube-api-access-mf28h\") pod \"kuadrant-operator-catalog-lzkh2\" (UID: \"2925787b-5cbe-44b1-9f92-ccc61c238e85\") " pod="kuadrant-system/kuadrant-operator-catalog-lzkh2" Jun 08 12:13:43.259912 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:43.259824 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf28h\" (UniqueName: \"kubernetes.io/projected/2925787b-5cbe-44b1-9f92-ccc61c238e85-kube-api-access-mf28h\") pod \"kuadrant-operator-catalog-lzkh2\" (UID: \"2925787b-5cbe-44b1-9f92-ccc61c238e85\") " pod="kuadrant-system/kuadrant-operator-catalog-lzkh2" Jun 08 12:13:43.268038 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:43.268010 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf28h\" (UniqueName: \"kubernetes.io/projected/2925787b-5cbe-44b1-9f92-ccc61c238e85-kube-api-access-mf28h\") pod \"kuadrant-operator-catalog-lzkh2\" (UID: \"2925787b-5cbe-44b1-9f92-ccc61c238e85\") " pod="kuadrant-system/kuadrant-operator-catalog-lzkh2" Jun 08 12:13:43.357034 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:43.356995 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lzkh2" Jun 08 12:13:43.408963 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:43.408361 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lzkh2"] Jun 08 12:13:43.494730 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:43.494705 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lzkh2"] Jun 08 12:13:43.497247 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:13:43.497218 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2925787b_5cbe_44b1_9f92_ccc61c238e85.slice/crio-ce4887d0e56ea82a58747c288eea395592daf2f929226ab553877d58604b5f2a WatchSource:0}: Error finding container ce4887d0e56ea82a58747c288eea395592daf2f929226ab553877d58604b5f2a: Status 404 returned error can't find the container with id ce4887d0e56ea82a58747c288eea395592daf2f929226ab553877d58604b5f2a Jun 08 12:13:43.619023 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:43.618991 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r4ts9"] Jun 08 12:13:43.623803 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:43.623785 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r4ts9" Jun 08 12:13:43.626065 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:43.626038 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-4dpzj\"" Jun 08 12:13:43.629330 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:43.629292 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r4ts9"] Jun 08 12:13:43.764929 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:43.764889 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqgp9\" (UniqueName: \"kubernetes.io/projected/2b07cc83-c634-4233-88fc-fc4c955e13d1-kube-api-access-pqgp9\") pod \"kuadrant-operator-catalog-r4ts9\" (UID: \"2b07cc83-c634-4233-88fc-fc4c955e13d1\") " pod="kuadrant-system/kuadrant-operator-catalog-r4ts9" Jun 08 12:13:43.839988 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:43.839957 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:43.865690 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:43.865660 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqgp9\" (UniqueName: \"kubernetes.io/projected/2b07cc83-c634-4233-88fc-fc4c955e13d1-kube-api-access-pqgp9\") pod \"kuadrant-operator-catalog-r4ts9\" (UID: \"2b07cc83-c634-4233-88fc-fc4c955e13d1\") " pod="kuadrant-system/kuadrant-operator-catalog-r4ts9" Jun 08 12:13:43.874151 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:43.874085 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqgp9\" (UniqueName: \"kubernetes.io/projected/2b07cc83-c634-4233-88fc-fc4c955e13d1-kube-api-access-pqgp9\") pod \"kuadrant-operator-catalog-r4ts9\" (UID: \"2b07cc83-c634-4233-88fc-fc4c955e13d1\") " pod="kuadrant-system/kuadrant-operator-catalog-r4ts9" Jun 08 12:13:43.935139 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:43.935099 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r4ts9" Jun 08 12:13:44.042897 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:44.042862 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:44.072803 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:44.072739 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r4ts9"] Jun 08 12:13:44.075468 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:13:44.075445 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b07cc83_c634_4233_88fc_fc4c955e13d1.slice/crio-e10cfa95f0be66e4ba8717303b7b11c457bc5569715ce48e019ab0366b0a5a48 WatchSource:0}: Error finding container e10cfa95f0be66e4ba8717303b7b11c457bc5569715ce48e019ab0366b0a5a48: Status 404 returned error can't find the container with id e10cfa95f0be66e4ba8717303b7b11c457bc5569715ce48e019ab0366b0a5a48 Jun 08 12:13:44.140223 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:44.140126 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r4ts9" event={"ID":"2b07cc83-c634-4233-88fc-fc4c955e13d1","Type":"ContainerStarted","Data":"e10cfa95f0be66e4ba8717303b7b11c457bc5569715ce48e019ab0366b0a5a48"} Jun 08 12:13:44.141542 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:44.141511 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lzkh2" event={"ID":"2925787b-5cbe-44b1-9f92-ccc61c238e85","Type":"ContainerStarted","Data":"ce4887d0e56ea82a58747c288eea395592daf2f929226ab553877d58604b5f2a"} Jun 08 12:13:46.154261 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:46.154021 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r4ts9" event={"ID":"2b07cc83-c634-4233-88fc-fc4c955e13d1","Type":"ContainerStarted","Data":"fbb80938ee5f462ea2e69a86c33e7a8b7830190590c33dd29d61c6b0e07abb6c"} Jun 08 12:13:46.155785 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:46.155760 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lzkh2" event={"ID":"2925787b-5cbe-44b1-9f92-ccc61c238e85","Type":"ContainerStarted","Data":"240c70376ca622351dab2fc7a246431364c9ce3bf652d44039876b950bf083db"} Jun 08 12:13:46.155912 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:46.155815 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-lzkh2" podUID="2925787b-5cbe-44b1-9f92-ccc61c238e85" containerName="registry-server" containerID="cri-o://240c70376ca622351dab2fc7a246431364c9ce3bf652d44039876b950bf083db" gracePeriod=2 Jun 08 12:13:46.171121 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:46.170657 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-r4ts9" podStartSLOduration=1.181273595 podStartE2EDuration="3.170637064s" totalImagesPullingTime="1.989363469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:13:46.169805463 +0000 UTC m=+547.498154115" watchObservedRunningTime="2026-06-08 12:13:46.170637064 +0000 UTC m=+547.498985715" Jun 08 12:13:46.185121 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:46.185075 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-lzkh2" podStartSLOduration=0.644491751 podStartE2EDuration="3.185059676s" totalImagesPullingTime="2.540567925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:13:46.183824733 +0000 UTC m=+547.512173397" watchObservedRunningTime="2026-06-08 12:13:46.185059676 +0000 UTC m=+547.513408326" Jun 08 12:13:46.411369 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:46.411344 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-lzkh2_2925787b-5cbe-44b1-9f92-ccc61c238e85/registry-server/0.log" Jun 08 12:13:46.413717 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:46.413694 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lzkh2" Jun 08 12:13:46.558588 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:46.558555 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:46.592249 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:46.592180 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mf28h\" (UniqueName: \"kubernetes.io/projected/2925787b-5cbe-44b1-9f92-ccc61c238e85-kube-api-access-mf28h\") pod \"2925787b-5cbe-44b1-9f92-ccc61c238e85\" (UID: \"2925787b-5cbe-44b1-9f92-ccc61c238e85\") " Jun 08 12:13:46.594282 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:46.594258 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2925787b-5cbe-44b1-9f92-ccc61c238e85-kube-api-access-mf28h" (OuterVolumeSpecName: "kube-api-access-mf28h") pod "2925787b-5cbe-44b1-9f92-ccc61c238e85" (UID: "2925787b-5cbe-44b1-9f92-ccc61c238e85"). InnerVolumeSpecName "kube-api-access-mf28h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:13:46.693904 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:46.693870 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mf28h\" (UniqueName: \"kubernetes.io/projected/2925787b-5cbe-44b1-9f92-ccc61c238e85-kube-api-access-mf28h\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:13:47.160856 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:47.160830 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-lzkh2_2925787b-5cbe-44b1-9f92-ccc61c238e85/registry-server/0.log" Jun 08 12:13:47.161256 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:47.160874 2565 generic.go:356] "Generic (PLEG): container finished" podID="2925787b-5cbe-44b1-9f92-ccc61c238e85" containerID="240c70376ca622351dab2fc7a246431364c9ce3bf652d44039876b950bf083db" exitCode=2 Jun 08 12:13:47.161256 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:47.160919 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lzkh2" Jun 08 12:13:47.161256 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:47.160958 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lzkh2" event={"ID":"2925787b-5cbe-44b1-9f92-ccc61c238e85","Type":"ContainerDied","Data":"240c70376ca622351dab2fc7a246431364c9ce3bf652d44039876b950bf083db"} Jun 08 12:13:47.161256 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:47.161014 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lzkh2" event={"ID":"2925787b-5cbe-44b1-9f92-ccc61c238e85","Type":"ContainerDied","Data":"ce4887d0e56ea82a58747c288eea395592daf2f929226ab553877d58604b5f2a"} Jun 08 12:13:47.161256 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:47.161037 2565 scope.go:117] "RemoveContainer" containerID="240c70376ca622351dab2fc7a246431364c9ce3bf652d44039876b950bf083db" Jun 08 12:13:47.169488 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:47.169469 2565 scope.go:117] "RemoveContainer" containerID="240c70376ca622351dab2fc7a246431364c9ce3bf652d44039876b950bf083db" Jun 08 12:13:47.169775 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:13:47.169751 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"240c70376ca622351dab2fc7a246431364c9ce3bf652d44039876b950bf083db\": container with ID starting with 240c70376ca622351dab2fc7a246431364c9ce3bf652d44039876b950bf083db not found: ID does not exist" containerID="240c70376ca622351dab2fc7a246431364c9ce3bf652d44039876b950bf083db" Jun 08 12:13:47.169896 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:47.169786 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"240c70376ca622351dab2fc7a246431364c9ce3bf652d44039876b950bf083db"} err="failed to get container status \"240c70376ca622351dab2fc7a246431364c9ce3bf652d44039876b950bf083db\": rpc error: code = NotFound desc = could not find container \"240c70376ca622351dab2fc7a246431364c9ce3bf652d44039876b950bf083db\": container with ID starting with 240c70376ca622351dab2fc7a246431364c9ce3bf652d44039876b950bf083db not found: ID does not exist" Jun 08 12:13:47.176664 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:47.176644 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lzkh2"] Jun 08 12:13:47.180387 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:47.180370 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lzkh2"] Jun 08 12:13:49.123829 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:49.123798 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2925787b-5cbe-44b1-9f92-ccc61c238e85" path="/var/lib/kubelet/pods/2925787b-5cbe-44b1-9f92-ccc61c238e85/volumes" Jun 08 12:13:50.487492 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:50.487448 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:50.552379 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:50.552349 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:53.936217 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:53.936182 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-r4ts9" Jun 08 12:13:53.936670 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:53.936256 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-r4ts9" Jun 08 12:13:53.958698 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:53.958663 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-r4ts9" Jun 08 12:13:54.212468 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:13:54.212396 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-r4ts9" Jun 08 12:14:06.347643 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:06.347592 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:08.786826 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:08.782992 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pm4jf"] Jun 08 12:14:08.786826 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:08.783845 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2925787b-5cbe-44b1-9f92-ccc61c238e85" containerName="registry-server" Jun 08 12:14:08.786826 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:08.783866 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2925787b-5cbe-44b1-9f92-ccc61c238e85" containerName="registry-server" Jun 08 12:14:08.786826 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:08.784040 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2925787b-5cbe-44b1-9f92-ccc61c238e85" containerName="registry-server" Jun 08 12:14:08.788998 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:08.788973 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pm4jf" Jun 08 12:14:08.791444 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:08.791421 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-dcfvs\"" Jun 08 12:14:08.799896 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:08.799873 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pm4jf"] Jun 08 12:14:08.884714 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:08.884672 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c76hn\" (UniqueName: \"kubernetes.io/projected/9417106d-e0ec-49f8-8311-51a015051354-kube-api-access-c76hn\") pod \"limitador-operator-controller-manager-859d7b78bd-pm4jf\" (UID: \"9417106d-e0ec-49f8-8311-51a015051354\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pm4jf" Jun 08 12:14:08.985731 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:08.985686 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c76hn\" (UniqueName: \"kubernetes.io/projected/9417106d-e0ec-49f8-8311-51a015051354-kube-api-access-c76hn\") pod \"limitador-operator-controller-manager-859d7b78bd-pm4jf\" (UID: \"9417106d-e0ec-49f8-8311-51a015051354\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pm4jf" Jun 08 12:14:08.999032 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:08.999008 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c76hn\" (UniqueName: \"kubernetes.io/projected/9417106d-e0ec-49f8-8311-51a015051354-kube-api-access-c76hn\") pod \"limitador-operator-controller-manager-859d7b78bd-pm4jf\" (UID: \"9417106d-e0ec-49f8-8311-51a015051354\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pm4jf" Jun 08 12:14:09.098483 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:09.098438 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pm4jf" Jun 08 12:14:09.235818 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:09.235783 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pm4jf"] Jun 08 12:14:09.240174 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:14:09.240146 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9417106d_e0ec_49f8_8311_51a015051354.slice/crio-71ae3d460fe9aef2f2d9e704ef5d94e1542d11b1b796ca0d0d4fcd51bca8b15e WatchSource:0}: Error finding container 71ae3d460fe9aef2f2d9e704ef5d94e1542d11b1b796ca0d0d4fcd51bca8b15e: Status 404 returned error can't find the container with id 71ae3d460fe9aef2f2d9e704ef5d94e1542d11b1b796ca0d0d4fcd51bca8b15e Jun 08 12:14:09.255519 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:09.255485 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pm4jf" event={"ID":"9417106d-e0ec-49f8-8311-51a015051354","Type":"ContainerStarted","Data":"71ae3d460fe9aef2f2d9e704ef5d94e1542d11b1b796ca0d0d4fcd51bca8b15e"} Jun 08 12:14:09.737112 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:09.737077 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:09.854980 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:09.854947 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:11.312694 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:11.312664 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:11.417143 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:11.417111 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:11.531219 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:11.531190 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:12.029630 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:12.029594 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:12.134468 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:12.134438 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:12.274014 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:12.273979 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pm4jf" event={"ID":"9417106d-e0ec-49f8-8311-51a015051354","Type":"ContainerStarted","Data":"fe5bfbb9260d2c26e9b7f366ae2722d1246566954be73d3dc3bbb9bb92be380d"} Jun 08 12:14:12.274184 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:12.274057 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pm4jf" Jun 08 12:14:12.291027 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:12.290936 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pm4jf" podStartSLOduration=2.224634511 podStartE2EDuration="4.290921442s" totalImagesPullingTime="2.066286931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:14:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:14:12.289777504 +0000 UTC m=+573.618126157" watchObservedRunningTime="2026-06-08 12:14:12.290921442 +0000 UTC m=+573.619270163" Jun 08 12:14:14.220498 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:14.220465 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npgp4"] Jun 08 12:14:14.223992 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:14.223973 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npgp4" Jun 08 12:14:14.226209 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:14.226188 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-f9fdc\"" Jun 08 12:14:14.244755 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:14.244730 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npgp4"] Jun 08 12:14:14.339761 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:14.339719 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3bd0918-ef58-4dbb-98a9-7cbd6d083997-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-npgp4\" (UID: \"d3bd0918-ef58-4dbb-98a9-7cbd6d083997\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npgp4" Jun 08 12:14:14.339761 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:14.339759 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krgtx\" (UniqueName: \"kubernetes.io/projected/d3bd0918-ef58-4dbb-98a9-7cbd6d083997-kube-api-access-krgtx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-npgp4\" (UID: \"d3bd0918-ef58-4dbb-98a9-7cbd6d083997\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npgp4" Jun 08 12:14:14.441249 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:14.441216 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3bd0918-ef58-4dbb-98a9-7cbd6d083997-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-npgp4\" (UID: \"d3bd0918-ef58-4dbb-98a9-7cbd6d083997\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npgp4" Jun 08 12:14:14.441249 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:14.441252 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krgtx\" (UniqueName: \"kubernetes.io/projected/d3bd0918-ef58-4dbb-98a9-7cbd6d083997-kube-api-access-krgtx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-npgp4\" (UID: \"d3bd0918-ef58-4dbb-98a9-7cbd6d083997\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npgp4" Jun 08 12:14:14.441673 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:14.441647 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3bd0918-ef58-4dbb-98a9-7cbd6d083997-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-npgp4\" (UID: \"d3bd0918-ef58-4dbb-98a9-7cbd6d083997\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npgp4" Jun 08 12:14:14.452899 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:14.452872 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krgtx\" (UniqueName: \"kubernetes.io/projected/d3bd0918-ef58-4dbb-98a9-7cbd6d083997-kube-api-access-krgtx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-npgp4\" (UID: \"d3bd0918-ef58-4dbb-98a9-7cbd6d083997\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npgp4" Jun 08 12:14:14.533856 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:14.533768 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npgp4" Jun 08 12:14:14.546003 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:14.545971 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:14.679387 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:14.679328 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npgp4"] Jun 08 12:14:14.681840 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:14:14.681812 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3bd0918_ef58_4dbb_98a9_7cbd6d083997.slice/crio-b714ae65575df1d8709c2630b474c32555e9573890d1012632bd8c2096dae7e6 WatchSource:0}: Error finding container b714ae65575df1d8709c2630b474c32555e9573890d1012632bd8c2096dae7e6: Status 404 returned error can't find the container with id b714ae65575df1d8709c2630b474c32555e9573890d1012632bd8c2096dae7e6 Jun 08 12:14:15.115695 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:15.115660 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:15.288941 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:15.288905 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npgp4" event={"ID":"d3bd0918-ef58-4dbb-98a9-7cbd6d083997","Type":"ContainerStarted","Data":"b714ae65575df1d8709c2630b474c32555e9573890d1012632bd8c2096dae7e6"} Jun 08 12:14:16.973750 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:16.973712 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:18.375320 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:18.375271 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:19.309515 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:19.309480 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:19.453513 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:19.453477 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:20.589045 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:20.589012 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zq5gg"] Jun 08 12:14:20.595468 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:20.595451 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zq5gg" Jun 08 12:14:20.597292 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:20.597270 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 08 12:14:20.597433 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:20.597377 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-5dm9q\"" Jun 08 12:14:20.601425 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:20.601400 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zq5gg"] Jun 08 12:14:20.700527 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:20.700496 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmsmb\" (UniqueName: \"kubernetes.io/projected/f26543c4-de01-4919-843c-dde45b46e339-kube-api-access-cmsmb\") pod \"dns-operator-controller-manager-864dd78c4c-zq5gg\" (UID: \"f26543c4-de01-4919-843c-dde45b46e339\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zq5gg" Jun 08 12:14:20.801930 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:20.801899 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmsmb\" (UniqueName: \"kubernetes.io/projected/f26543c4-de01-4919-843c-dde45b46e339-kube-api-access-cmsmb\") pod \"dns-operator-controller-manager-864dd78c4c-zq5gg\" (UID: \"f26543c4-de01-4919-843c-dde45b46e339\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zq5gg" Jun 08 12:14:20.811535 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:20.811506 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmsmb\" (UniqueName: \"kubernetes.io/projected/f26543c4-de01-4919-843c-dde45b46e339-kube-api-access-cmsmb\") pod \"dns-operator-controller-manager-864dd78c4c-zq5gg\" (UID: \"f26543c4-de01-4919-843c-dde45b46e339\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zq5gg" Jun 08 12:14:20.907397 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:20.907288 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zq5gg" Jun 08 12:14:21.328341 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:21.328296 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:22.060243 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:22.060210 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:22.164125 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:22.164097 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:22.165328 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:22.165295 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zq5gg"] Jun 08 12:14:22.167485 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:14:22.167460 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf26543c4_de01_4919_843c_dde45b46e339.slice/crio-e006d9288da3beb943bb0cf89e2ea9de6492bb69349e2c3df3dbb5fd3649d965 WatchSource:0}: Error finding container e006d9288da3beb943bb0cf89e2ea9de6492bb69349e2c3df3dbb5fd3649d965: Status 404 returned error can't find the container with id e006d9288da3beb943bb0cf89e2ea9de6492bb69349e2c3df3dbb5fd3649d965 Jun 08 12:14:22.264085 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:22.264056 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:22.324938 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:22.324902 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npgp4" event={"ID":"d3bd0918-ef58-4dbb-98a9-7cbd6d083997","Type":"ContainerStarted","Data":"08e070e43513a87e9a91d24bc06bc526a1bd6abec8e21ba607730e53211b5951"} Jun 08 12:14:22.325117 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:22.324972 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npgp4" Jun 08 12:14:22.326161 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:22.326135 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zq5gg" event={"ID":"f26543c4-de01-4919-843c-dde45b46e339","Type":"ContainerStarted","Data":"e006d9288da3beb943bb0cf89e2ea9de6492bb69349e2c3df3dbb5fd3649d965"} Jun 08 12:14:22.342886 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:22.342846 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npgp4" podStartSLOduration=0.943352343 podStartE2EDuration="8.342832647s" totalImagesPullingTime="7.399480304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:14:22.342215912 +0000 UTC m=+583.670564564" watchObservedRunningTime="2026-06-08 12:14:22.342832647 +0000 UTC m=+583.671181296" Jun 08 12:14:22.544910 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:22.544877 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:22.641056 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:22.640949 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:23.280642 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:23.280615 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pm4jf" Jun 08 12:14:24.346083 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:24.346048 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zq5gg" event={"ID":"f26543c4-de01-4919-843c-dde45b46e339","Type":"ContainerStarted","Data":"c967c4e1a60f0d612f44c2b8f95c9ebd9ebbba37e531a8853177b48b8d3dc842"} Jun 08 12:14:24.346456 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:24.346174 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zq5gg" Jun 08 12:14:24.375535 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:24.375475 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zq5gg" podStartSLOduration=2.269014326 podStartE2EDuration="4.375458491s" totalImagesPullingTime="2.106444165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:14:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:14:24.372471537 +0000 UTC m=+585.700820188" watchObservedRunningTime="2026-06-08 12:14:24.375458491 +0000 UTC m=+585.703807140" Jun 08 12:14:25.124113 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:25.124072 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:25.301234 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:25.301201 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:25.929675 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:25.929639 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:25.987847 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:25.987814 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:33.340922 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:33.340890 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npgp4" Jun 08 12:14:34.620573 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:34.620538 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:34.742134 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:34.742092 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:35.068917 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.068868 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npgp4"] Jun 08 12:14:35.069198 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.069097 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npgp4" podUID="d3bd0918-ef58-4dbb-98a9-7cbd6d083997" containerName="manager" containerID="cri-o://08e070e43513a87e9a91d24bc06bc526a1bd6abec8e21ba607730e53211b5951" gracePeriod=2 Jun 08 12:14:35.071186 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.071162 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npgp4"] Jun 08 12:14:35.087830 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.087804 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsnkf"] Jun 08 12:14:35.088168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.088156 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3bd0918-ef58-4dbb-98a9-7cbd6d083997" containerName="manager" Jun 08 12:14:35.088227 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.088169 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3bd0918-ef58-4dbb-98a9-7cbd6d083997" containerName="manager" Jun 08 12:14:35.088227 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.088220 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3bd0918-ef58-4dbb-98a9-7cbd6d083997" containerName="manager" Jun 08 12:14:35.092549 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.092528 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsnkf" Jun 08 12:14:35.103974 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.103940 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pm4jf"] Jun 08 12:14:35.104156 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.104134 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pm4jf" podUID="9417106d-e0ec-49f8-8311-51a015051354" containerName="manager" containerID="cri-o://fe5bfbb9260d2c26e9b7f366ae2722d1246566954be73d3dc3bbb9bb92be380d" gracePeriod=2 Jun 08 12:14:35.126051 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.126020 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pm4jf"] Jun 08 12:14:35.126205 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.126070 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsnkf"] Jun 08 12:14:35.130573 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.130546 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh5fx\" (UniqueName: \"kubernetes.io/projected/43f7f125-2885-4477-8a65-2aa5129121af-kube-api-access-bh5fx\") pod \"kuadrant-operator-controller-manager-86878c769f-tsnkf\" (UID: \"43f7f125-2885-4477-8a65-2aa5129121af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsnkf" Jun 08 12:14:35.130740 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.130595 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/43f7f125-2885-4477-8a65-2aa5129121af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tsnkf\" (UID: \"43f7f125-2885-4477-8a65-2aa5129121af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsnkf" Jun 08 12:14:35.134160 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.134140 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-424h9"] Jun 08 12:14:35.134598 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.134579 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9417106d-e0ec-49f8-8311-51a015051354" containerName="manager" Jun 08 12:14:35.134695 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.134600 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9417106d-e0ec-49f8-8311-51a015051354" containerName="manager" Jun 08 12:14:35.134751 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.134704 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9417106d-e0ec-49f8-8311-51a015051354" containerName="manager" Jun 08 12:14:35.137662 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.137643 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-424h9" Jun 08 12:14:35.145185 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.145163 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h9lzj"] Jun 08 12:14:35.148720 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.148680 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h9lzj" Jun 08 12:14:35.149956 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:14:35.149925 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-npgp4\" is forbidden: User \"system:node:ip-10-0-133-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-35.ec2.internal' and this object" podUID="d3bd0918-ef58-4dbb-98a9-7cbd6d083997" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npgp4" Jun 08 12:14:35.167512 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.167481 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-424h9"] Jun 08 12:14:35.169469 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.169440 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h9lzj"] Jun 08 12:14:35.182888 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:14:35.182850 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pm4jf\" is forbidden: User \"system:node:ip-10-0-133-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-35.ec2.internal' and this object" podUID="9417106d-e0ec-49f8-8311-51a015051354" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pm4jf" Jun 08 12:14:35.231474 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.231440 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/27ac8c97-97fe-43b6-a55a-05cd7fbce76f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-424h9\" (UID: \"27ac8c97-97fe-43b6-a55a-05cd7fbce76f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-424h9" Jun 08 12:14:35.231597 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.231495 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh5fx\" (UniqueName: \"kubernetes.io/projected/43f7f125-2885-4477-8a65-2aa5129121af-kube-api-access-bh5fx\") pod \"kuadrant-operator-controller-manager-86878c769f-tsnkf\" (UID: \"43f7f125-2885-4477-8a65-2aa5129121af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsnkf" Jun 08 12:14:35.231597 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.231557 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcm8l\" (UniqueName: \"kubernetes.io/projected/b5f0b196-7098-495e-ab97-c71a7adb836d-kube-api-access-zcm8l\") pod \"limitador-operator-controller-manager-859d7b78bd-h9lzj\" (UID: \"b5f0b196-7098-495e-ab97-c71a7adb836d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h9lzj" Jun 08 12:14:35.231597 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.231589 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/43f7f125-2885-4477-8a65-2aa5129121af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tsnkf\" (UID: \"43f7f125-2885-4477-8a65-2aa5129121af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsnkf" Jun 08 12:14:35.231733 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.231614 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwmjt\" (UniqueName: \"kubernetes.io/projected/27ac8c97-97fe-43b6-a55a-05cd7fbce76f-kube-api-access-cwmjt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-424h9\" (UID: \"27ac8c97-97fe-43b6-a55a-05cd7fbce76f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-424h9" Jun 08 12:14:35.231982 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.231965 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/43f7f125-2885-4477-8a65-2aa5129121af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tsnkf\" (UID: \"43f7f125-2885-4477-8a65-2aa5129121af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsnkf" Jun 08 12:14:35.243092 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.243059 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh5fx\" (UniqueName: \"kubernetes.io/projected/43f7f125-2885-4477-8a65-2aa5129121af-kube-api-access-bh5fx\") pod \"kuadrant-operator-controller-manager-86878c769f-tsnkf\" (UID: \"43f7f125-2885-4477-8a65-2aa5129121af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsnkf" Jun 08 12:14:35.332556 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.332526 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/27ac8c97-97fe-43b6-a55a-05cd7fbce76f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-424h9\" (UID: \"27ac8c97-97fe-43b6-a55a-05cd7fbce76f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-424h9" Jun 08 12:14:35.332720 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.332585 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcm8l\" (UniqueName: \"kubernetes.io/projected/b5f0b196-7098-495e-ab97-c71a7adb836d-kube-api-access-zcm8l\") pod \"limitador-operator-controller-manager-859d7b78bd-h9lzj\" (UID: \"b5f0b196-7098-495e-ab97-c71a7adb836d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h9lzj" Jun 08 12:14:35.332720 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.332608 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwmjt\" (UniqueName: \"kubernetes.io/projected/27ac8c97-97fe-43b6-a55a-05cd7fbce76f-kube-api-access-cwmjt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-424h9\" (UID: \"27ac8c97-97fe-43b6-a55a-05cd7fbce76f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-424h9" Jun 08 12:14:35.332987 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.332963 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/27ac8c97-97fe-43b6-a55a-05cd7fbce76f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-424h9\" (UID: \"27ac8c97-97fe-43b6-a55a-05cd7fbce76f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-424h9" Jun 08 12:14:35.338413 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.338389 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npgp4" Jun 08 12:14:35.340191 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:14:35.340159 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pm4jf\" is forbidden: User \"system:node:ip-10-0-133-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-35.ec2.internal' and this object" podUID="9417106d-e0ec-49f8-8311-51a015051354" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pm4jf" Jun 08 12:14:35.347291 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.347244 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcm8l\" (UniqueName: \"kubernetes.io/projected/b5f0b196-7098-495e-ab97-c71a7adb836d-kube-api-access-zcm8l\") pod \"limitador-operator-controller-manager-859d7b78bd-h9lzj\" (UID: \"b5f0b196-7098-495e-ab97-c71a7adb836d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h9lzj" Jun 08 12:14:35.347729 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.347710 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwmjt\" (UniqueName: \"kubernetes.io/projected/27ac8c97-97fe-43b6-a55a-05cd7fbce76f-kube-api-access-cwmjt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-424h9\" (UID: \"27ac8c97-97fe-43b6-a55a-05cd7fbce76f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-424h9" Jun 08 12:14:35.352416 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.352397 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zq5gg" Jun 08 12:14:35.354429 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:14:35.354291 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pm4jf\" is forbidden: User \"system:node:ip-10-0-133-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-35.ec2.internal' and this object" podUID="9417106d-e0ec-49f8-8311-51a015051354" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pm4jf" Jun 08 12:14:35.358513 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.358498 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pm4jf" Jun 08 12:14:35.383543 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:14:35.383496 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pm4jf\" is forbidden: User \"system:node:ip-10-0-133-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-35.ec2.internal' and this object" podUID="9417106d-e0ec-49f8-8311-51a015051354" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pm4jf" Jun 08 12:14:35.404812 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.404785 2565 generic.go:356] "Generic (PLEG): container finished" podID="d3bd0918-ef58-4dbb-98a9-7cbd6d083997" containerID="08e070e43513a87e9a91d24bc06bc526a1bd6abec8e21ba607730e53211b5951" exitCode=0 Jun 08 12:14:35.404942 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.404833 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npgp4" Jun 08 12:14:35.404942 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.404879 2565 scope.go:117] "RemoveContainer" containerID="08e070e43513a87e9a91d24bc06bc526a1bd6abec8e21ba607730e53211b5951" Jun 08 12:14:35.406397 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.406371 2565 generic.go:356] "Generic (PLEG): container finished" podID="9417106d-e0ec-49f8-8311-51a015051354" containerID="fe5bfbb9260d2c26e9b7f366ae2722d1246566954be73d3dc3bbb9bb92be380d" exitCode=0 Jun 08 12:14:35.406517 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.406483 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pm4jf" Jun 08 12:14:35.406610 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:14:35.406581 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pm4jf\" is forbidden: User \"system:node:ip-10-0-133-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-35.ec2.internal' and this object" podUID="9417106d-e0ec-49f8-8311-51a015051354" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pm4jf" Jun 08 12:14:35.408170 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:14:35.408136 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pm4jf\" is forbidden: User \"system:node:ip-10-0-133-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-35.ec2.internal' and this object" podUID="9417106d-e0ec-49f8-8311-51a015051354" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pm4jf" Jun 08 12:14:35.413691 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.413663 2565 scope.go:117] "RemoveContainer" containerID="08e070e43513a87e9a91d24bc06bc526a1bd6abec8e21ba607730e53211b5951" Jun 08 12:14:35.413953 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:14:35.413935 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08e070e43513a87e9a91d24bc06bc526a1bd6abec8e21ba607730e53211b5951\": container with ID starting with 08e070e43513a87e9a91d24bc06bc526a1bd6abec8e21ba607730e53211b5951 not found: ID does not exist" containerID="08e070e43513a87e9a91d24bc06bc526a1bd6abec8e21ba607730e53211b5951" Jun 08 12:14:35.414027 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.413958 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08e070e43513a87e9a91d24bc06bc526a1bd6abec8e21ba607730e53211b5951"} err="failed to get container status \"08e070e43513a87e9a91d24bc06bc526a1bd6abec8e21ba607730e53211b5951\": rpc error: code = NotFound desc = could not find container \"08e070e43513a87e9a91d24bc06bc526a1bd6abec8e21ba607730e53211b5951\": container with ID starting with 08e070e43513a87e9a91d24bc06bc526a1bd6abec8e21ba607730e53211b5951 not found: ID does not exist" Jun 08 12:14:35.414027 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.413973 2565 scope.go:117] "RemoveContainer" containerID="fe5bfbb9260d2c26e9b7f366ae2722d1246566954be73d3dc3bbb9bb92be380d" Jun 08 12:14:35.422031 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.422010 2565 scope.go:117] "RemoveContainer" containerID="fe5bfbb9260d2c26e9b7f366ae2722d1246566954be73d3dc3bbb9bb92be380d" Jun 08 12:14:35.422275 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:14:35.422258 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe5bfbb9260d2c26e9b7f366ae2722d1246566954be73d3dc3bbb9bb92be380d\": container with ID starting with fe5bfbb9260d2c26e9b7f366ae2722d1246566954be73d3dc3bbb9bb92be380d not found: ID does not exist" containerID="fe5bfbb9260d2c26e9b7f366ae2722d1246566954be73d3dc3bbb9bb92be380d" Jun 08 12:14:35.422417 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.422280 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe5bfbb9260d2c26e9b7f366ae2722d1246566954be73d3dc3bbb9bb92be380d"} err="failed to get container status \"fe5bfbb9260d2c26e9b7f366ae2722d1246566954be73d3dc3bbb9bb92be380d\": rpc error: code = NotFound desc = could not find container \"fe5bfbb9260d2c26e9b7f366ae2722d1246566954be73d3dc3bbb9bb92be380d\": container with ID starting with fe5bfbb9260d2c26e9b7f366ae2722d1246566954be73d3dc3bbb9bb92be380d not found: ID does not exist" Jun 08 12:14:35.433737 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.433716 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krgtx\" (UniqueName: \"kubernetes.io/projected/d3bd0918-ef58-4dbb-98a9-7cbd6d083997-kube-api-access-krgtx\") pod \"d3bd0918-ef58-4dbb-98a9-7cbd6d083997\" (UID: \"d3bd0918-ef58-4dbb-98a9-7cbd6d083997\") " Jun 08 12:14:35.433841 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.433765 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3bd0918-ef58-4dbb-98a9-7cbd6d083997-extensions-socket-volume\") pod \"d3bd0918-ef58-4dbb-98a9-7cbd6d083997\" (UID: \"d3bd0918-ef58-4dbb-98a9-7cbd6d083997\") " Jun 08 12:14:35.433903 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.433851 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c76hn\" (UniqueName: \"kubernetes.io/projected/9417106d-e0ec-49f8-8311-51a015051354-kube-api-access-c76hn\") pod \"9417106d-e0ec-49f8-8311-51a015051354\" (UID: \"9417106d-e0ec-49f8-8311-51a015051354\") " Jun 08 12:14:35.434395 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.434356 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3bd0918-ef58-4dbb-98a9-7cbd6d083997-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d3bd0918-ef58-4dbb-98a9-7cbd6d083997" (UID: "d3bd0918-ef58-4dbb-98a9-7cbd6d083997"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:14:35.435698 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.435668 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3bd0918-ef58-4dbb-98a9-7cbd6d083997-kube-api-access-krgtx" (OuterVolumeSpecName: "kube-api-access-krgtx") pod "d3bd0918-ef58-4dbb-98a9-7cbd6d083997" (UID: "d3bd0918-ef58-4dbb-98a9-7cbd6d083997"). InnerVolumeSpecName "kube-api-access-krgtx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:14:35.435880 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.435860 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9417106d-e0ec-49f8-8311-51a015051354-kube-api-access-c76hn" (OuterVolumeSpecName: "kube-api-access-c76hn") pod "9417106d-e0ec-49f8-8311-51a015051354" (UID: "9417106d-e0ec-49f8-8311-51a015051354"). InnerVolumeSpecName "kube-api-access-c76hn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:14:35.493934 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.493901 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsnkf" Jun 08 12:14:35.500269 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.500250 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-424h9" Jun 08 12:14:35.507237 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.507214 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h9lzj" Jun 08 12:14:35.534956 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.534874 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3bd0918-ef58-4dbb-98a9-7cbd6d083997-extensions-socket-volume\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:14:35.534956 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.534903 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c76hn\" (UniqueName: \"kubernetes.io/projected/9417106d-e0ec-49f8-8311-51a015051354-kube-api-access-c76hn\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:14:35.534956 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.534914 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krgtx\" (UniqueName: \"kubernetes.io/projected/d3bd0918-ef58-4dbb-98a9-7cbd6d083997-kube-api-access-krgtx\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:14:35.654678 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.654646 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsnkf"] Jun 08 12:14:35.658356 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:14:35.658300 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43f7f125_2885_4477_8a65_2aa5129121af.slice/crio-b32fbf3b134137f3ba77d3719527b1643f2539215ba91d9e7073648d6198b826 WatchSource:0}: Error finding container b32fbf3b134137f3ba77d3719527b1643f2539215ba91d9e7073648d6198b826: Status 404 returned error can't find the container with id b32fbf3b134137f3ba77d3719527b1643f2539215ba91d9e7073648d6198b826 Jun 08 12:14:35.675353 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.674816 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-424h9"] Jun 08 12:14:35.681223 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:14:35.681190 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27ac8c97_97fe_43b6_a55a_05cd7fbce76f.slice/crio-901c1b28b426d1bfcb6767ab6941f6f8fa1b90072c359bc391e9a58cdafdf597 WatchSource:0}: Error finding container 901c1b28b426d1bfcb6767ab6941f6f8fa1b90072c359bc391e9a58cdafdf597: Status 404 returned error can't find the container with id 901c1b28b426d1bfcb6767ab6941f6f8fa1b90072c359bc391e9a58cdafdf597 Jun 08 12:14:35.691390 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:35.691360 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h9lzj"] Jun 08 12:14:35.700620 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:14:35.700583 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5f0b196_7098_495e_ab97_c71a7adb836d.slice/crio-73e41a61dd8aba58215ed23e5d324c6760bf1eb834a9700b4297821ff519f87b WatchSource:0}: Error finding container 73e41a61dd8aba58215ed23e5d324c6760bf1eb834a9700b4297821ff519f87b: Status 404 returned error can't find the container with id 73e41a61dd8aba58215ed23e5d324c6760bf1eb834a9700b4297821ff519f87b Jun 08 12:14:35.722816 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:14:35.722779 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pm4jf\" is forbidden: User \"system:node:ip-10-0-133-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-35.ec2.internal' and this object" podUID="9417106d-e0ec-49f8-8311-51a015051354" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pm4jf" Jun 08 12:14:35.724478 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:14:35.724451 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pm4jf\" is forbidden: User \"system:node:ip-10-0-133-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-35.ec2.internal' and this object" podUID="9417106d-e0ec-49f8-8311-51a015051354" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pm4jf" Jun 08 12:14:36.413963 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:36.413863 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-424h9" event={"ID":"27ac8c97-97fe-43b6-a55a-05cd7fbce76f","Type":"ContainerStarted","Data":"564e005496f7077821f8d5fad9f446d5a105360ef0257f28b8e719e34a0cee18"} Jun 08 12:14:36.413963 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:36.413924 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-424h9" event={"ID":"27ac8c97-97fe-43b6-a55a-05cd7fbce76f","Type":"ContainerStarted","Data":"901c1b28b426d1bfcb6767ab6941f6f8fa1b90072c359bc391e9a58cdafdf597"} Jun 08 12:14:36.414198 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:36.413976 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-424h9" Jun 08 12:14:36.415504 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:36.415472 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h9lzj" event={"ID":"b5f0b196-7098-495e-ab97-c71a7adb836d","Type":"ContainerStarted","Data":"2fb756294c64bb6f202e38c2b82ab8ce868cfb36eccee140ec66bef7b2ba4419"} Jun 08 12:14:36.415643 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:14:36.415503 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pm4jf\" is forbidden: User \"system:node:ip-10-0-133-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-35.ec2.internal' and this object" podUID="9417106d-e0ec-49f8-8311-51a015051354" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pm4jf" Jun 08 12:14:36.415643 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:36.415520 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h9lzj" event={"ID":"b5f0b196-7098-495e-ab97-c71a7adb836d","Type":"ContainerStarted","Data":"73e41a61dd8aba58215ed23e5d324c6760bf1eb834a9700b4297821ff519f87b"} Jun 08 12:14:36.415643 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:36.415570 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h9lzj" Jun 08 12:14:36.417767 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:36.417744 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsnkf" event={"ID":"43f7f125-2885-4477-8a65-2aa5129121af","Type":"ContainerStarted","Data":"dc316e1915e578527305104072ad3278efa25a486d2e7596c4af1547dc2b501e"} Jun 08 12:14:36.417906 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:36.417786 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsnkf" event={"ID":"43f7f125-2885-4477-8a65-2aa5129121af","Type":"ContainerStarted","Data":"b32fbf3b134137f3ba77d3719527b1643f2539215ba91d9e7073648d6198b826"} Jun 08 12:14:36.417906 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:36.417860 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsnkf" Jun 08 12:14:36.438455 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:14:36.438328 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pm4jf\" is forbidden: User \"system:node:ip-10-0-133-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-35.ec2.internal' and this object" podUID="9417106d-e0ec-49f8-8311-51a015051354" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pm4jf" Jun 08 12:14:36.438596 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:36.438542 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-424h9" podStartSLOduration=1.438523 podStartE2EDuration="1.438523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:14:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:14:36.436504259 +0000 UTC m=+597.764852919" watchObservedRunningTime="2026-06-08 12:14:36.438523 +0000 UTC m=+597.766871651" Jun 08 12:14:36.463274 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:36.463223 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h9lzj" podStartSLOduration=1.463208841 podStartE2EDuration="1.463208841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:14:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:14:36.460730904 +0000 UTC m=+597.789079555" watchObservedRunningTime="2026-06-08 12:14:36.463208841 +0000 UTC m=+597.791557482" Jun 08 12:14:36.484253 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:36.484210 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsnkf" podStartSLOduration=1.4841942000000001 podStartE2EDuration="1.4841942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:14:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:14:36.483046651 +0000 UTC m=+597.811395302" watchObservedRunningTime="2026-06-08 12:14:36.4841942 +0000 UTC m=+597.812542849" Jun 08 12:14:37.127192 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:37.127156 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9417106d-e0ec-49f8-8311-51a015051354" path="/var/lib/kubelet/pods/9417106d-e0ec-49f8-8311-51a015051354/volumes" Jun 08 12:14:37.127723 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:37.127703 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3bd0918-ef58-4dbb-98a9-7cbd6d083997" path="/var/lib/kubelet/pods/d3bd0918-ef58-4dbb-98a9-7cbd6d083997/volumes" Jun 08 12:14:37.138748 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:37.138720 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:37.228237 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:37.228209 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:39.112935 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:39.112913 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94jtj_c96f0d0b-bdfb-42c4-a74f-183f2cf4876f/ovn-acl-logging/0.log" Jun 08 12:14:39.113263 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:39.112913 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94jtj_c96f0d0b-bdfb-42c4-a74f-183f2cf4876f/ovn-acl-logging/0.log" Jun 08 12:14:41.272392 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:41.272362 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:41.406962 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:41.406932 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:42.145610 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:42.145575 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:43.574452 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:43.574420 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:43.674380 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:43.674326 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:44.492171 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:44.492141 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:47.425577 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:47.425547 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsnkf" Jun 08 12:14:47.425989 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:47.425614 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h9lzj" Jun 08 12:14:47.425989 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:47.425729 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-424h9" Jun 08 12:14:47.497820 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:47.497783 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-424h9"] Jun 08 12:14:47.498032 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:47.498004 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-424h9" podUID="27ac8c97-97fe-43b6-a55a-05cd7fbce76f" containerName="manager" containerID="cri-o://564e005496f7077821f8d5fad9f446d5a105360ef0257f28b8e719e34a0cee18" gracePeriod=10 Jun 08 12:14:47.740798 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:47.740773 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-424h9" Jun 08 12:14:47.845131 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:47.845086 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwmjt\" (UniqueName: \"kubernetes.io/projected/27ac8c97-97fe-43b6-a55a-05cd7fbce76f-kube-api-access-cwmjt\") pod \"27ac8c97-97fe-43b6-a55a-05cd7fbce76f\" (UID: \"27ac8c97-97fe-43b6-a55a-05cd7fbce76f\") " Jun 08 12:14:47.845299 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:47.845149 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/27ac8c97-97fe-43b6-a55a-05cd7fbce76f-extensions-socket-volume\") pod \"27ac8c97-97fe-43b6-a55a-05cd7fbce76f\" (UID: \"27ac8c97-97fe-43b6-a55a-05cd7fbce76f\") " Jun 08 12:14:47.845544 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:47.845521 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27ac8c97-97fe-43b6-a55a-05cd7fbce76f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "27ac8c97-97fe-43b6-a55a-05cd7fbce76f" (UID: "27ac8c97-97fe-43b6-a55a-05cd7fbce76f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:14:47.847198 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:47.847175 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27ac8c97-97fe-43b6-a55a-05cd7fbce76f-kube-api-access-cwmjt" (OuterVolumeSpecName: "kube-api-access-cwmjt") pod "27ac8c97-97fe-43b6-a55a-05cd7fbce76f" (UID: "27ac8c97-97fe-43b6-a55a-05cd7fbce76f"). InnerVolumeSpecName "kube-api-access-cwmjt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:14:47.946252 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:47.946213 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwmjt\" (UniqueName: \"kubernetes.io/projected/27ac8c97-97fe-43b6-a55a-05cd7fbce76f-kube-api-access-cwmjt\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:14:47.946252 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:47.946244 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/27ac8c97-97fe-43b6-a55a-05cd7fbce76f-extensions-socket-volume\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:14:48.477526 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:48.477493 2565 generic.go:356] "Generic (PLEG): container finished" podID="27ac8c97-97fe-43b6-a55a-05cd7fbce76f" containerID="564e005496f7077821f8d5fad9f446d5a105360ef0257f28b8e719e34a0cee18" exitCode=0 Jun 08 12:14:48.478000 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:48.477559 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-424h9" Jun 08 12:14:48.478000 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:48.477584 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-424h9" event={"ID":"27ac8c97-97fe-43b6-a55a-05cd7fbce76f","Type":"ContainerDied","Data":"564e005496f7077821f8d5fad9f446d5a105360ef0257f28b8e719e34a0cee18"} Jun 08 12:14:48.478000 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:48.477645 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-424h9" event={"ID":"27ac8c97-97fe-43b6-a55a-05cd7fbce76f","Type":"ContainerDied","Data":"901c1b28b426d1bfcb6767ab6941f6f8fa1b90072c359bc391e9a58cdafdf597"} Jun 08 12:14:48.478000 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:48.477668 2565 scope.go:117] "RemoveContainer" containerID="564e005496f7077821f8d5fad9f446d5a105360ef0257f28b8e719e34a0cee18" Jun 08 12:14:48.486711 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:48.486693 2565 scope.go:117] "RemoveContainer" containerID="564e005496f7077821f8d5fad9f446d5a105360ef0257f28b8e719e34a0cee18" Jun 08 12:14:48.486941 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:14:48.486925 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"564e005496f7077821f8d5fad9f446d5a105360ef0257f28b8e719e34a0cee18\": container with ID starting with 564e005496f7077821f8d5fad9f446d5a105360ef0257f28b8e719e34a0cee18 not found: ID does not exist" containerID="564e005496f7077821f8d5fad9f446d5a105360ef0257f28b8e719e34a0cee18" Jun 08 12:14:48.487156 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:48.486947 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"564e005496f7077821f8d5fad9f446d5a105360ef0257f28b8e719e34a0cee18"} err="failed to get container status \"564e005496f7077821f8d5fad9f446d5a105360ef0257f28b8e719e34a0cee18\": rpc error: code = NotFound desc = could not find container \"564e005496f7077821f8d5fad9f446d5a105360ef0257f28b8e719e34a0cee18\": container with ID starting with 564e005496f7077821f8d5fad9f446d5a105360ef0257f28b8e719e34a0cee18 not found: ID does not exist" Jun 08 12:14:48.503388 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:48.503358 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-424h9"] Jun 08 12:14:48.508586 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:48.508565 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-424h9"] Jun 08 12:14:49.123922 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:49.123891 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27ac8c97-97fe-43b6-a55a-05cd7fbce76f" path="/var/lib/kubelet/pods/27ac8c97-97fe-43b6-a55a-05cd7fbce76f/volumes" Jun 08 12:14:52.266980 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:52.266951 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:52.370899 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:52.370866 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:52.475081 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:52.475052 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:54.712192 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:54.712158 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:54.808716 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:54.808687 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:59.071844 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:59.071767 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:59.174693 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:59.174658 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:59.271080 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:14:59.271050 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:01.876847 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:01.876809 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:01.941696 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:01.941657 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:03.764895 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.764866 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx"] Jun 08 12:15:03.765286 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.765241 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27ac8c97-97fe-43b6-a55a-05cd7fbce76f" containerName="manager" Jun 08 12:15:03.765286 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.765254 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="27ac8c97-97fe-43b6-a55a-05cd7fbce76f" containerName="manager" Jun 08 12:15:03.765408 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.765342 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="27ac8c97-97fe-43b6-a55a-05cd7fbce76f" containerName="manager" Jun 08 12:15:03.767512 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.767493 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:03.769450 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.769430 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-xglgb\"" Jun 08 12:15:03.783755 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.783731 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx"] Jun 08 12:15:03.805625 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.805599 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:03.892937 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.892905 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a2144c9-373e-405d-a9a5-a56c4f31d5cf-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-lzvtx\" (UID: \"4a2144c9-373e-405d-a9a5-a56c4f31d5cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:03.893139 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.892939 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vzpz\" (UniqueName: \"kubernetes.io/projected/4a2144c9-373e-405d-a9a5-a56c4f31d5cf-kube-api-access-8vzpz\") pod \"maas-default-gateway-openshift-default-687ff6996-lzvtx\" (UID: \"4a2144c9-373e-405d-a9a5-a56c4f31d5cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:03.893139 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.893062 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a2144c9-373e-405d-a9a5-a56c4f31d5cf-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-lzvtx\" (UID: \"4a2144c9-373e-405d-a9a5-a56c4f31d5cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:03.893139 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.893109 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a2144c9-373e-405d-a9a5-a56c4f31d5cf-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-lzvtx\" (UID: \"4a2144c9-373e-405d-a9a5-a56c4f31d5cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:03.893364 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.893155 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a2144c9-373e-405d-a9a5-a56c4f31d5cf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-lzvtx\" (UID: \"4a2144c9-373e-405d-a9a5-a56c4f31d5cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:03.893364 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.893224 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a2144c9-373e-405d-a9a5-a56c4f31d5cf-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-lzvtx\" (UID: \"4a2144c9-373e-405d-a9a5-a56c4f31d5cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:03.893364 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.893252 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a2144c9-373e-405d-a9a5-a56c4f31d5cf-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-lzvtx\" (UID: \"4a2144c9-373e-405d-a9a5-a56c4f31d5cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:03.893364 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.893299 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a2144c9-373e-405d-a9a5-a56c4f31d5cf-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-lzvtx\" (UID: \"4a2144c9-373e-405d-a9a5-a56c4f31d5cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:03.893542 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.893399 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a2144c9-373e-405d-a9a5-a56c4f31d5cf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-lzvtx\" (UID: \"4a2144c9-373e-405d-a9a5-a56c4f31d5cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:03.904403 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.904379 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:03.994118 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.994087 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a2144c9-373e-405d-a9a5-a56c4f31d5cf-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-lzvtx\" (UID: \"4a2144c9-373e-405d-a9a5-a56c4f31d5cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:03.994118 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.994120 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a2144c9-373e-405d-a9a5-a56c4f31d5cf-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-lzvtx\" (UID: \"4a2144c9-373e-405d-a9a5-a56c4f31d5cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:03.994389 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.994140 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a2144c9-373e-405d-a9a5-a56c4f31d5cf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-lzvtx\" (UID: \"4a2144c9-373e-405d-a9a5-a56c4f31d5cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:03.994389 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.994171 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a2144c9-373e-405d-a9a5-a56c4f31d5cf-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-lzvtx\" (UID: \"4a2144c9-373e-405d-a9a5-a56c4f31d5cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:03.994389 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.994246 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a2144c9-373e-405d-a9a5-a56c4f31d5cf-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-lzvtx\" (UID: \"4a2144c9-373e-405d-a9a5-a56c4f31d5cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:03.994389 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.994290 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a2144c9-373e-405d-a9a5-a56c4f31d5cf-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-lzvtx\" (UID: \"4a2144c9-373e-405d-a9a5-a56c4f31d5cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:03.994389 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.994387 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a2144c9-373e-405d-a9a5-a56c4f31d5cf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-lzvtx\" (UID: \"4a2144c9-373e-405d-a9a5-a56c4f31d5cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:03.994765 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.994420 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a2144c9-373e-405d-a9a5-a56c4f31d5cf-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-lzvtx\" (UID: \"4a2144c9-373e-405d-a9a5-a56c4f31d5cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:03.994765 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.994448 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vzpz\" (UniqueName: \"kubernetes.io/projected/4a2144c9-373e-405d-a9a5-a56c4f31d5cf-kube-api-access-8vzpz\") pod \"maas-default-gateway-openshift-default-687ff6996-lzvtx\" (UID: \"4a2144c9-373e-405d-a9a5-a56c4f31d5cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:03.994765 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.994578 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a2144c9-373e-405d-a9a5-a56c4f31d5cf-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-lzvtx\" (UID: \"4a2144c9-373e-405d-a9a5-a56c4f31d5cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:03.994765 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.994624 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a2144c9-373e-405d-a9a5-a56c4f31d5cf-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-lzvtx\" (UID: \"4a2144c9-373e-405d-a9a5-a56c4f31d5cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:03.994945 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.994847 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a2144c9-373e-405d-a9a5-a56c4f31d5cf-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-lzvtx\" (UID: \"4a2144c9-373e-405d-a9a5-a56c4f31d5cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:03.994945 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.994878 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a2144c9-373e-405d-a9a5-a56c4f31d5cf-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-lzvtx\" (UID: \"4a2144c9-373e-405d-a9a5-a56c4f31d5cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:03.995171 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.995146 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a2144c9-373e-405d-a9a5-a56c4f31d5cf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-lzvtx\" (UID: \"4a2144c9-373e-405d-a9a5-a56c4f31d5cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:03.996592 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.996573 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a2144c9-373e-405d-a9a5-a56c4f31d5cf-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-lzvtx\" (UID: \"4a2144c9-373e-405d-a9a5-a56c4f31d5cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:03.996706 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:03.996689 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a2144c9-373e-405d-a9a5-a56c4f31d5cf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-lzvtx\" (UID: \"4a2144c9-373e-405d-a9a5-a56c4f31d5cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:04.005165 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:04.005115 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a2144c9-373e-405d-a9a5-a56c4f31d5cf-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-lzvtx\" (UID: \"4a2144c9-373e-405d-a9a5-a56c4f31d5cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:04.006325 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:04.006287 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vzpz\" (UniqueName: \"kubernetes.io/projected/4a2144c9-373e-405d-a9a5-a56c4f31d5cf-kube-api-access-8vzpz\") pod \"maas-default-gateway-openshift-default-687ff6996-lzvtx\" (UID: \"4a2144c9-373e-405d-a9a5-a56c4f31d5cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:04.077595 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:04.077566 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:04.211836 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:04.211811 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx"] Jun 08 12:15:04.214053 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:15:04.214020 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a2144c9_373e_405d_a9a5_a56c4f31d5cf.slice/crio-da7e0ff2840904715b7e03f0d4cd903570e1a9eeca75bac8c0d9ad12295fad8c WatchSource:0}: Error finding container da7e0ff2840904715b7e03f0d4cd903570e1a9eeca75bac8c0d9ad12295fad8c: Status 404 returned error can't find the container with id da7e0ff2840904715b7e03f0d4cd903570e1a9eeca75bac8c0d9ad12295fad8c Jun 08 12:15:04.216061 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:04.216024 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 12:15:04.216140 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:04.216096 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 12:15:04.216140 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:04.216123 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 12:15:04.557788 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:04.557749 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" event={"ID":"4a2144c9-373e-405d-a9a5-a56c4f31d5cf","Type":"ContainerStarted","Data":"bcae963a6e01dff5ca8017c020258433524f08583708ec60a410596b17ffe86b"} Jun 08 12:15:04.557947 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:04.557820 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" event={"ID":"4a2144c9-373e-405d-a9a5-a56c4f31d5cf","Type":"ContainerStarted","Data":"da7e0ff2840904715b7e03f0d4cd903570e1a9eeca75bac8c0d9ad12295fad8c"} Jun 08 12:15:04.578862 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:04.578807 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" podStartSLOduration=1.578790173 podStartE2EDuration="1.578790173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:15:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:15:04.578569417 +0000 UTC m=+625.906918059" watchObservedRunningTime="2026-06-08 12:15:04.578790173 +0000 UTC m=+625.907138823" Jun 08 12:15:05.078354 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:05.078297 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:05.083727 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:05.083705 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:05.563105 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:05.563075 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:05.564133 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:05.564114 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:15:07.774378 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:07.774291 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:08.149283 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:08.149251 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:08.296102 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:08.296060 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:15:08.299479 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:08.299461 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dm9tk" Jun 08 12:15:08.305331 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:08.305280 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 08 12:15:08.305514 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:08.305494 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mm794\"" Jun 08 12:15:08.313931 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:08.313908 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:15:08.325469 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:08.325442 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:08.366204 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:08.366173 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:15:08.411638 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:08.411522 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:08.437807 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:08.437778 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0930ffe6-00e0-433d-8b48-b757d2651147-config-file\") pod \"limitador-limitador-54d6d988d5-dm9tk\" (UID: \"0930ffe6-00e0-433d-8b48-b757d2651147\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dm9tk" Jun 08 12:15:08.437999 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:08.437821 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfrcp\" (UniqueName: \"kubernetes.io/projected/0930ffe6-00e0-433d-8b48-b757d2651147-kube-api-access-rfrcp\") pod \"limitador-limitador-54d6d988d5-dm9tk\" (UID: \"0930ffe6-00e0-433d-8b48-b757d2651147\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dm9tk" Jun 08 12:15:08.539201 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:08.539167 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfrcp\" (UniqueName: \"kubernetes.io/projected/0930ffe6-00e0-433d-8b48-b757d2651147-kube-api-access-rfrcp\") pod \"limitador-limitador-54d6d988d5-dm9tk\" (UID: \"0930ffe6-00e0-433d-8b48-b757d2651147\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dm9tk" Jun 08 12:15:08.539371 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:08.539291 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0930ffe6-00e0-433d-8b48-b757d2651147-config-file\") pod \"limitador-limitador-54d6d988d5-dm9tk\" (UID: \"0930ffe6-00e0-433d-8b48-b757d2651147\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dm9tk" Jun 08 12:15:08.539894 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:08.539874 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0930ffe6-00e0-433d-8b48-b757d2651147-config-file\") pod \"limitador-limitador-54d6d988d5-dm9tk\" (UID: \"0930ffe6-00e0-433d-8b48-b757d2651147\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dm9tk" Jun 08 12:15:08.554722 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:08.554699 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfrcp\" (UniqueName: \"kubernetes.io/projected/0930ffe6-00e0-433d-8b48-b757d2651147-kube-api-access-rfrcp\") pod \"limitador-limitador-54d6d988d5-dm9tk\" (UID: \"0930ffe6-00e0-433d-8b48-b757d2651147\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dm9tk" Jun 08 12:15:08.610802 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:08.610771 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dm9tk" Jun 08 12:15:08.750771 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:08.750749 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:15:08.753467 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:15:08.753436 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0930ffe6_00e0_433d_8b48_b757d2651147.slice/crio-44568b0285e38d37c2fd88258a2238ba6ccd218f963152920776dcf2ba77d451 WatchSource:0}: Error finding container 44568b0285e38d37c2fd88258a2238ba6ccd218f963152920776dcf2ba77d451: Status 404 returned error can't find the container with id 44568b0285e38d37c2fd88258a2238ba6ccd218f963152920776dcf2ba77d451 Jun 08 12:15:09.065641 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:09.065617 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:09.157526 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:09.157484 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:09.592439 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:09.592398 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dm9tk" event={"ID":"0930ffe6-00e0-433d-8b48-b757d2651147","Type":"ContainerStarted","Data":"44568b0285e38d37c2fd88258a2238ba6ccd218f963152920776dcf2ba77d451"} Jun 08 12:15:11.099012 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:11.098974 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:11.200730 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:11.200688 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:11.300217 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:11.300196 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:11.604250 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:11.604211 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dm9tk" event={"ID":"0930ffe6-00e0-433d-8b48-b757d2651147","Type":"ContainerStarted","Data":"cfea0b78dc0f9cb778892e802bee678acaaaafba9da18a3e09bc995d3b91f6b0"} Jun 08 12:15:11.604437 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:11.604409 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dm9tk" Jun 08 12:15:11.621103 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:11.621046 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-dm9tk" podStartSLOduration=1.107932164 podStartE2EDuration="3.621032336s" totalImagesPullingTime="2.513100172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:15:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:15:11.620536357 +0000 UTC m=+632.948885008" watchObservedRunningTime="2026-06-08 12:15:11.621032336 +0000 UTC m=+632.949380985" Jun 08 12:15:13.578515 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:13.578484 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:13.671441 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:13.671410 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:22.610060 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:22.610027 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dm9tk" Jun 08 12:15:24.325896 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:24.325855 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:35.667672 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:35.667637 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:35.769199 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:35.769168 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:35.907355 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:15:35.907323 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:16:06.667046 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:16:06.667012 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:16:06.768638 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:16:06.768607 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:16:38.084216 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:16:38.084118 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:16:38.474140 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:16:38.474055 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:16:44.254562 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:16:44.254527 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:16:44.372702 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:16:44.372669 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:16:44.534614 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:16:44.534534 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:16:44.702556 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:16:44.702527 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:16:47.932732 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:16:47.932704 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:16:48.066540 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:16:48.066499 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:17.783514 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:17.783479 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:17.847902 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:17.847875 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5499cf4f78-7gqjh"] Jun 08 12:17:17.851159 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:17.851143 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5499cf4f78-7gqjh" Jun 08 12:17:17.853695 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:17.853677 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-nw77s\"" Jun 08 12:17:17.853800 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:17.853680 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 08 12:17:17.867505 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:17.867484 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5499cf4f78-7gqjh"] Jun 08 12:17:18.004403 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:18.004367 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9kr9\" (UniqueName: \"kubernetes.io/projected/f7677855-92eb-470c-9ab8-c3234a346e50-kube-api-access-t9kr9\") pod \"maas-api-5499cf4f78-7gqjh\" (UID: \"f7677855-92eb-470c-9ab8-c3234a346e50\") " pod="opendatahub/maas-api-5499cf4f78-7gqjh" Jun 08 12:17:18.004582 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:18.004481 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7677855-92eb-470c-9ab8-c3234a346e50-maas-api-tls\") pod \"maas-api-5499cf4f78-7gqjh\" (UID: \"f7677855-92eb-470c-9ab8-c3234a346e50\") " pod="opendatahub/maas-api-5499cf4f78-7gqjh" Jun 08 12:17:18.105123 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:18.105081 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9kr9\" (UniqueName: \"kubernetes.io/projected/f7677855-92eb-470c-9ab8-c3234a346e50-kube-api-access-t9kr9\") pod \"maas-api-5499cf4f78-7gqjh\" (UID: \"f7677855-92eb-470c-9ab8-c3234a346e50\") " pod="opendatahub/maas-api-5499cf4f78-7gqjh" Jun 08 12:17:18.105295 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:18.105184 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7677855-92eb-470c-9ab8-c3234a346e50-maas-api-tls\") pod \"maas-api-5499cf4f78-7gqjh\" (UID: \"f7677855-92eb-470c-9ab8-c3234a346e50\") " pod="opendatahub/maas-api-5499cf4f78-7gqjh" Jun 08 12:17:18.107621 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:18.107597 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7677855-92eb-470c-9ab8-c3234a346e50-maas-api-tls\") pod \"maas-api-5499cf4f78-7gqjh\" (UID: \"f7677855-92eb-470c-9ab8-c3234a346e50\") " pod="opendatahub/maas-api-5499cf4f78-7gqjh" Jun 08 12:17:18.122122 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:18.122095 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9kr9\" (UniqueName: \"kubernetes.io/projected/f7677855-92eb-470c-9ab8-c3234a346e50-kube-api-access-t9kr9\") pod \"maas-api-5499cf4f78-7gqjh\" (UID: \"f7677855-92eb-470c-9ab8-c3234a346e50\") " pod="opendatahub/maas-api-5499cf4f78-7gqjh" Jun 08 12:17:18.137063 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:18.137026 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:18.160965 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:18.160936 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5499cf4f78-7gqjh" Jun 08 12:17:18.315238 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:18.315211 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5499cf4f78-7gqjh"] Jun 08 12:17:18.316320 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:17:18.316280 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7677855_92eb_470c_9ab8_c3234a346e50.slice/crio-ed99518abaaada188a2e3df22bad205c5ec6c5b510a7ba2bae454827b471301f WatchSource:0}: Error finding container ed99518abaaada188a2e3df22bad205c5ec6c5b510a7ba2bae454827b471301f: Status 404 returned error can't find the container with id ed99518abaaada188a2e3df22bad205c5ec6c5b510a7ba2bae454827b471301f Jun 08 12:17:18.624389 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:18.624362 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:18.764573 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:18.764544 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:19.162146 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:19.162112 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:17:19.199258 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:19.199219 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5499cf4f78-7gqjh" event={"ID":"f7677855-92eb-470c-9ab8-c3234a346e50","Type":"ContainerStarted","Data":"ed99518abaaada188a2e3df22bad205c5ec6c5b510a7ba2bae454827b471301f"} Jun 08 12:17:22.217894 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:22.217851 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5499cf4f78-7gqjh" event={"ID":"f7677855-92eb-470c-9ab8-c3234a346e50","Type":"ContainerStarted","Data":"9acd2d1d833567edba437a6300817b24e5e0f5b18dde226eff6f221c4695df43"} Jun 08 12:17:22.218298 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:22.218041 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5499cf4f78-7gqjh" Jun 08 12:17:22.251594 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:22.251533 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-5499cf4f78-7gqjh" podStartSLOduration=2.391578338 podStartE2EDuration="5.251511599s" totalImagesPullingTime="2.859933261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:17:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:17:22.248640173 +0000 UTC m=+763.576988824" watchObservedRunningTime="2026-06-08 12:17:22.251511599 +0000 UTC m=+763.579860249" Jun 08 12:17:27.250548 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:27.250509 2565 generic.go:356] "Generic (PLEG): container finished" podID="4a2144c9-373e-405d-a9a5-a56c4f31d5cf" containerID="bcae963a6e01dff5ca8017c020258433524f08583708ec60a410596b17ffe86b" exitCode=0 Jun 08 12:17:27.250974 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:27.250585 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" event={"ID":"4a2144c9-373e-405d-a9a5-a56c4f31d5cf","Type":"ContainerDied","Data":"bcae963a6e01dff5ca8017c020258433524f08583708ec60a410596b17ffe86b"} Jun 08 12:17:27.250974 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:27.250954 2565 scope.go:117] "RemoveContainer" containerID="bcae963a6e01dff5ca8017c020258433524f08583708ec60a410596b17ffe86b" Jun 08 12:17:27.251953 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:27.251929 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 12:17:27.252008 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:27.251995 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 12:17:27.252043 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:27.252028 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 12:17:28.227735 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:28.227705 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5499cf4f78-7gqjh" Jun 08 12:17:28.260857 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:28.260801 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" event={"ID":"4a2144c9-373e-405d-a9a5-a56c4f31d5cf","Type":"ContainerStarted","Data":"4b8851074b56dde84a6bf9a17cc60274e45ef218f6c13e2578694fec23386c0b"} Jun 08 12:17:29.078059 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:29.078025 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:17:29.078285 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:29.078264 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-lzvtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jun 08 12:17:29.078365 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:29.078337 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" podUID="4a2144c9-373e-405d-a9a5-a56c4f31d5cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jun 08 12:17:30.078196 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:30.078158 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-lzvtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jun 08 12:17:30.078628 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:30.078214 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" podUID="4a2144c9-373e-405d-a9a5-a56c4f31d5cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jun 08 12:17:31.078544 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:31.078509 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-lzvtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jun 08 12:17:31.078952 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:31.078566 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" podUID="4a2144c9-373e-405d-a9a5-a56c4f31d5cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jun 08 12:17:32.081839 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:32.081811 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:17:32.082229 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:32.082079 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:17:32.082681 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:32.082662 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lzvtx" Jun 08 12:17:43.360096 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:17:43.360063 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:08.378167 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:18:08.378106 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:08.519345 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:18:08.519272 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:43.579348 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:18:43.579299 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:43.973198 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:18:43.973109 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:18:48.658138 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:18:48.658108 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:49.064505 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:18:49.064474 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:18:59.626817 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:18:59.626781 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:00.036416 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:19:00.036328 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:19:08.660210 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:19:08.660168 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:09.221598 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:19:09.221568 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:19:19.434891 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:19:19.434859 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:20.112955 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:19:20.112918 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:19:28.976889 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:19:28.976781 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:29.909176 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:19:29.909139 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:19:39.144252 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:19:39.144224 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94jtj_c96f0d0b-bdfb-42c4-a74f-183f2cf4876f/ovn-acl-logging/0.log" Jun 08 12:19:39.146105 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:19:39.146080 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94jtj_c96f0d0b-bdfb-42c4-a74f-183f2cf4876f/ovn-acl-logging/0.log" Jun 08 12:19:41.082617 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:19:41.082582 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:41.155505 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:19:41.155466 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:20:02.520066 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:20:02.520004 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:20:24.586244 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:20:24.586192 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:20:34.421179 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:20:34.421139 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:20:34.531477 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:20:34.531441 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:20:35.597950 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:20:35.597910 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:20:35.749060 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:20:35.749018 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:20:40.762095 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:20:40.762066 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:20:40.862036 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:20:40.861999 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:21:05.238988 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:21:05.238951 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:21:08.409725 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:21:08.409693 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:21:16.808938 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:21:16.808900 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:21:27.226187 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:21:27.226153 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:21:35.909131 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:21:35.909087 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:21:47.002859 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:21:47.002818 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:21:55.229277 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:21:55.229242 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:22:06.107921 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:22:06.107880 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:22:13.871045 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:22:13.871013 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:22:15.869099 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:22:15.869070 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:22:26.659646 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:22:26.659533 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:22:39.305214 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:22:39.305131 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:22:40.475810 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:22:40.475766 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:22:43.500375 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:22:43.500340 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:22:56.754801 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:22:56.754767 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:22:56.852580 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:22:56.852543 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:23:05.253174 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:23:05.253143 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:23:11.082990 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:23:11.082951 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:23:11.146720 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:23:11.146686 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:23:19.900603 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:23:19.900566 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:23:35.995931 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:23:35.995898 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:23:37.963247 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:23:37.963214 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:23:43.257521 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:23:43.257481 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:23:43.353497 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:23:43.353468 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:24:07.232855 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:24:07.232820 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:24:13.047079 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:24:13.047042 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:24:13.107628 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:24:13.107588 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:24:13.192983 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:24:13.192957 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:24:13.300143 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:24:13.300074 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:24:13.450740 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:24:13.450710 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:24:13.546449 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:24:13.546421 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:24:14.395070 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:24:14.395041 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:24:29.978411 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:24:29.978352 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:24:30.084708 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:24:30.084677 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:24:30.204344 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:24:30.204293 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:24:31.589860 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:24:31.589827 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:24:36.076472 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:24:36.076442 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:24:36.176250 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:24:36.176222 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:24:39.171856 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:24:39.171829 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94jtj_c96f0d0b-bdfb-42c4-a74f-183f2cf4876f/ovn-acl-logging/0.log" Jun 08 12:24:39.174284 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:24:39.174256 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94jtj_c96f0d0b-bdfb-42c4-a74f-183f2cf4876f/ovn-acl-logging/0.log" Jun 08 12:24:44.273509 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:24:44.273474 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:24:44.384242 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:24:44.384209 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:24:44.482650 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:24:44.482615 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:24:44.582653 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:24:44.582625 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:24:45.604668 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:24:45.604637 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:25:00.898032 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:25:00.897998 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:25:00.991169 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:25:00.991140 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:25:01.103908 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:25:01.103876 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:25:01.204646 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:25:01.204492 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:25:03.594746 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:25:03.594708 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:25:07.257497 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:25:07.257461 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:25:07.329390 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:25:07.329362 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:25:25.620144 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:25:25.620112 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:25:25.703575 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:25:25.703548 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:25:25.804385 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:25:25.804334 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:25:27.566919 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:25:27.566884 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:25:27.649122 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:25:27.649081 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:25:32.215605 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:25:32.215528 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:25:32.383368 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:25:32.383337 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:25:32.490034 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:25:32.489961 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:25:32.608606 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:25:32.608574 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:25:38.365418 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:25:38.365390 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:25:38.465289 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:25:38.465256 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:25:39.010786 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:25:39.010760 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:25:39.304100 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:25:39.304026 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:25:42.611855 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:25:42.611823 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:26:04.527782 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:26:04.527747 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:26:13.710082 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:26:13.710045 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:26:30.297807 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:26:30.297774 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:26:39.002702 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:26:39.002666 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:26:55.798355 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:26:55.798322 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:27:04.309634 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:27:04.309603 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:27:36.802987 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:27:36.802950 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:27:44.907482 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:27:44.907449 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:27:47.396726 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:27:47.396696 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:27:53.596109 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:27:53.596074 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:28:02.195881 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:28:02.195847 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:28:10.513235 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:28:10.513202 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:28:27.704139 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:28:27.704104 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:28:33.603702 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:28:33.603628 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:28:38.904302 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:28:38.904268 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:29:17.691954 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:29:17.691917 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:29:19.706737 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:29:19.706698 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:29:27.207348 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:29:27.207319 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:29:30.297633 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:29:30.297601 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:29:38.602335 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:29:38.602285 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:29:39.201544 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:29:39.201517 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94jtj_c96f0d0b-bdfb-42c4-a74f-183f2cf4876f/ovn-acl-logging/0.log" Jun 08 12:29:39.204822 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:29:39.204790 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94jtj_c96f0d0b-bdfb-42c4-a74f-183f2cf4876f/ovn-acl-logging/0.log" Jun 08 12:29:46.903465 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:29:46.903431 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:29:56.999112 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:29:56.999078 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:30:05.296205 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:30:05.296169 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:30:13.409613 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:30:13.409578 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:30:16.200590 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:30:16.200552 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:30:22.499861 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:30:22.499829 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:30:31.309560 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:30:31.309530 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:30:40.403845 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:30:40.403807 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:30:49.205135 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:30:49.205105 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:30:58.007260 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:30:58.007224 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:31:06.503250 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:31:06.503215 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:31:15.200868 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:31:15.200836 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:31:23.893939 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:31:23.893903 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:31:32.102417 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:31:32.102340 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:31:41.812808 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:31:41.812774 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:31:50.197665 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:31:50.197631 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:32:42.037737 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:32:42.037704 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsnkf"] Jun 08 12:32:42.040126 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:32:42.037938 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsnkf" podUID="43f7f125-2885-4477-8a65-2aa5129121af" containerName="manager" containerID="cri-o://dc316e1915e578527305104072ad3278efa25a486d2e7596c4af1547dc2b501e" gracePeriod=10 Jun 08 12:32:42.285742 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:32:42.285720 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsnkf" Jun 08 12:32:42.392813 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:32:42.392784 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/43f7f125-2885-4477-8a65-2aa5129121af-extensions-socket-volume\") pod \"43f7f125-2885-4477-8a65-2aa5129121af\" (UID: \"43f7f125-2885-4477-8a65-2aa5129121af\") " Jun 08 12:32:42.392964 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:32:42.392930 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bh5fx\" (UniqueName: \"kubernetes.io/projected/43f7f125-2885-4477-8a65-2aa5129121af-kube-api-access-bh5fx\") pod \"43f7f125-2885-4477-8a65-2aa5129121af\" (UID: \"43f7f125-2885-4477-8a65-2aa5129121af\") " Jun 08 12:32:42.393168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:32:42.393145 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43f7f125-2885-4477-8a65-2aa5129121af-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "43f7f125-2885-4477-8a65-2aa5129121af" (UID: "43f7f125-2885-4477-8a65-2aa5129121af"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:32:42.394913 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:32:42.394892 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43f7f125-2885-4477-8a65-2aa5129121af-kube-api-access-bh5fx" (OuterVolumeSpecName: "kube-api-access-bh5fx") pod "43f7f125-2885-4477-8a65-2aa5129121af" (UID: "43f7f125-2885-4477-8a65-2aa5129121af"). InnerVolumeSpecName "kube-api-access-bh5fx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:32:42.488706 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:32:42.488669 2565 generic.go:356] "Generic (PLEG): container finished" podID="43f7f125-2885-4477-8a65-2aa5129121af" containerID="dc316e1915e578527305104072ad3278efa25a486d2e7596c4af1547dc2b501e" exitCode=0 Jun 08 12:32:42.488862 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:32:42.488781 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsnkf" event={"ID":"43f7f125-2885-4477-8a65-2aa5129121af","Type":"ContainerDied","Data":"dc316e1915e578527305104072ad3278efa25a486d2e7596c4af1547dc2b501e"} Jun 08 12:32:42.488862 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:32:42.488795 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsnkf" Jun 08 12:32:42.488981 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:32:42.488880 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsnkf" event={"ID":"43f7f125-2885-4477-8a65-2aa5129121af","Type":"ContainerDied","Data":"b32fbf3b134137f3ba77d3719527b1643f2539215ba91d9e7073648d6198b826"} Jun 08 12:32:42.488981 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:32:42.488911 2565 scope.go:117] "RemoveContainer" containerID="dc316e1915e578527305104072ad3278efa25a486d2e7596c4af1547dc2b501e" Jun 08 12:32:42.493423 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:32:42.493392 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bh5fx\" (UniqueName: \"kubernetes.io/projected/43f7f125-2885-4477-8a65-2aa5129121af-kube-api-access-bh5fx\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:32:42.493423 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:32:42.493412 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/43f7f125-2885-4477-8a65-2aa5129121af-extensions-socket-volume\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:32:42.499897 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:32:42.499883 2565 scope.go:117] "RemoveContainer" containerID="dc316e1915e578527305104072ad3278efa25a486d2e7596c4af1547dc2b501e" Jun 08 12:32:42.500164 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:32:42.500144 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc316e1915e578527305104072ad3278efa25a486d2e7596c4af1547dc2b501e\": container with ID starting with dc316e1915e578527305104072ad3278efa25a486d2e7596c4af1547dc2b501e not found: ID does not exist" containerID="dc316e1915e578527305104072ad3278efa25a486d2e7596c4af1547dc2b501e" Jun 08 12:32:42.500232 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:32:42.500176 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc316e1915e578527305104072ad3278efa25a486d2e7596c4af1547dc2b501e"} err="failed to get container status \"dc316e1915e578527305104072ad3278efa25a486d2e7596c4af1547dc2b501e\": rpc error: code = NotFound desc = could not find container \"dc316e1915e578527305104072ad3278efa25a486d2e7596c4af1547dc2b501e\": container with ID starting with dc316e1915e578527305104072ad3278efa25a486d2e7596c4af1547dc2b501e not found: ID does not exist" Jun 08 12:32:42.512460 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:32:42.512436 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsnkf"] Jun 08 12:32:42.519714 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:32:42.519683 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tsnkf"] Jun 08 12:32:43.123784 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:32:43.123757 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43f7f125-2885-4477-8a65-2aa5129121af" path="/var/lib/kubelet/pods/43f7f125-2885-4477-8a65-2aa5129121af/volumes" Jun 08 12:33:48.185605 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:33:48.185577 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2vws"] Jun 08 12:33:48.186055 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:33:48.185926 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43f7f125-2885-4477-8a65-2aa5129121af" containerName="manager" Jun 08 12:33:48.186055 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:33:48.185936 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="43f7f125-2885-4477-8a65-2aa5129121af" containerName="manager" Jun 08 12:33:48.186055 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:33:48.186006 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="43f7f125-2885-4477-8a65-2aa5129121af" containerName="manager" Jun 08 12:33:48.190041 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:33:48.190025 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2vws" Jun 08 12:33:48.192445 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:33:48.192423 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-f9fdc\"" Jun 08 12:33:48.205056 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:33:48.205024 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2vws"] Jun 08 12:33:48.316784 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:33:48.316761 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhxlz\" (UniqueName: \"kubernetes.io/projected/03f56c69-f02a-45b8-b645-d11d781cd995-kube-api-access-hhxlz\") pod \"kuadrant-operator-controller-manager-86878c769f-b2vws\" (UID: \"03f56c69-f02a-45b8-b645-d11d781cd995\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2vws" Jun 08 12:33:48.316908 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:33:48.316811 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03f56c69-f02a-45b8-b645-d11d781cd995-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-b2vws\" (UID: \"03f56c69-f02a-45b8-b645-d11d781cd995\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2vws" Jun 08 12:33:48.417945 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:33:48.417921 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhxlz\" (UniqueName: \"kubernetes.io/projected/03f56c69-f02a-45b8-b645-d11d781cd995-kube-api-access-hhxlz\") pod \"kuadrant-operator-controller-manager-86878c769f-b2vws\" (UID: \"03f56c69-f02a-45b8-b645-d11d781cd995\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2vws" Jun 08 12:33:48.418048 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:33:48.417963 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03f56c69-f02a-45b8-b645-d11d781cd995-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-b2vws\" (UID: \"03f56c69-f02a-45b8-b645-d11d781cd995\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2vws" Jun 08 12:33:48.418275 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:33:48.418260 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03f56c69-f02a-45b8-b645-d11d781cd995-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-b2vws\" (UID: \"03f56c69-f02a-45b8-b645-d11d781cd995\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2vws" Jun 08 12:33:48.426459 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:33:48.426441 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhxlz\" (UniqueName: \"kubernetes.io/projected/03f56c69-f02a-45b8-b645-d11d781cd995-kube-api-access-hhxlz\") pod \"kuadrant-operator-controller-manager-86878c769f-b2vws\" (UID: \"03f56c69-f02a-45b8-b645-d11d781cd995\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2vws" Jun 08 12:33:48.499816 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:33:48.499763 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2vws" Jun 08 12:33:48.634378 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:33:48.634351 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2vws"] Jun 08 12:33:48.635886 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:33:48.635861 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03f56c69_f02a_45b8_b645_d11d781cd995.slice/crio-761084f077100ac3445aa19832ffcc63d521d6ea62802a893150dc97f07ef92e WatchSource:0}: Error finding container 761084f077100ac3445aa19832ffcc63d521d6ea62802a893150dc97f07ef92e: Status 404 returned error can't find the container with id 761084f077100ac3445aa19832ffcc63d521d6ea62802a893150dc97f07ef92e Jun 08 12:33:48.792844 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:33:48.792768 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2vws" event={"ID":"03f56c69-f02a-45b8-b645-d11d781cd995","Type":"ContainerStarted","Data":"fd73daa5cc422f209c88661c49b6323d7bdade6ca0ade30611b0d41c9e0e9255"} Jun 08 12:33:48.792844 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:33:48.792813 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2vws" event={"ID":"03f56c69-f02a-45b8-b645-d11d781cd995","Type":"ContainerStarted","Data":"761084f077100ac3445aa19832ffcc63d521d6ea62802a893150dc97f07ef92e"} Jun 08 12:33:48.793036 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:33:48.792857 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2vws" Jun 08 12:33:48.818988 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:33:48.818943 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2vws" podStartSLOduration=0.818929332 podStartE2EDuration="818.929332ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:33:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:33:48.81599333 +0000 UTC m=+1750.144341979" watchObservedRunningTime="2026-06-08 12:33:48.818929332 +0000 UTC m=+1750.147277981" Jun 08 12:33:59.798976 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:33:59.798946 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2vws" Jun 08 12:34:07.095691 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:34:07.095656 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:34:11.601927 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:34:11.601894 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:34:24.337052 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:34:24.336978 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:34:37.809107 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:34:37.809072 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:34:39.237204 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:34:39.237165 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94jtj_c96f0d0b-bdfb-42c4-a74f-183f2cf4876f/ovn-acl-logging/0.log" Jun 08 12:34:39.240482 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:34:39.240461 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94jtj_c96f0d0b-bdfb-42c4-a74f-183f2cf4876f/ovn-acl-logging/0.log" Jun 08 12:34:42.490897 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:34:42.490867 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:34:51.906294 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:34:51.906265 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:35:02.688865 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:35:02.688826 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:35:11.094579 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:35:11.094549 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:35:12.516469 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:35:12.516433 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:35:21.394779 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:35:21.394748 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:35:30.505961 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:35:30.505930 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:35:40.994506 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:35:40.994468 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:35:49.794787 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:35:49.794750 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:36:00.386829 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:36:00.386750 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:36:09.787120 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:36:09.787086 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:36:13.790956 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:36:13.790918 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:36:42.699647 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:36:42.699616 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:37:25.390258 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:37:25.390220 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:37:33.996425 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:37:33.996392 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:37:42.691073 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:37:42.691041 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:37:51.610737 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:37:51.610704 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:37:56.079503 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:37:56.079465 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:37:59.914896 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:37:59.914860 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:38:10.593337 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:38:10.593290 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:38:19.497898 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:38:19.497863 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:38:25.298715 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:38:25.298683 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:38:25.576580 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:38:25.576550 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:38:25.677592 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:38:25.677556 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:38:33.697553 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:38:33.697520 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:38:42.196637 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:38:42.196605 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:38:50.204878 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:38:50.204850 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:39:00.794732 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:39:00.794653 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:39:18.697113 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:39:18.697078 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:39:27.491407 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:39:27.491370 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:39:35.697963 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:39:35.697925 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:39:39.267098 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:39:39.267070 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94jtj_c96f0d0b-bdfb-42c4-a74f-183f2cf4876f/ovn-acl-logging/0.log" Jun 08 12:39:39.270994 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:39:39.270971 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94jtj_c96f0d0b-bdfb-42c4-a74f-183f2cf4876f/ovn-acl-logging/0.log" Jun 08 12:39:44.809656 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:39:44.809619 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:40:01.397200 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:40:01.397166 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:40:09.206357 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:40:09.206327 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:40:18.411203 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:40:18.411166 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:40:27.204815 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:40:27.204779 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:40:35.800566 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:40:35.800486 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:40:44.508168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:40:44.508137 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:40:53.604779 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:40:53.604747 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:41:03.902628 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:41:03.902594 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:41:06.617059 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:41:06.617027 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:41:13.904737 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:41:13.904708 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:41:25.102829 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:41:25.102788 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:41:34.103333 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:41:34.103277 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:41:40.006074 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:41:40.006043 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:41:48.707690 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:41:48.707654 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:41:54.700495 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:41:54.700463 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:42:10.902384 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:10.902351 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:42:19.505875 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:19.505839 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dm9tk"] Jun 08 12:42:28.515590 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.515557 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx"] Jun 08 12:42:28.518187 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.518163 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:28.521555 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.521537 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1f4499f9-openshift-default-dockercfg-5w9h5\"" Jun 08 12:42:28.548329 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.548287 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx"] Jun 08 12:42:28.606442 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.606411 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:42:28.654830 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.654805 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-workload-certs\") pod \"e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:28.654996 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.654848 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw9wt\" (UniqueName: \"kubernetes.io/projected/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-kube-api-access-fw9wt\") pod \"e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:28.654996 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.654891 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-workload-socket\") pod \"e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:28.654996 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.654914 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istio-token\") pod \"e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:28.654996 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.654932 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istio-data\") pod \"e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:28.654996 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.654949 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istio-envoy\") pod \"e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:28.654996 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.654972 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-credential-socket\") pod \"e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:28.655332 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.655088 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istiod-ca-cert\") pod \"e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:28.655332 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.655127 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istio-podinfo\") pod \"e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:28.756153 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.756126 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw9wt\" (UniqueName: \"kubernetes.io/projected/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-kube-api-access-fw9wt\") pod \"e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:28.756380 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.756165 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-workload-socket\") pod \"e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:28.756380 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.756184 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istio-token\") pod \"e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:28.756380 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.756201 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istio-data\") pod \"e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:28.756380 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.756223 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istio-envoy\") pod \"e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:28.756671 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.756501 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-credential-socket\") pod \"e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:28.756671 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.756591 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-workload-socket\") pod \"e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:28.756671 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.756598 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istiod-ca-cert\") pod \"e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:28.756671 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.756657 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istio-podinfo\") pod \"e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:28.756862 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.756714 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istio-data\") pod \"e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:28.756862 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.756743 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-workload-certs\") pod \"e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:28.757100 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.757080 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-workload-certs\") pod \"e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:28.757293 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.757273 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istiod-ca-cert\") pod \"e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:28.757391 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.757278 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-credential-socket\") pod \"e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:28.758762 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.758741 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istio-envoy\") pod \"e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:28.759189 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.759169 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istio-podinfo\") pod \"e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:28.765408 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.765382 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw9wt\" (UniqueName: \"kubernetes.io/projected/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-kube-api-access-fw9wt\") pod \"e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:28.769915 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.769867 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istio-token\") pod \"e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:28.830053 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.830033 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:28.968275 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.968215 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx"] Jun 08 12:42:28.971152 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:42:28.971122 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod189a0d7a_e850_4e73_aa9f_871cac9ccb7a.slice/crio-5642c9de62e6b0a52cbb8cb6b48c474e5343647a5f3f078ca34455bf284c6269 WatchSource:0}: Error finding container 5642c9de62e6b0a52cbb8cb6b48c474e5343647a5f3f078ca34455bf284c6269: Status 404 returned error can't find the container with id 5642c9de62e6b0a52cbb8cb6b48c474e5343647a5f3f078ca34455bf284c6269 Jun 08 12:42:28.973328 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.973280 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 12:42:28.973418 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.973360 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 12:42:28.973418 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:28.973406 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 12:42:29.173735 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:29.173700 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" event={"ID":"189a0d7a-e850-4e73-aa9f-871cac9ccb7a","Type":"ContainerStarted","Data":"bb858b07b65921e87f341d5a642453d0508437b10498cdee505f55930e14f178"} Jun 08 12:42:29.173935 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:29.173765 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" event={"ID":"189a0d7a-e850-4e73-aa9f-871cac9ccb7a","Type":"ContainerStarted","Data":"5642c9de62e6b0a52cbb8cb6b48c474e5343647a5f3f078ca34455bf284c6269"} Jun 08 12:42:29.199387 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:29.199336 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" podStartSLOduration=1.1992961580000001 podStartE2EDuration="1.199296158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:42:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:42:29.19770733 +0000 UTC m=+2270.526055979" watchObservedRunningTime="2026-06-08 12:42:29.199296158 +0000 UTC m=+2270.527644806" Jun 08 12:42:29.807885 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:29.807850 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:42:29.830289 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:29.830258 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:30.834913 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:30.834883 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:31.183132 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:31.183045 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:31.184014 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:31.183991 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:32.750694 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:32.750661 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:42:33.145906 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:33.145877 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:42:33.247189 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:33.247162 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:42:34.875121 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:34.875084 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:42:35.000197 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:35.000168 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx"] Jun 08 12:42:35.000377 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:35.000353 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" podUID="189a0d7a-e850-4e73-aa9f-871cac9ccb7a" containerName="istio-proxy" containerID="cri-o://bb858b07b65921e87f341d5a642453d0508437b10498cdee505f55930e14f178" gracePeriod=30 Jun 08 12:42:35.037540 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:35.037508 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:42:35.113741 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:35.113702 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:42:36.956177 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:36.956145 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:42:40.225477 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.225445 2565 generic.go:356] "Generic (PLEG): container finished" podID="189a0d7a-e850-4e73-aa9f-871cac9ccb7a" containerID="bb858b07b65921e87f341d5a642453d0508437b10498cdee505f55930e14f178" exitCode=0 Jun 08 12:42:40.225773 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.225503 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" event={"ID":"189a0d7a-e850-4e73-aa9f-871cac9ccb7a","Type":"ContainerDied","Data":"bb858b07b65921e87f341d5a642453d0508437b10498cdee505f55930e14f178"} Jun 08 12:42:40.239888 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.239866 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:40.354677 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.354649 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-workload-certs\") pod \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " Jun 08 12:42:40.354837 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.354686 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fw9wt\" (UniqueName: \"kubernetes.io/projected/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-kube-api-access-fw9wt\") pod \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " Jun 08 12:42:40.354837 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.354716 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-workload-socket\") pod \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " Jun 08 12:42:40.354837 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.354736 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-credential-socket\") pod \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " Jun 08 12:42:40.354837 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.354800 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istiod-ca-cert\") pod \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " Jun 08 12:42:40.355041 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.354836 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istio-podinfo\") pod \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " Jun 08 12:42:40.355041 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.354892 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istio-envoy\") pod \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " Jun 08 12:42:40.355041 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.354965 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "189a0d7a-e850-4e73-aa9f-871cac9ccb7a" (UID: "189a0d7a-e850-4e73-aa9f-871cac9ccb7a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:42:40.355041 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.354968 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "189a0d7a-e850-4e73-aa9f-871cac9ccb7a" (UID: "189a0d7a-e850-4e73-aa9f-871cac9ccb7a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:42:40.355041 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.355005 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istio-token\") pod \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " Jun 08 12:42:40.355041 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.355042 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istio-data\") pod \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\" (UID: \"189a0d7a-e850-4e73-aa9f-871cac9ccb7a\") " Jun 08 12:42:40.355331 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.355091 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "189a0d7a-e850-4e73-aa9f-871cac9ccb7a" (UID: "189a0d7a-e850-4e73-aa9f-871cac9ccb7a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:42:40.355331 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.355163 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "189a0d7a-e850-4e73-aa9f-871cac9ccb7a" (UID: "189a0d7a-e850-4e73-aa9f-871cac9ccb7a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:42:40.355441 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.355380 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istio-data" (OuterVolumeSpecName: "istio-data") pod "189a0d7a-e850-4e73-aa9f-871cac9ccb7a" (UID: "189a0d7a-e850-4e73-aa9f-871cac9ccb7a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:42:40.355494 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.355471 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istio-data\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:42:40.355545 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.355492 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-workload-certs\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:42:40.355545 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.355506 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-workload-socket\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:42:40.355545 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.355519 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-credential-socket\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:42:40.355545 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.355532 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istiod-ca-cert\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:42:40.356970 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.356947 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-kube-api-access-fw9wt" (OuterVolumeSpecName: "kube-api-access-fw9wt") pod "189a0d7a-e850-4e73-aa9f-871cac9ccb7a" (UID: "189a0d7a-e850-4e73-aa9f-871cac9ccb7a"). InnerVolumeSpecName "kube-api-access-fw9wt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:42:40.357085 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.356992 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istio-token" (OuterVolumeSpecName: "istio-token") pod "189a0d7a-e850-4e73-aa9f-871cac9ccb7a" (UID: "189a0d7a-e850-4e73-aa9f-871cac9ccb7a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:42:40.357217 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.357197 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "189a0d7a-e850-4e73-aa9f-871cac9ccb7a" (UID: "189a0d7a-e850-4e73-aa9f-871cac9ccb7a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 08 12:42:40.357289 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.357202 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "189a0d7a-e850-4e73-aa9f-871cac9ccb7a" (UID: "189a0d7a-e850-4e73-aa9f-871cac9ccb7a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:42:40.456295 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.456267 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istio-envoy\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:42:40.456295 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.456292 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istio-token\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:42:40.456465 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.456329 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fw9wt\" (UniqueName: \"kubernetes.io/projected/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-kube-api-access-fw9wt\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:42:40.456465 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.456343 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/189a0d7a-e850-4e73-aa9f-871cac9ccb7a-istio-podinfo\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:42:40.998195 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:40.998162 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:42:41.065712 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.065684 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:42:41.186279 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.186243 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp"] Jun 08 12:42:41.186834 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.186814 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="189a0d7a-e850-4e73-aa9f-871cac9ccb7a" containerName="istio-proxy" Jun 08 12:42:41.186834 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.186835 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="189a0d7a-e850-4e73-aa9f-871cac9ccb7a" containerName="istio-proxy" Jun 08 12:42:41.187002 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.186955 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="189a0d7a-e850-4e73-aa9f-871cac9ccb7a" containerName="istio-proxy" Jun 08 12:42:41.188937 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.188919 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:41.191033 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.191007 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6f689a47-openshift-default-dockercfg-gmpc2\"" Jun 08 12:42:41.205133 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.205106 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp"] Jun 08 12:42:41.222161 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.222125 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:42:41.231782 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.231761 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" event={"ID":"189a0d7a-e850-4e73-aa9f-871cac9ccb7a","Type":"ContainerDied","Data":"5642c9de62e6b0a52cbb8cb6b48c474e5343647a5f3f078ca34455bf284c6269"} Jun 08 12:42:41.232082 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.231784 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx" Jun 08 12:42:41.232082 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.231819 2565 scope.go:117] "RemoveContainer" containerID="bb858b07b65921e87f341d5a642453d0508437b10498cdee505f55930e14f178" Jun 08 12:42:41.248258 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.248210 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx"] Jun 08 12:42:41.255318 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.255285 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1f4499f9-openshift-default-768cbd4998-bvjdx"] Jun 08 12:42:41.326323 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.326279 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:42:41.363401 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.363371 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-workload-certs\") pod \"e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:41.363545 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.363412 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istio-podinfo\") pod \"e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:41.363545 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.363434 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6252\" (UniqueName: \"kubernetes.io/projected/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-kube-api-access-v6252\") pod \"e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:41.363545 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.363490 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-workload-socket\") pod \"e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:41.363545 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.363521 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istio-envoy\") pod \"e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:41.363545 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.363536 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istio-data\") pod \"e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:41.363716 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.363588 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-credential-socket\") pod \"e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:41.363716 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.363622 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istio-token\") pod \"e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:41.363716 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.363653 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istiod-ca-cert\") pod \"e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:41.419927 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.419901 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:42:41.464205 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.464178 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-credential-socket\") pod \"e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:41.464341 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.464210 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istio-token\") pod \"e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:41.464341 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.464244 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istiod-ca-cert\") pod \"e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:41.464341 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.464286 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-workload-certs\") pod \"e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:41.464839 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.464344 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istio-podinfo\") pod \"e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:41.464839 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.464368 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6252\" (UniqueName: \"kubernetes.io/projected/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-kube-api-access-v6252\") pod \"e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:41.464839 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.464395 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-workload-socket\") pod \"e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:41.464839 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.464436 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istio-envoy\") pod \"e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:41.464839 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.464457 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istio-data\") pod \"e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:41.464839 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.464608 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-credential-socket\") pod \"e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:41.464839 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.464695 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-workload-certs\") pod \"e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:41.464839 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.464732 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-workload-socket\") pod \"e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:41.465114 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.464881 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istio-data\") pod \"e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:41.465114 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.464968 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istiod-ca-cert\") pod \"e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:41.466647 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.466628 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istio-envoy\") pod \"e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:41.466883 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.466861 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istio-podinfo\") pod \"e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:41.472148 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.472126 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istio-token\") pod \"e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:41.472231 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.472219 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6252\" (UniqueName: \"kubernetes.io/projected/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-kube-api-access-v6252\") pod \"e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:41.499345 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.499286 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:41.632235 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.632213 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp"] Jun 08 12:42:41.633831 ip-10-0-133-35 kubenswrapper[2565]: W0608 12:42:41.633803 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d0c7e4c_7735_4ee8_8944_82e0cdada5fc.slice/crio-48ef6011e3356c8f6c7e5f459002e0b4a8b3fd45e3fb8b7bd2fea7071fc57f59 WatchSource:0}: Error finding container 48ef6011e3356c8f6c7e5f459002e0b4a8b3fd45e3fb8b7bd2fea7071fc57f59: Status 404 returned error can't find the container with id 48ef6011e3356c8f6c7e5f459002e0b4a8b3fd45e3fb8b7bd2fea7071fc57f59 Jun 08 12:42:41.636060 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.636027 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 12:42:41.636160 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.636091 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 12:42:41.636160 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:41.636120 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 12:42:42.238390 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:42.238353 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" event={"ID":"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc","Type":"ContainerStarted","Data":"a599a66e84604b42118906796ceda01731317e6d05e24a889d4bf1d1c04c500f"} Jun 08 12:42:42.238831 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:42.238410 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" event={"ID":"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc","Type":"ContainerStarted","Data":"48ef6011e3356c8f6c7e5f459002e0b4a8b3fd45e3fb8b7bd2fea7071fc57f59"} Jun 08 12:42:42.268168 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:42.268114 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" podStartSLOduration=1.268096329 podStartE2EDuration="1.268096329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:42:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:42:42.268032829 +0000 UTC m=+2283.596381480" watchObservedRunningTime="2026-06-08 12:42:42.268096329 +0000 UTC m=+2283.596444977" Jun 08 12:42:42.499970 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:42.499898 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:42.504702 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:42.504681 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:43.124803 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:43.124768 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="189a0d7a-e850-4e73-aa9f-871cac9ccb7a" path="/var/lib/kubelet/pods/189a0d7a-e850-4e73-aa9f-871cac9ccb7a/volumes" Jun 08 12:42:43.243696 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:43.243670 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:43.244566 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:43.244548 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:44.465797 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:44.465762 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:42:47.485736 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:47.485701 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:42:48.650298 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:48.650268 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp"] Jun 08 12:42:48.650727 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:48.650452 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" podUID="9d0c7e4c-7735-4ee8-8944-82e0cdada5fc" containerName="istio-proxy" containerID="cri-o://a599a66e84604b42118906796ceda01731317e6d05e24a889d4bf1d1c04c500f" gracePeriod=30 Jun 08 12:42:48.675722 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:48.675690 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:42:48.777194 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:48.777163 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:42:51.021532 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:51.021490 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:42:53.899351 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:53.899328 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:53.965502 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:53.965438 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-workload-certs\") pod \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " Jun 08 12:42:53.965502 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:53.965479 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istio-token\") pod \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " Jun 08 12:42:53.965686 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:53.965526 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istio-podinfo\") pod \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " Jun 08 12:42:53.965686 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:53.965549 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istiod-ca-cert\") pod \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " Jun 08 12:42:53.965686 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:53.965572 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istio-envoy\") pod \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " Jun 08 12:42:53.965686 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:53.965594 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istio-data\") pod \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " Jun 08 12:42:53.965686 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:53.965643 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-workload-socket\") pod \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " Jun 08 12:42:53.965686 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:53.965671 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-credential-socket\") pod \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " Jun 08 12:42:53.965995 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:53.965709 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9d0c7e4c-7735-4ee8-8944-82e0cdada5fc" (UID: "9d0c7e4c-7735-4ee8-8944-82e0cdada5fc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:42:53.965995 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:53.965735 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6252\" (UniqueName: \"kubernetes.io/projected/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-kube-api-access-v6252\") pod \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\" (UID: \"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc\") " Jun 08 12:42:53.965995 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:53.965969 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9d0c7e4c-7735-4ee8-8944-82e0cdada5fc" (UID: "9d0c7e4c-7735-4ee8-8944-82e0cdada5fc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:42:53.965995 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:53.965972 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9d0c7e4c-7735-4ee8-8944-82e0cdada5fc" (UID: "9d0c7e4c-7735-4ee8-8944-82e0cdada5fc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:42:53.966221 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:53.966018 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-workload-certs\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:42:53.966221 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:53.966001 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istio-data" (OuterVolumeSpecName: "istio-data") pod "9d0c7e4c-7735-4ee8-8944-82e0cdada5fc" (UID: "9d0c7e4c-7735-4ee8-8944-82e0cdada5fc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:42:53.966221 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:53.966046 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9d0c7e4c-7735-4ee8-8944-82e0cdada5fc" (UID: "9d0c7e4c-7735-4ee8-8944-82e0cdada5fc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:42:53.967632 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:53.967608 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9d0c7e4c-7735-4ee8-8944-82e0cdada5fc" (UID: "9d0c7e4c-7735-4ee8-8944-82e0cdada5fc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:42:53.967632 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:53.967610 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9d0c7e4c-7735-4ee8-8944-82e0cdada5fc" (UID: "9d0c7e4c-7735-4ee8-8944-82e0cdada5fc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 08 12:42:53.967797 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:53.967745 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-kube-api-access-v6252" (OuterVolumeSpecName: "kube-api-access-v6252") pod "9d0c7e4c-7735-4ee8-8944-82e0cdada5fc" (UID: "9d0c7e4c-7735-4ee8-8944-82e0cdada5fc"). InnerVolumeSpecName "kube-api-access-v6252". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:42:53.967912 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:53.967895 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istio-token" (OuterVolumeSpecName: "istio-token") pod "9d0c7e4c-7735-4ee8-8944-82e0cdada5fc" (UID: "9d0c7e4c-7735-4ee8-8944-82e0cdada5fc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:42:54.067093 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:54.067059 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istio-token\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:42:54.067093 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:54.067089 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istio-podinfo\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:42:54.067093 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:54.067098 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istiod-ca-cert\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:42:54.067093 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:54.067105 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istio-envoy\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:42:54.067297 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:54.067112 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-istio-data\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:42:54.067297 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:54.067121 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-workload-socket\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:42:54.067297 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:54.067129 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-credential-socket\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:42:54.067297 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:54.067143 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6252\" (UniqueName: \"kubernetes.io/projected/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc-kube-api-access-v6252\") on node \"ip-10-0-133-35.ec2.internal\" DevicePath \"\"" Jun 08 12:42:54.293699 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:54.293626 2565 generic.go:356] "Generic (PLEG): container finished" podID="9d0c7e4c-7735-4ee8-8944-82e0cdada5fc" containerID="a599a66e84604b42118906796ceda01731317e6d05e24a889d4bf1d1c04c500f" exitCode=0 Jun 08 12:42:54.294147 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:54.293935 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" Jun 08 12:42:54.294520 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:54.293964 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" event={"ID":"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc","Type":"ContainerDied","Data":"a599a66e84604b42118906796ceda01731317e6d05e24a889d4bf1d1c04c500f"} Jun 08 12:42:54.294630 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:54.294549 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp" event={"ID":"9d0c7e4c-7735-4ee8-8944-82e0cdada5fc","Type":"ContainerDied","Data":"48ef6011e3356c8f6c7e5f459002e0b4a8b3fd45e3fb8b7bd2fea7071fc57f59"} Jun 08 12:42:54.294630 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:54.294587 2565 scope.go:117] "RemoveContainer" containerID="a599a66e84604b42118906796ceda01731317e6d05e24a889d4bf1d1c04c500f" Jun 08 12:42:54.303290 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:54.303274 2565 scope.go:117] "RemoveContainer" containerID="a599a66e84604b42118906796ceda01731317e6d05e24a889d4bf1d1c04c500f" Jun 08 12:42:54.303549 ip-10-0-133-35 kubenswrapper[2565]: E0608 12:42:54.303530 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a599a66e84604b42118906796ceda01731317e6d05e24a889d4bf1d1c04c500f\": container with ID starting with a599a66e84604b42118906796ceda01731317e6d05e24a889d4bf1d1c04c500f not found: ID does not exist" containerID="a599a66e84604b42118906796ceda01731317e6d05e24a889d4bf1d1c04c500f" Jun 08 12:42:54.303638 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:54.303551 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a599a66e84604b42118906796ceda01731317e6d05e24a889d4bf1d1c04c500f"} err="failed to get container status \"a599a66e84604b42118906796ceda01731317e6d05e24a889d4bf1d1c04c500f\": rpc error: code = NotFound desc = could not find container \"a599a66e84604b42118906796ceda01731317e6d05e24a889d4bf1d1c04c500f\": container with ID starting with a599a66e84604b42118906796ceda01731317e6d05e24a889d4bf1d1c04c500f not found: ID does not exist" Jun 08 12:42:54.315865 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:54.315843 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp"] Jun 08 12:42:54.320765 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:54.320744 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-6f689a47-openshift-default-7b9dcfc9f6-g67wp"] Jun 08 12:42:55.124516 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:55.124487 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d0c7e4c-7735-4ee8-8944-82e0cdada5fc" path="/var/lib/kubelet/pods/9d0c7e4c-7735-4ee8-8944-82e0cdada5fc/volumes" Jun 08 12:42:55.246512 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:55.246482 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:42:55.345924 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:42:55.345892 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:43:06.136082 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:06.136050 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6b6d49959d-r5trc_17104e02-d81f-4d96-b951-7b2ab65b0c4c/nginx/0.log" Jun 08 12:43:06.489368 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:06.489284 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5499cf4f78-7gqjh_f7677855-92eb-470c-9ab8-c3234a346e50/maas-api/0.log" Jun 08 12:43:06.833013 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:06.832992 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-8rtcw_9db910d5-0a1c-4f21-8203-8a8f1e2784f9/server/0.log" Jun 08 12:43:07.060856 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:07.060835 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-854df88b87-7nztq_2f1e5fd5-f28c-44ea-a9b5-748ced270b99/copy-manifests/0.log" Jun 08 12:43:07.067932 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:07.067903 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-854df88b87-7nztq_2f1e5fd5-f28c-44ea-a9b5-748ced270b99/manager/0.log" Jun 08 12:43:08.941784 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:08.941747 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-zq5gg_f26543c4-de01-4919-843c-dde45b46e339/manager/0.log" Jun 08 12:43:09.172063 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:09.172032 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-r4ts9_2b07cc83-c634-4233-88fc-fc4c955e13d1/registry-server/0.log" Jun 08 12:43:09.302192 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:09.302115 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-b2vws_03f56c69-f02a-45b8-b645-d11d781cd995/manager/0.log" Jun 08 12:43:09.425410 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:09.425389 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dm9tk_0930ffe6-00e0-433d-8b48-b757d2651147/limitador/0.log" Jun 08 12:43:09.553043 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:09.552977 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-h9lzj_b5f0b196-7098-495e-ab97-c71a7adb836d/manager/0.log" Jun 08 12:43:09.894894 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:09.894866 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795qj85p_13418ac1-9288-43c8-b4a5-8b3c3b77e00e/istio-proxy/0.log" Jun 08 12:43:10.360396 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:10.360365 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lzvtx_4a2144c9-373e-405d-a9a5-a56c4f31d5cf/istio-proxy/1.log" Jun 08 12:43:16.107561 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:16.107530 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wz44x/must-gather-9wwgj"] Jun 08 12:43:16.107959 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:16.107892 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d0c7e4c-7735-4ee8-8944-82e0cdada5fc" containerName="istio-proxy" Jun 08 12:43:16.107959 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:16.107902 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d0c7e4c-7735-4ee8-8944-82e0cdada5fc" containerName="istio-proxy" Jun 08 12:43:16.108037 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:16.107972 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d0c7e4c-7735-4ee8-8944-82e0cdada5fc" containerName="istio-proxy" Jun 08 12:43:16.110058 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:16.110042 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wz44x/must-gather-9wwgj" Jun 08 12:43:16.114403 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:16.114371 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wz44x\"/\"kube-root-ca.crt\"" Jun 08 12:43:16.114817 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:16.114797 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wz44x\"/\"openshift-service-ca.crt\"" Jun 08 12:43:16.114927 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:16.114808 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wz44x\"/\"default-dockercfg-756qk\"" Jun 08 12:43:16.120995 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:16.120969 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wz44x/must-gather-9wwgj"] Jun 08 12:43:16.123724 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:16.123699 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:43:16.147126 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:16.147103 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb5hh\" (UniqueName: \"kubernetes.io/projected/eaad7043-5918-45f0-b34f-45d654aa3496-kube-api-access-rb5hh\") pod \"must-gather-9wwgj\" (UID: \"eaad7043-5918-45f0-b34f-45d654aa3496\") " pod="openshift-must-gather-wz44x/must-gather-9wwgj" Jun 08 12:43:16.147241 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:16.147180 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/eaad7043-5918-45f0-b34f-45d654aa3496-must-gather-output\") pod \"must-gather-9wwgj\" (UID: \"eaad7043-5918-45f0-b34f-45d654aa3496\") " pod="openshift-must-gather-wz44x/must-gather-9wwgj" Jun 08 12:43:16.227540 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:16.227506 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" limit=1024 Jun 08 12:43:16.248031 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:16.248003 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/eaad7043-5918-45f0-b34f-45d654aa3496-must-gather-output\") pod \"must-gather-9wwgj\" (UID: \"eaad7043-5918-45f0-b34f-45d654aa3496\") " pod="openshift-must-gather-wz44x/must-gather-9wwgj" Jun 08 12:43:16.248173 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:16.248050 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb5hh\" (UniqueName: \"kubernetes.io/projected/eaad7043-5918-45f0-b34f-45d654aa3496-kube-api-access-rb5hh\") pod \"must-gather-9wwgj\" (UID: \"eaad7043-5918-45f0-b34f-45d654aa3496\") " pod="openshift-must-gather-wz44x/must-gather-9wwgj" Jun 08 12:43:16.248365 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:16.248348 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/eaad7043-5918-45f0-b34f-45d654aa3496-must-gather-output\") pod \"must-gather-9wwgj\" (UID: \"eaad7043-5918-45f0-b34f-45d654aa3496\") " pod="openshift-must-gather-wz44x/must-gather-9wwgj" Jun 08 12:43:16.256246 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:16.256216 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb5hh\" (UniqueName: \"kubernetes.io/projected/eaad7043-5918-45f0-b34f-45d654aa3496-kube-api-access-rb5hh\") pod \"must-gather-9wwgj\" (UID: \"eaad7043-5918-45f0-b34f-45d654aa3496\") " pod="openshift-must-gather-wz44x/must-gather-9wwgj" Jun 08 12:43:16.419333 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:16.419227 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wz44x/must-gather-9wwgj" Jun 08 12:43:16.546631 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:16.546605 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wz44x/must-gather-9wwgj"] Jun 08 12:43:16.553087 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:16.553062 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 12:43:17.399131 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:17.399088 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wz44x/must-gather-9wwgj" event={"ID":"eaad7043-5918-45f0-b34f-45d654aa3496","Type":"ContainerStarted","Data":"2e993d44f29526b04ea52e28c3a3ed685cb08169a7ce82890db70de321161080"} Jun 08 12:43:18.406053 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:18.406014 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wz44x/must-gather-9wwgj" event={"ID":"eaad7043-5918-45f0-b34f-45d654aa3496","Type":"ContainerStarted","Data":"dab9626f861395bb816f386e18f415a1c3793d717143c24f733baa0ed04e71eb"} Jun 08 12:43:18.406053 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:18.406055 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wz44x/must-gather-9wwgj" event={"ID":"eaad7043-5918-45f0-b34f-45d654aa3496","Type":"ContainerStarted","Data":"bbf85a957052d73546fb0ce1544a91cd7a937cf91b318cd575ff23db14bf1fe3"} Jun 08 12:43:18.425055 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:18.425006 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wz44x/must-gather-9wwgj" podStartSLOduration=1.458586566 podStartE2EDuration="2.424990801s" totalImagesPullingTime="966.404235ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:43:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:43:18.423355469 +0000 UTC m=+2319.751704109" watchObservedRunningTime="2026-06-08 12:43:18.424990801 +0000 UTC m=+2319.753339449" Jun 08 12:43:19.398589 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:19.398550 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-96gpg_9feeac32-9e54-42d4-85f7-3e4175f9eb08/global-pull-secret-syncer/0.log" Jun 08 12:43:19.550442 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:19.550407 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7vjm8_87ecf61c-d270-4aeb-bf85-8ba8713e26ee/konnectivity-agent/0.log" Jun 08 12:43:19.676419 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:19.676337 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-35.ec2.internal_3f0d14af2a26bde7f58d321a723d5ba5/haproxy/0.log" Jun 08 12:43:24.775676 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:24.775643 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-zq5gg_f26543c4-de01-4919-843c-dde45b46e339/manager/0.log" Jun 08 12:43:24.865184 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:24.865150 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-r4ts9_2b07cc83-c634-4233-88fc-fc4c955e13d1/registry-server/0.log" Jun 08 12:43:24.940193 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:24.940160 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-b2vws_03f56c69-f02a-45b8-b645-d11d781cd995/manager/0.log" Jun 08 12:43:24.974225 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:24.974155 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dm9tk_0930ffe6-00e0-433d-8b48-b757d2651147/limitador/0.log" Jun 08 12:43:25.087178 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:25.087068 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-h9lzj_b5f0b196-7098-495e-ab97-c71a7adb836d/manager/0.log" Jun 08 12:43:26.908754 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:26.908136 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5cbdc5b888-98rw8_e97d57fe-d882-4489-9bc2-5a1fd534dad8/metrics-server/0.log" Jun 08 12:43:27.085929 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:27.083329 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fpwsv_a8d1e947-d56d-46ed-889e-33ee22b588fd/node-exporter/0.log" Jun 08 12:43:27.113562 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:27.113491 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fpwsv_a8d1e947-d56d-46ed-889e-33ee22b588fd/kube-rbac-proxy/0.log" Jun 08 12:43:27.150291 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:27.150138 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fpwsv_a8d1e947-d56d-46ed-889e-33ee22b588fd/init-textfile/0.log" Jun 08 12:43:27.473409 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:27.473276 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2bd9f54c-93f0-4af1-82f6-5b432a268dbc/prometheus/0.log" Jun 08 12:43:27.503267 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:27.503126 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2bd9f54c-93f0-4af1-82f6-5b432a268dbc/config-reloader/0.log" Jun 08 12:43:27.535198 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:27.535150 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2bd9f54c-93f0-4af1-82f6-5b432a268dbc/thanos-sidecar/0.log" Jun 08 12:43:27.562273 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:27.562248 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2bd9f54c-93f0-4af1-82f6-5b432a268dbc/kube-rbac-proxy-web/0.log" Jun 08 12:43:27.588522 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:27.588452 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2bd9f54c-93f0-4af1-82f6-5b432a268dbc/kube-rbac-proxy/0.log" Jun 08 12:43:27.620197 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:27.620166 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2bd9f54c-93f0-4af1-82f6-5b432a268dbc/kube-rbac-proxy-thanos/0.log" Jun 08 12:43:27.657286 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:27.657254 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2bd9f54c-93f0-4af1-82f6-5b432a268dbc/init-config-reloader/0.log" Jun 08 12:43:27.794428 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:27.794348 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-ksrrb_0a205280-732c-4f01-a1f0-ba3e966f9166/prometheus-operator-admission-webhook/0.log" Jun 08 12:43:27.829271 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:27.829245 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5689b5c5df-r89mj_8debbfba-a053-4587-8a8b-6524cb45bd35/telemeter-client/0.log" Jun 08 12:43:27.865616 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:27.865589 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5689b5c5df-r89mj_8debbfba-a053-4587-8a8b-6524cb45bd35/reload/0.log" Jun 08 12:43:27.893626 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:27.893593 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5689b5c5df-r89mj_8debbfba-a053-4587-8a8b-6524cb45bd35/kube-rbac-proxy/0.log" Jun 08 12:43:27.933720 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:27.933687 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b4dd9c845-hj9p5_a44dd565-96e2-442c-a90f-4dc1a38d7b66/thanos-query/0.log" Jun 08 12:43:27.961739 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:27.961709 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b4dd9c845-hj9p5_a44dd565-96e2-442c-a90f-4dc1a38d7b66/kube-rbac-proxy-web/0.log" Jun 08 12:43:27.995362 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:27.995334 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b4dd9c845-hj9p5_a44dd565-96e2-442c-a90f-4dc1a38d7b66/kube-rbac-proxy/0.log" Jun 08 12:43:28.028559 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:28.028530 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b4dd9c845-hj9p5_a44dd565-96e2-442c-a90f-4dc1a38d7b66/prom-label-proxy/0.log" Jun 08 12:43:28.056056 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:28.056035 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b4dd9c845-hj9p5_a44dd565-96e2-442c-a90f-4dc1a38d7b66/kube-rbac-proxy-rules/0.log" Jun 08 12:43:28.088356 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:28.088329 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b4dd9c845-hj9p5_a44dd565-96e2-442c-a90f-4dc1a38d7b66/kube-rbac-proxy-metrics/0.log" Jun 08 12:43:30.504868 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:30.504772 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wz44x/perf-node-gather-daemonset-tkqcg"] Jun 08 12:43:30.512678 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:30.512652 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-tkqcg" Jun 08 12:43:30.517475 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:30.517443 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wz44x/perf-node-gather-daemonset-tkqcg"] Jun 08 12:43:30.606003 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:30.605952 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fde9ff48-e2aa-4858-86d5-18bb005fa861-lib-modules\") pod \"perf-node-gather-daemonset-tkqcg\" (UID: \"fde9ff48-e2aa-4858-86d5-18bb005fa861\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-tkqcg" Jun 08 12:43:30.606188 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:30.606039 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fde9ff48-e2aa-4858-86d5-18bb005fa861-podres\") pod \"perf-node-gather-daemonset-tkqcg\" (UID: \"fde9ff48-e2aa-4858-86d5-18bb005fa861\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-tkqcg" Jun 08 12:43:30.606188 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:30.606073 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fde9ff48-e2aa-4858-86d5-18bb005fa861-sys\") pod \"perf-node-gather-daemonset-tkqcg\" (UID: \"fde9ff48-e2aa-4858-86d5-18bb005fa861\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-tkqcg" Jun 08 12:43:30.606188 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:30.606096 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2b8x\" (UniqueName: \"kubernetes.io/projected/fde9ff48-e2aa-4858-86d5-18bb005fa861-kube-api-access-k2b8x\") pod \"perf-node-gather-daemonset-tkqcg\" (UID: \"fde9ff48-e2aa-4858-86d5-18bb005fa861\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-tkqcg" Jun 08 12:43:30.606401 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:30.606196 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fde9ff48-e2aa-4858-86d5-18bb005fa861-proc\") pod \"perf-node-gather-daemonset-tkqcg\" (UID: \"fde9ff48-e2aa-4858-86d5-18bb005fa861\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-tkqcg" Jun 08 12:43:30.707547 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:30.707517 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fde9ff48-e2aa-4858-86d5-18bb005fa861-proc\") pod \"perf-node-gather-daemonset-tkqcg\" (UID: \"fde9ff48-e2aa-4858-86d5-18bb005fa861\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-tkqcg" Jun 08 12:43:30.707725 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:30.707591 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fde9ff48-e2aa-4858-86d5-18bb005fa861-lib-modules\") pod \"perf-node-gather-daemonset-tkqcg\" (UID: \"fde9ff48-e2aa-4858-86d5-18bb005fa861\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-tkqcg" Jun 08 12:43:30.707725 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:30.707635 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fde9ff48-e2aa-4858-86d5-18bb005fa861-podres\") pod \"perf-node-gather-daemonset-tkqcg\" (UID: \"fde9ff48-e2aa-4858-86d5-18bb005fa861\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-tkqcg" Jun 08 12:43:30.707725 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:30.707648 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fde9ff48-e2aa-4858-86d5-18bb005fa861-proc\") pod \"perf-node-gather-daemonset-tkqcg\" (UID: \"fde9ff48-e2aa-4858-86d5-18bb005fa861\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-tkqcg" Jun 08 12:43:30.707890 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:30.707726 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fde9ff48-e2aa-4858-86d5-18bb005fa861-sys\") pod \"perf-node-gather-daemonset-tkqcg\" (UID: \"fde9ff48-e2aa-4858-86d5-18bb005fa861\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-tkqcg" Jun 08 12:43:30.707890 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:30.707774 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fde9ff48-e2aa-4858-86d5-18bb005fa861-podres\") pod \"perf-node-gather-daemonset-tkqcg\" (UID: \"fde9ff48-e2aa-4858-86d5-18bb005fa861\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-tkqcg" Jun 08 12:43:30.707890 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:30.707661 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fde9ff48-e2aa-4858-86d5-18bb005fa861-sys\") pod \"perf-node-gather-daemonset-tkqcg\" (UID: \"fde9ff48-e2aa-4858-86d5-18bb005fa861\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-tkqcg" Jun 08 12:43:30.707890 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:30.707817 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2b8x\" (UniqueName: \"kubernetes.io/projected/fde9ff48-e2aa-4858-86d5-18bb005fa861-kube-api-access-k2b8x\") pod \"perf-node-gather-daemonset-tkqcg\" (UID: \"fde9ff48-e2aa-4858-86d5-18bb005fa861\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-tkqcg" Jun 08 12:43:30.707890 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:30.707830 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fde9ff48-e2aa-4858-86d5-18bb005fa861-lib-modules\") pod \"perf-node-gather-daemonset-tkqcg\" (UID: \"fde9ff48-e2aa-4858-86d5-18bb005fa861\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-tkqcg" Jun 08 12:43:30.717423 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:30.717380 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2b8x\" (UniqueName: \"kubernetes.io/projected/fde9ff48-e2aa-4858-86d5-18bb005fa861-kube-api-access-k2b8x\") pod \"perf-node-gather-daemonset-tkqcg\" (UID: \"fde9ff48-e2aa-4858-86d5-18bb005fa861\") " pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-tkqcg" Jun 08 12:43:30.824162 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:30.824127 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-tkqcg" Jun 08 12:43:31.002917 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:31.002355 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wz44x/perf-node-gather-daemonset-tkqcg"] Jun 08 12:43:31.497240 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:31.497135 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-tkqcg" event={"ID":"fde9ff48-e2aa-4858-86d5-18bb005fa861","Type":"ContainerStarted","Data":"6d464597455e15ac3414c61e7da155cc6bac705fc688406f61b0e159a46ce58c"} Jun 08 12:43:31.497240 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:31.497216 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-tkqcg" Jun 08 12:43:31.497596 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:31.497242 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-tkqcg" event={"ID":"fde9ff48-e2aa-4858-86d5-18bb005fa861","Type":"ContainerStarted","Data":"95e5f8078a5e347015ce3392d67a421a20fd2fe465b02604bb6345c3dc17b233"} Jun 08 12:43:31.515955 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:31.515351 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-tkqcg" podStartSLOduration=1.51533061 podStartE2EDuration="1.51533061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:43:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:43:31.513374745 +0000 UTC m=+2332.841723394" watchObservedRunningTime="2026-06-08 12:43:31.51533061 +0000 UTC m=+2332.843679259" Jun 08 12:43:32.470248 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:32.470212 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kcc8l_e7ae58fd-3b0e-48b3-91bb-e9ee538e8895/dns/0.log" Jun 08 12:43:32.495074 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:32.495042 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kcc8l_e7ae58fd-3b0e-48b3-91bb-e9ee538e8895/kube-rbac-proxy/0.log" Jun 08 12:43:32.570584 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:32.570559 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w4wf6_eee4acbf-8c90-49e2-8573-d2386ae891cc/dns-node-resolver/0.log" Jun 08 12:43:33.195477 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:33.195450 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xz292_af53aaaa-69bd-4d1e-9fb7-6eaf4b58fb13/node-ca/0.log" Jun 08 12:43:34.170553 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:34.170524 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795qj85p_13418ac1-9288-43c8-b4a5-8b3c3b77e00e/istio-proxy/0.log" Jun 08 12:43:34.369206 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:34.369169 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lzvtx_4a2144c9-373e-405d-a9a5-a56c4f31d5cf/istio-proxy/0.log" Jun 08 12:43:34.436252 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:34.436169 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lzvtx_4a2144c9-373e-405d-a9a5-a56c4f31d5cf/istio-proxy/1.log" Jun 08 12:43:35.258122 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:35.258093 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t4z7r_3f729f0e-de15-48e8-ae58-d85687aa7a72/serve-healthcheck-canary/0.log" Jun 08 12:43:35.786668 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:35.786638 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-hqv87_d5ec04a0-580b-44a0-a883-051acfdd1eb6/insights-operator/0.log" Jun 08 12:43:35.788744 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:35.788717 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-hqv87_d5ec04a0-580b-44a0-a883-051acfdd1eb6/insights-operator/1.log" Jun 08 12:43:35.810696 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:35.810668 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5th2j_20a0d005-c050-4c9d-ae42-2feea0eb416b/kube-rbac-proxy/0.log" Jun 08 12:43:35.837817 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:35.837766 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5th2j_20a0d005-c050-4c9d-ae42-2feea0eb416b/exporter/0.log" Jun 08 12:43:35.870060 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:35.870029 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5th2j_20a0d005-c050-4c9d-ae42-2feea0eb416b/extractor/0.log" Jun 08 12:43:37.513622 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:37.513592 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wz44x/perf-node-gather-daemonset-tkqcg" Jun 08 12:43:38.344100 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:38.344073 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6b6d49959d-r5trc_17104e02-d81f-4d96-b951-7b2ab65b0c4c/nginx/0.log" Jun 08 12:43:38.571647 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:38.571622 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5499cf4f78-7gqjh_f7677855-92eb-470c-9ab8-c3234a346e50/maas-api/0.log" Jun 08 12:43:38.693564 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:38.693485 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-8rtcw_9db910d5-0a1c-4f21-8203-8a8f1e2784f9/server/0.log" Jun 08 12:43:38.771562 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:38.771514 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-854df88b87-7nztq_2f1e5fd5-f28c-44ea-a9b5-748ced270b99/manager/0.log" Jun 08 12:43:38.794411 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:38.794388 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-854df88b87-7nztq_2f1e5fd5-f28c-44ea-a9b5-748ced270b99/copy-manifests/0.log" Jun 08 12:43:40.849434 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:40.849376 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-59f754cb69-mtzhk_2f454530-5f00-4bc5-a8c8-2ae2f18aff01/manager/0.log" Jun 08 12:43:43.824348 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:43.824297 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795qj85p_13418ac1-9288-43c8-b4a5-8b3c3b77e00e/istio-proxy/0.log" Jun 08 12:43:43.992101 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:43.992061 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lzvtx_4a2144c9-373e-405d-a9a5-a56c4f31d5cf/istio-proxy/0.log" Jun 08 12:43:44.043471 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:44.043446 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lzvtx_4a2144c9-373e-405d-a9a5-a56c4f31d5cf/istio-proxy/1.log" Jun 08 12:43:45.214634 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:45.214602 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795qj85p_13418ac1-9288-43c8-b4a5-8b3c3b77e00e/istio-proxy/0.log" Jun 08 12:43:45.381218 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:45.381188 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lzvtx_4a2144c9-373e-405d-a9a5-a56c4f31d5cf/istio-proxy/0.log" Jun 08 12:43:45.441213 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:45.441175 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lzvtx_4a2144c9-373e-405d-a9a5-a56c4f31d5cf/istio-proxy/1.log" Jun 08 12:43:46.185905 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:46.185871 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-grts6_8707cb3e-5f4b-45e7-89b1-f290850e6832/migrator/0.log" Jun 08 12:43:46.207522 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:46.207491 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-grts6_8707cb3e-5f4b-45e7-89b1-f290850e6832/graceful-termination/0.log" Jun 08 12:43:47.332259 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:47.332230 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795qj85p_13418ac1-9288-43c8-b4a5-8b3c3b77e00e/istio-proxy/0.log" Jun 08 12:43:47.488869 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:47.488836 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lzvtx_4a2144c9-373e-405d-a9a5-a56c4f31d5cf/istio-proxy/0.log" Jun 08 12:43:47.561366 ip-10-0-133-35 kubenswrapper[2565]: I0608 12:43:47.561271 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lzvtx_4a2144c9-373e-405d-a9a5-a56c4f31d5cf/istio-proxy/1.log"