Jul 14 11:37:47.917191 ip-10-0-136-205 systemd[1]: Starting Kubernetes Kubelet... Jul 14 11:37:48.353103 ip-10-0-136-205 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 11:37:48.353103 ip-10-0-136-205 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 14 11:37:48.353103 ip-10-0-136-205 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 11:37:48.353103 ip-10-0-136-205 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 14 11:37:48.353103 ip-10-0-136-205 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 11:37:48.353103 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.348203 2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 14 11:37:48.354750 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354282 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 11:37:48.354750 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354301 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 11:37:48.354750 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354307 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 11:37:48.354750 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354311 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 11:37:48.354750 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354315 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 11:37:48.354750 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354320 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 11:37:48.354750 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354323 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 11:37:48.354750 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354326 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 11:37:48.354750 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354329 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 11:37:48.354750 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354332 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 11:37:48.354750 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354335 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 11:37:48.354750 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354337 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 11:37:48.354750 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354340 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 11:37:48.354750 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354345 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 11:37:48.354750 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354349 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 11:37:48.354750 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354354 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 11:37:48.354750 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354357 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 11:37:48.354750 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354360 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 11:37:48.354750 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354364 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 11:37:48.355285 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354369 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 11:37:48.355285 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354382 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 11:37:48.355285 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354386 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 11:37:48.355285 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354390 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 11:37:48.355285 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354393 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 11:37:48.355285 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354396 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 11:37:48.355285 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354399 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 11:37:48.355285 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354405 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 11:37:48.355285 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354408 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 11:37:48.355285 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354412 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 11:37:48.355285 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354415 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 11:37:48.355285 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354418 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 11:37:48.355285 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354420 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 11:37:48.355285 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354425 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 11:37:48.355285 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354428 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 11:37:48.355285 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354430 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 11:37:48.355285 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354434 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 11:37:48.355285 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354438 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 11:37:48.355285 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354441 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 11:37:48.355285 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354445 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 11:37:48.355831 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354450 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 11:37:48.355831 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354456 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 11:37:48.355831 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354460 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 11:37:48.355831 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354463 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 11:37:48.355831 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354467 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 11:37:48.355831 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354471 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 11:37:48.355831 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354474 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 11:37:48.355831 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354476 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 11:37:48.355831 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354479 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 14 11:37:48.355831 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354483 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 11:37:48.355831 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354485 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 11:37:48.355831 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354488 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 11:37:48.355831 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354491 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 11:37:48.355831 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354495 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 11:37:48.355831 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354498 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 11:37:48.355831 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354500 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 11:37:48.355831 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354503 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 11:37:48.355831 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354507 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 11:37:48.355831 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354511 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 11:37:48.355831 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354514 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 11:37:48.356400 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354516 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 11:37:48.356400 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354520 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 11:37:48.356400 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354523 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 11:37:48.356400 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354526 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 11:37:48.356400 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354529 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 11:37:48.356400 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354532 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 11:37:48.356400 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354535 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 11:37:48.356400 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354538 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 11:37:48.356400 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354540 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 11:37:48.356400 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354542 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 11:37:48.356400 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354545 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 11:37:48.356400 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354547 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 11:37:48.356400 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354552 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 11:37:48.356400 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354555 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 11:37:48.356400 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354557 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 11:37:48.356400 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354560 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 11:37:48.356400 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354564 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 11:37:48.356400 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354566 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 11:37:48.356400 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354570 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 11:37:48.356943 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354575 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 11:37:48.356943 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354578 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 11:37:48.356943 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354581 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 11:37:48.356943 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354584 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 11:37:48.356943 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354587 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 11:37:48.356943 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354590 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 11:37:48.356943 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354593 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 11:37:48.356943 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354596 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 11:37:48.356943 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354599 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 11:37:48.356943 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354602 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 11:37:48.356943 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354605 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 11:37:48.356943 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354608 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 11:37:48.356943 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354612 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 11:37:48.356943 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354615 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 11:37:48.356943 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354617 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 11:37:48.356943 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354621 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 11:37:48.356943 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354624 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 11:37:48.356943 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354627 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 11:37:48.356943 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354629 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 11:37:48.357492 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354631 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 11:37:48.357492 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.354635 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 11:37:48.357492 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355433 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 11:37:48.357492 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355440 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 11:37:48.357492 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355445 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 11:37:48.357492 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355449 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 11:37:48.357492 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355453 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 11:37:48.357492 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355457 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 11:37:48.357492 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355460 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 11:37:48.357492 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355463 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 11:37:48.357492 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355466 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 11:37:48.357492 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355469 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 11:37:48.357492 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355472 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 11:37:48.357492 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355474 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 11:37:48.357492 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355477 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 14 11:37:48.357492 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355479 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 11:37:48.357492 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355482 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 11:37:48.357492 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355485 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 11:37:48.357492 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355487 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 11:37:48.357492 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355490 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 11:37:48.358079 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355492 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 11:37:48.358079 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355494 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 11:37:48.358079 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355497 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 11:37:48.358079 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355500 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 11:37:48.358079 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355502 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 11:37:48.358079 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355505 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 11:37:48.358079 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355507 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 11:37:48.358079 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355510 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 11:37:48.358079 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355512 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 11:37:48.358079 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355515 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 11:37:48.358079 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355518 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 11:37:48.358079 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355521 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 11:37:48.358079 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355524 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 11:37:48.358079 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355526 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 11:37:48.358079 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355529 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 11:37:48.358079 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355531 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 11:37:48.358079 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355534 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 11:37:48.358079 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355536 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 11:37:48.358079 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355539 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 11:37:48.358079 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355542 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 11:37:48.358639 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355549 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 11:37:48.358639 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355551 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 11:37:48.358639 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355554 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 11:37:48.358639 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355557 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 11:37:48.358639 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355560 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 11:37:48.358639 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355563 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 11:37:48.358639 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355565 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 11:37:48.358639 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355568 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 11:37:48.358639 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355570 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 11:37:48.358639 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355573 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 11:37:48.358639 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355575 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 11:37:48.358639 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355578 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 11:37:48.358639 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355581 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 11:37:48.358639 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355583 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 11:37:48.358639 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355587 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 11:37:48.358639 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355590 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 11:37:48.358639 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355594 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 11:37:48.358639 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355596 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 11:37:48.358639 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355599 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 11:37:48.359185 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355602 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 11:37:48.359185 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355605 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 11:37:48.359185 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355608 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 11:37:48.359185 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355610 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 11:37:48.359185 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355614 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 11:37:48.359185 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355616 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 11:37:48.359185 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355619 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 11:37:48.359185 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355621 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 11:37:48.359185 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355624 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 11:37:48.359185 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355626 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 11:37:48.359185 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355629 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 11:37:48.359185 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355632 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 11:37:48.359185 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355634 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 11:37:48.359185 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355637 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 11:37:48.359185 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355640 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 11:37:48.359185 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355643 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 11:37:48.359185 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355646 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 11:37:48.359185 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355648 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 11:37:48.359185 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355651 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 11:37:48.359185 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355653 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 11:37:48.359768 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355658 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 11:37:48.359768 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355661 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 11:37:48.359768 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355664 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 11:37:48.359768 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355666 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 11:37:48.359768 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355669 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 11:37:48.359768 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355672 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 11:37:48.359768 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355674 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 11:37:48.359768 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355677 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 11:37:48.359768 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355679 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 11:37:48.359768 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355681 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 11:37:48.359768 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355684 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 11:37:48.359768 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355687 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 11:37:48.359768 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355689 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 11:37:48.359768 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355692 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 11:37:48.359768 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355694 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 11:37:48.359768 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355697 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 11:37:48.359768 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355699 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 11:37:48.359768 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355703 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 11:37:48.359768 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355705 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 11:37:48.360320 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355708 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 11:37:48.360320 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355711 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 11:37:48.360320 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.355714 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 11:37:48.360320 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356138 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 11:37:48.360320 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356143 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 11:37:48.360320 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356147 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 11:37:48.360320 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356149 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 11:37:48.360320 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356153 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 11:37:48.360320 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356155 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 11:37:48.360320 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356158 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 11:37:48.360320 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356161 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 11:37:48.360320 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356165 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 11:37:48.360320 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356169 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 11:37:48.360320 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356172 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 11:37:48.360320 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356174 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 11:37:48.360320 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356177 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 11:37:48.360320 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356180 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 11:37:48.360320 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356183 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 11:37:48.360320 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356186 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 11:37:48.360320 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356189 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 11:37:48.360964 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356191 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 11:37:48.360964 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356194 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 11:37:48.360964 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356196 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 11:37:48.360964 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356199 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 11:37:48.360964 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356202 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 11:37:48.360964 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356204 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 11:37:48.360964 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356207 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 11:37:48.360964 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356210 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 11:37:48.360964 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356214 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 11:37:48.360964 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356218 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 11:37:48.360964 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356221 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 11:37:48.360964 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356224 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 11:37:48.360964 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356226 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 11:37:48.360964 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356229 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 11:37:48.360964 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356231 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 11:37:48.360964 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356234 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 11:37:48.360964 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356236 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 11:37:48.360964 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356240 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 11:37:48.360964 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356242 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 11:37:48.360964 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356245 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 11:37:48.361510 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356249 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 11:37:48.361510 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356251 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 11:37:48.361510 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356254 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 11:37:48.361510 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356257 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 11:37:48.361510 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356259 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 11:37:48.361510 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356261 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 11:37:48.361510 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356264 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 11:37:48.361510 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356267 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 11:37:48.361510 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356269 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 11:37:48.361510 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356272 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 11:37:48.361510 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356274 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 11:37:48.361510 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356277 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 11:37:48.361510 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356279 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 11:37:48.361510 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356282 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 11:37:48.361510 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356285 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 11:37:48.361510 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356287 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 11:37:48.361510 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356290 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 11:37:48.361510 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356293 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 11:37:48.361510 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356296 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 11:37:48.362197 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356299 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 11:37:48.362197 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356301 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 11:37:48.362197 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356304 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 11:37:48.362197 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356306 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 11:37:48.362197 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356309 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 11:37:48.362197 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356312 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 11:37:48.362197 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356317 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 11:37:48.362197 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356321 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 11:37:48.362197 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356324 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 11:37:48.362197 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356326 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 11:37:48.362197 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356329 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 11:37:48.362197 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356331 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 14 11:37:48.362197 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356334 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 11:37:48.362197 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356336 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 11:37:48.362197 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356339 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 11:37:48.362197 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356342 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 11:37:48.362197 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356345 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 11:37:48.362197 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356347 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 11:37:48.362197 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356349 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 11:37:48.362197 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356352 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 11:37:48.362751 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356355 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 11:37:48.362751 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356358 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 11:37:48.362751 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356360 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 11:37:48.362751 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356364 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 11:37:48.362751 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356367 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 11:37:48.362751 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356370 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 11:37:48.362751 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356373 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 11:37:48.362751 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356376 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 11:37:48.362751 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356378 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 11:37:48.362751 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356380 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 11:37:48.362751 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356383 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 11:37:48.362751 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356385 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 11:37:48.362751 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356388 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 11:37:48.362751 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356390 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 11:37:48.362751 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356393 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 11:37:48.362751 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356395 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 11:37:48.362751 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356398 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 11:37:48.362751 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356401 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 11:37:48.362751 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356404 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 11:37:48.363343 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356407 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 11:37:48.363343 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356409 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 11:37:48.363343 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356412 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 11:37:48.363343 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.356415 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 11:37:48.363343 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356503 2582 flags.go:64] FLAG: --address="0.0.0.0" Jul 14 11:37:48.363343 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356514 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 14 11:37:48.363343 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356529 2582 flags.go:64] FLAG: --anonymous-auth="true" Jul 14 11:37:48.363343 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356536 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 14 11:37:48.363343 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356542 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 14 11:37:48.363343 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356545 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 14 11:37:48.363343 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356549 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 14 11:37:48.363343 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356553 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 14 11:37:48.363343 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356559 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 14 11:37:48.363343 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356562 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 14 11:37:48.363343 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356565 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 14 11:37:48.363343 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356569 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 14 11:37:48.363343 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356572 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 14 11:37:48.363343 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356575 2582 flags.go:64] FLAG: --cgroup-root="" Jul 14 11:37:48.363343 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356578 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 14 11:37:48.363343 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356581 2582 flags.go:64] FLAG: --client-ca-file="" Jul 14 11:37:48.363343 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356584 2582 flags.go:64] FLAG: --cloud-provider="external" Jul 14 11:37:48.363343 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356587 2582 flags.go:64] FLAG: --cluster-dns="[]" Jul 14 11:37:48.363343 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356592 2582 flags.go:64] FLAG: --cluster-domain="" Jul 14 11:37:48.364011 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356595 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 14 11:37:48.364011 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356598 2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 14 11:37:48.364011 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356601 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 14 11:37:48.364011 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356605 2582 flags.go:64] FLAG: --container-log-max-files="5" Jul 14 11:37:48.364011 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356608 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 14 11:37:48.364011 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356611 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 14 11:37:48.364011 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356615 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 14 11:37:48.364011 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356618 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 14 11:37:48.364011 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356621 2582 flags.go:64] FLAG: --contention-profiling="false" Jul 14 11:37:48.364011 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356624 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 14 11:37:48.364011 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356627 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 14 11:37:48.364011 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356630 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 14 11:37:48.364011 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356633 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 14 11:37:48.364011 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356638 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 14 11:37:48.364011 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356641 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 14 11:37:48.364011 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356644 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 14 11:37:48.364011 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356647 2582 flags.go:64] FLAG: --enable-load-reader="false" Jul 14 11:37:48.364011 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356650 2582 flags.go:64] FLAG: --enable-server="true" Jul 14 11:37:48.364011 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356654 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 14 11:37:48.364011 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356658 2582 flags.go:64] FLAG: --event-burst="100" Jul 14 11:37:48.364011 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356661 2582 flags.go:64] FLAG: --event-qps="50" Jul 14 11:37:48.364011 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356665 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 14 11:37:48.364011 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356669 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 14 11:37:48.364011 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356672 2582 flags.go:64] FLAG: --eviction-hard="" Jul 14 11:37:48.364681 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356676 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 14 11:37:48.364681 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356679 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 14 11:37:48.364681 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356682 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 14 11:37:48.364681 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356685 2582 flags.go:64] FLAG: --eviction-soft="" Jul 14 11:37:48.364681 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356688 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 14 11:37:48.364681 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356691 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 14 11:37:48.364681 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356694 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 14 11:37:48.364681 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356696 2582 flags.go:64] FLAG: --experimental-mounter-path="" Jul 14 11:37:48.364681 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356699 2582 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 14 11:37:48.364681 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356702 2582 flags.go:64] FLAG: --fail-swap-on="true" Jul 14 11:37:48.364681 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356705 2582 flags.go:64] FLAG: --feature-gates="" Jul 14 11:37:48.364681 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356709 2582 flags.go:64] FLAG: --file-check-frequency="20s" Jul 14 11:37:48.364681 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356727 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 14 11:37:48.364681 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356732 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 14 11:37:48.364681 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356735 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 14 11:37:48.364681 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356739 2582 flags.go:64] FLAG: --healthz-port="10248" Jul 14 11:37:48.364681 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356742 2582 flags.go:64] FLAG: --help="false" Jul 14 11:37:48.364681 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356745 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-136-205.ec2.internal" Jul 14 11:37:48.364681 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356748 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 14 11:37:48.364681 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356751 2582 flags.go:64] FLAG: --http-check-frequency="20s" Jul 14 11:37:48.364681 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356754 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 14 11:37:48.364681 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356757 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 14 11:37:48.364681 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356761 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 14 11:37:48.365360 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356764 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 14 11:37:48.365360 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356767 2582 flags.go:64] FLAG: --image-service-endpoint="" Jul 14 11:37:48.365360 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356770 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 14 11:37:48.365360 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356772 2582 flags.go:64] FLAG: --kube-api-burst="100" Jul 14 11:37:48.365360 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356776 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 14 11:37:48.365360 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356779 2582 flags.go:64] FLAG: --kube-api-qps="50" Jul 14 11:37:48.365360 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356783 2582 flags.go:64] FLAG: --kube-reserved="" Jul 14 11:37:48.365360 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356788 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 14 11:37:48.365360 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356790 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 14 11:37:48.365360 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356793 2582 flags.go:64] FLAG: --kubelet-cgroups="" Jul 14 11:37:48.365360 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356796 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 14 11:37:48.365360 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356799 2582 flags.go:64] FLAG: --lock-file="" Jul 14 11:37:48.365360 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356802 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 14 11:37:48.365360 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356804 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 14 11:37:48.365360 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356808 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 14 11:37:48.365360 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356813 2582 flags.go:64] FLAG: --log-json-split-stream="false" Jul 14 11:37:48.365360 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356816 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 14 11:37:48.365360 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356819 2582 flags.go:64] FLAG: --log-text-split-stream="false" Jul 14 11:37:48.365360 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356822 2582 flags.go:64] FLAG: --logging-format="text" Jul 14 11:37:48.365360 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356825 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 14 11:37:48.365360 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356829 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 14 11:37:48.365360 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356831 2582 flags.go:64] FLAG: --manifest-url="" Jul 14 11:37:48.365360 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356848 2582 flags.go:64] FLAG: --manifest-url-header="" Jul 14 11:37:48.365360 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356853 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 14 11:37:48.365360 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356857 2582 flags.go:64] FLAG: --max-open-files="1000000" Jul 14 11:37:50.063784 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356861 2582 flags.go:64] FLAG: --max-pods="110" Jul 14 11:37:50.063784 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356864 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 14 11:37:50.063784 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356867 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 14 11:37:50.063784 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356870 2582 flags.go:64] FLAG: --memory-manager-policy="None" Jul 14 11:37:50.063784 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356873 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 14 11:37:50.063784 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356876 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 14 11:37:50.063784 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356879 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 14 11:37:50.063784 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356882 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 14 11:37:50.063784 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356891 2582 flags.go:64] FLAG: --node-status-max-images="50" Jul 14 11:37:50.063784 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356894 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 14 11:37:50.063784 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356897 2582 flags.go:64] FLAG: --oom-score-adj="-999" Jul 14 11:37:50.063784 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356900 2582 flags.go:64] FLAG: --pod-cidr="" Jul 14 11:37:50.063784 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356903 2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 14 11:37:50.063784 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356908 2582 flags.go:64] FLAG: --pod-manifest-path="" Jul 14 11:37:50.063784 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356914 2582 flags.go:64] FLAG: --pod-max-pids="-1" Jul 14 11:37:50.063784 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356917 2582 flags.go:64] FLAG: --pods-per-core="0" Jul 14 11:37:50.063784 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356920 2582 flags.go:64] FLAG: --port="10250" Jul 14 11:37:50.063784 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356923 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 14 11:37:50.063784 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356926 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d55aaac5e47e3ee1" Jul 14 11:37:50.063784 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356929 2582 flags.go:64] FLAG: --qos-reserved="" Jul 14 11:37:50.063784 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356932 2582 flags.go:64] FLAG: --read-only-port="10255" Jul 14 11:37:50.063784 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356935 2582 flags.go:64] FLAG: --register-node="true" Jul 14 11:37:50.063784 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356938 2582 flags.go:64] FLAG: --register-with-taints="" Jul 14 11:37:50.063784 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356941 2582 flags.go:64] FLAG: --registry-burst="10" Jul 14 11:37:50.032200 ip-10-0-136-205 systemd[1]: Started Kubernetes Kubelet. Jul 14 11:37:50.065811 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356944 2582 flags.go:64] FLAG: --registry-qps="5" Jul 14 11:37:50.065811 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356947 2582 flags.go:64] FLAG: --reserved-cpus="" Jul 14 11:37:50.065811 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356950 2582 flags.go:64] FLAG: --reserved-memory="" Jul 14 11:37:50.065811 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356955 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 14 11:37:50.065811 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356958 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 14 11:37:50.065811 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356961 2582 flags.go:64] FLAG: --rotate-certificates="false" Jul 14 11:37:50.065811 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356964 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 14 11:37:50.065811 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356966 2582 flags.go:64] FLAG: --runonce="false" Jul 14 11:37:50.065811 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356969 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 14 11:37:50.065811 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356972 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 14 11:37:50.065811 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356975 2582 flags.go:64] FLAG: --seccomp-default="false" Jul 14 11:37:50.065811 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356978 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 14 11:37:50.065811 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356981 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 14 11:37:50.065811 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356983 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 14 11:37:50.065811 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356987 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 14 11:37:50.065811 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356990 2582 flags.go:64] FLAG: --storage-driver-password="root" Jul 14 11:37:50.065811 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356993 2582 flags.go:64] FLAG: --storage-driver-secure="false" Jul 14 11:37:50.065811 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356996 2582 flags.go:64] FLAG: --storage-driver-table="stats" Jul 14 11:37:50.065811 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.356999 2582 flags.go:64] FLAG: --storage-driver-user="root" Jul 14 11:37:50.065811 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.357002 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 14 11:37:50.065811 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.357005 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 14 11:37:50.065811 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.357008 2582 flags.go:64] FLAG: --system-cgroups="" Jul 14 11:37:50.065811 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.357014 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 14 11:37:50.065811 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.357020 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 14 11:37:50.065811 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.357023 2582 flags.go:64] FLAG: --tls-cert-file="" Jul 14 11:37:50.067499 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.357026 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 14 11:37:50.067499 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.357031 2582 flags.go:64] FLAG: --tls-min-version="" Jul 14 11:37:50.067499 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.357034 2582 flags.go:64] FLAG: --tls-private-key-file="" Jul 14 11:37:50.067499 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.357036 2582 flags.go:64] FLAG: --topology-manager-policy="none" Jul 14 11:37:50.067499 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.357039 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 14 11:37:50.067499 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.357042 2582 flags.go:64] FLAG: --topology-manager-scope="container" Jul 14 11:37:50.067499 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.357045 2582 flags.go:64] FLAG: --v="2" Jul 14 11:37:50.067499 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.357049 2582 flags.go:64] FLAG: --version="false" Jul 14 11:37:50.067499 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.357056 2582 flags.go:64] FLAG: --vmodule="" Jul 14 11:37:50.067499 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.357060 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 14 11:37:50.067499 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.357063 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 14 11:37:50.067499 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357182 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 11:37:50.067499 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357187 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 11:37:50.067499 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357191 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 11:37:50.067499 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357194 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 11:37:50.067499 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357198 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 11:37:50.067499 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357200 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 11:37:50.067499 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357203 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 11:37:50.067499 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357205 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 11:37:50.067499 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357208 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 11:37:50.067499 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357211 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 11:37:50.067499 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357213 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 11:37:50.068264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357216 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 11:37:50.068264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357219 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 11:37:50.068264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357221 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 11:37:50.068264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357224 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 11:37:50.068264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357226 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 11:37:50.068264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357229 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 11:37:50.068264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357232 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 11:37:50.068264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357238 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 11:37:50.068264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357241 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 11:37:50.068264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357244 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 11:37:50.068264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357246 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 11:37:50.068264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357249 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 11:37:50.068264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357251 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 11:37:50.068264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357254 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 11:37:50.068264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357257 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 11:37:50.068264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357259 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 11:37:50.068264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357262 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 11:37:50.068264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357265 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 11:37:50.068264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357267 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 11:37:50.068264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357270 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 11:37:50.071151 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357273 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 11:37:50.071151 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357275 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 11:37:50.071151 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357278 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 11:37:50.071151 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357282 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 11:37:50.071151 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357286 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 11:37:50.071151 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357289 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 11:37:50.071151 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357291 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 11:37:50.071151 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357294 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 11:37:50.071151 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357296 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 11:37:50.071151 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357299 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 11:37:50.071151 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357301 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 11:37:50.071151 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357304 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 11:37:50.071151 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357306 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 11:37:50.071151 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357309 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 11:37:50.071151 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357312 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 11:37:50.071151 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357314 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 11:37:50.071151 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357317 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 11:37:50.071151 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357319 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 11:37:50.071151 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357322 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 11:37:50.071882 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357327 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 11:37:50.071882 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357330 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 11:37:50.071882 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357333 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 11:37:50.071882 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357335 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 11:37:50.071882 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357338 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 11:37:50.071882 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357340 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 11:37:50.071882 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357343 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 11:37:50.071882 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357345 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 11:37:50.071882 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357348 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 11:37:50.071882 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357351 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 11:37:50.071882 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357353 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 11:37:50.071882 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357356 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 14 11:37:50.071882 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357359 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 11:37:50.071882 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357361 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 11:37:50.071882 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357364 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 11:37:50.071882 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357366 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 11:37:50.071882 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357369 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 11:37:50.071882 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357371 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 11:37:50.071882 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357374 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 11:37:50.071882 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357376 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 11:37:50.071882 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357379 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 11:37:50.073049 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357381 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 11:37:50.073049 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357384 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 11:37:50.073049 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357386 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 11:37:50.073049 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357389 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 11:37:50.073049 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357393 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 11:37:50.073049 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357396 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 11:37:50.073049 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357399 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 11:37:50.073049 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357402 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 11:37:50.073049 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357404 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 11:37:50.073049 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357407 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 11:37:50.073049 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357410 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 11:37:50.073049 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357415 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 11:37:50.073049 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357417 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 11:37:50.073049 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357421 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 11:37:50.073049 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357423 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 11:37:50.073049 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357426 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 11:37:50.073049 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357429 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 11:37:50.073049 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357432 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 11:37:50.073049 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357434 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 11:37:50.073667 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357437 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 11:37:50.073667 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357439 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 11:37:50.073667 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357441 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 11:37:50.073667 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357444 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 11:37:50.073667 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357446 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 11:37:50.073667 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357449 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 11:37:50.073667 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357451 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 11:37:50.073667 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357454 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 11:37:50.073667 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.357456 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 11:37:50.073667 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.359088 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 11:37:50.073667 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.366577 2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 14 11:37:50.073667 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.366596 2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 14 11:37:50.073667 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.366619 2582 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 14 11:37:50.073667 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.366626 2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 14 11:37:50.074264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366700 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 11:37:50.074264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366706 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 11:37:50.074264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366711 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 11:37:50.074264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366715 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 11:37:50.074264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366718 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 11:37:50.074264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366721 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 11:37:50.074264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366724 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 11:37:50.074264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366727 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 11:37:50.074264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366730 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 11:37:50.074264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366733 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 11:37:50.074264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366736 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 14 11:37:50.074264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366738 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 11:37:50.074264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366741 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 11:37:50.074264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366743 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 11:37:50.074264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366746 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 11:37:50.074264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366749 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 11:37:50.074264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366751 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 11:37:50.074264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366754 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 11:37:50.074264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366756 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 11:37:50.074264 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366759 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 11:37:50.074921 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366761 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 11:37:50.074921 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366764 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 11:37:50.074921 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366766 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 11:37:50.074921 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366769 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 11:37:50.074921 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366772 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 11:37:50.074921 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366775 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 11:37:50.074921 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366779 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 11:37:50.074921 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366782 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 11:37:50.074921 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366785 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 11:37:50.074921 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366789 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 11:37:50.074921 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366792 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 11:37:50.074921 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366795 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 11:37:50.074921 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366797 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 11:37:50.074921 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366800 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 11:37:50.074921 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366803 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 11:37:50.074921 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366807 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 11:37:50.074921 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366811 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 11:37:50.074921 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366814 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 11:37:50.075931 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366817 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 11:37:50.075931 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366819 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 11:37:50.075931 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366822 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 11:37:50.075931 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366825 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 11:37:50.075931 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366828 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 11:37:50.075931 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366831 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 11:37:50.075931 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366851 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 11:37:50.075931 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366855 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 11:37:50.075931 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366858 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 11:37:50.075931 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366861 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 11:37:50.075931 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366864 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 11:37:50.075931 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366867 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 11:37:50.075931 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366869 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 11:37:50.075931 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366872 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 11:37:50.075931 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366875 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 11:37:50.075931 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366877 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 11:37:50.075931 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366880 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 11:37:50.075931 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366883 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 11:37:50.075931 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366887 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 11:37:50.075931 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366890 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 11:37:50.076979 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366893 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 11:37:50.076979 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366896 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 11:37:50.076979 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366899 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 11:37:50.076979 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366901 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 11:37:50.076979 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366905 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 11:37:50.076979 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366908 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 11:37:50.076979 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366911 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 11:37:50.076979 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366913 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 11:37:50.076979 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366916 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 11:37:50.076979 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366919 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 11:37:50.076979 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366921 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 11:37:50.076979 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366924 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 11:37:50.076979 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366926 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 11:37:50.076979 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366929 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 11:37:50.076979 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366931 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 11:37:50.076979 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366934 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 11:37:50.076979 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366936 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 11:37:50.076979 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366939 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 11:37:50.076979 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366942 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 11:37:50.076979 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366944 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 11:37:50.235631 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366947 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 11:37:50.235631 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366949 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 11:37:50.235631 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366952 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 11:37:50.235631 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366954 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 11:37:50.235631 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366957 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 11:37:50.235631 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366960 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 11:37:50.235631 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366962 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 11:37:50.235631 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366965 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 11:37:50.235631 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366968 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 11:37:50.235631 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366971 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 11:37:50.235631 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366973 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 11:37:50.235631 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366977 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 11:37:50.235631 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366979 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 11:37:50.235631 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366982 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 11:37:50.235631 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366984 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 11:37:50.235631 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366986 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 11:37:50.235631 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366989 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 11:37:50.235631 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366992 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 11:37:50.235631 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366995 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 11:37:50.235631 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.366998 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 11:37:50.235631 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367000 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 11:37:50.252134 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.367005 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 11:37:50.252134 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367154 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 11:37:50.252134 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367160 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 11:37:50.252134 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367163 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 11:37:50.252134 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367166 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 11:37:50.252134 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367170 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 11:37:50.252134 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367172 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 11:37:50.252134 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367175 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 11:37:50.252134 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367178 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 11:37:50.252134 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367180 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 11:37:50.252134 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367183 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 11:37:50.252134 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367186 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 11:37:50.252134 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367189 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 11:37:50.252134 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367191 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 11:37:50.252134 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367194 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 11:37:50.252916 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367197 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 11:37:50.252916 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367199 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 11:37:50.252916 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367202 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 11:37:50.252916 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367204 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 11:37:50.252916 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367207 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 11:37:50.252916 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367210 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 11:37:50.252916 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367213 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 11:37:50.252916 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367216 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 11:37:50.252916 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367218 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 11:37:50.252916 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367221 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 11:37:50.252916 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367223 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 11:37:50.252916 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367226 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 11:37:50.252916 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367228 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 11:37:50.252916 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367231 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 11:37:50.252916 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367234 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 11:37:50.252916 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367237 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 11:37:50.252916 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367240 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 11:37:50.252916 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367242 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 11:37:50.252916 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367245 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 11:37:50.252916 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367247 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 11:37:50.253526 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367250 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 11:37:50.253526 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367253 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 14 11:37:50.253526 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367255 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 11:37:50.253526 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367257 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 11:37:50.253526 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367260 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 11:37:50.253526 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367262 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 11:37:50.253526 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367265 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 11:37:50.253526 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367267 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 11:37:50.253526 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367269 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 11:37:50.253526 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367272 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 11:37:50.253526 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367274 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 11:37:50.253526 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367277 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 11:37:50.253526 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367280 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 11:37:50.253526 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367282 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 11:37:50.253526 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367285 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 11:37:50.253526 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367288 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 11:37:50.253526 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367291 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 11:37:50.253526 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367294 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 11:37:50.253526 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367297 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 11:37:50.253526 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367302 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 11:37:50.254362 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367306 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 11:37:50.254362 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367310 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 11:37:50.254362 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367313 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 11:37:50.254362 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367315 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 11:37:50.254362 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367318 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 11:37:50.254362 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367320 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 11:37:50.254362 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367323 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 11:37:50.254362 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367326 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 11:37:50.254362 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367329 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 11:37:50.254362 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367331 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 11:37:50.254362 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367333 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 11:37:50.254362 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367336 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 11:37:50.254362 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367338 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 11:37:50.254362 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367341 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 11:37:50.254362 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367343 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 11:37:50.254362 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367345 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 11:37:50.254362 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367348 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 11:37:50.254362 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367351 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 11:37:50.254362 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367353 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 11:37:50.254913 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367356 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 11:37:50.254913 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367358 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 11:37:50.254913 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367360 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 11:37:50.254913 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367363 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 11:37:50.254913 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367365 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 11:37:50.254913 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367368 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 11:37:50.254913 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367370 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 11:37:50.254913 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367374 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 11:37:50.254913 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367378 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 11:37:50.254913 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367381 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 11:37:50.254913 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367384 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 11:37:50.254913 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367387 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 11:37:50.254913 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367389 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 11:37:50.254913 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367392 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 11:37:50.254913 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367395 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 11:37:50.254913 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367398 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 11:37:50.254913 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367401 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 11:37:50.254913 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367403 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 11:37:50.254913 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367406 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 11:37:50.254913 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367408 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 11:37:50.255755 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367411 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 11:37:50.255755 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367414 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 11:37:50.255755 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367417 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 11:37:50.255755 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367419 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 11:37:50.255755 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367422 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 11:37:50.255755 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:48.367424 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 11:37:50.255755 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.367429 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 11:37:50.255755 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:48.367559 2582 server.go:962] "Client rotation is on, will bootstrap in background" Jul 14 11:37:50.255755 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:49.972298 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 14 11:37:50.255755 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:49.973722 2582 server.go:1019] "Starting client certificate rotation" Jul 14 11:37:50.255755 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:49.973820 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 11:37:50.255755 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:49.973886 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 11:37:50.255755 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:49.978790 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 11:37:50.256233 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:49.982272 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 11:37:50.256233 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:49.994839 2582 log.go:25] "Validated CRI v1 runtime API" Jul 14 11:37:50.256233 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:49.997204 2582 log.go:25] "Validated CRI v1 image API" Jul 14 11:37:50.256233 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:49.997942 2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 14 11:37:50.256233 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.000204 2582 fs.go:135] Filesystem UUIDs: map[4354d1cc-fad1-4b1a-a5ca-ffc3b39ba576:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a393365b-6e95-4eed-88e3-5c3738b144d5:/dev/nvme0n1p3] Jul 14 11:37:50.256233 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.000236 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 14 11:37:50.256233 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.004813 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 11:37:50.256730 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.007000 2582 manager.go:216] Machine: {Timestamp:2026-07-14 11:37:50.005294487 +0000 UTC m=+0.367945785 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100302 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2455d17c7759a1509d96a9bef8d3df SystemUUID:ec2455d1-7c77-59a1-509d-96a9bef8d3df BootID:3cc5d949-6a34-4e24-9538-98b7a6594237 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:00:66:f6:40:33 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:00:66:f6:40:33 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:80:94:01:47:9c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 14 11:37:50.256730 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.007174 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 14 11:37:50.256730 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.007382 2582 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 14 11:37:50.256730 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.012931 2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 14 11:37:50.256730 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.012978 2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-205.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 14 11:37:50.256730 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.013897 2582 topology_manager.go:138] "Creating topology manager with none policy" Jul 14 11:37:50.256730 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.013908 2582 container_manager_linux.go:309] "Creating device plugin manager" Jul 14 11:37:50.256730 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.013916 2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 11:37:50.256730 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.014576 2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 11:37:50.256730 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.015969 2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 14 11:37:50.256730 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.018553 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 14 11:37:50.256730 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.018696 2582 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 14 11:37:50.256730 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.018731 2582 kubelet.go:486] "Attempting to sync node with API server" Jul 14 11:37:50.256730 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.018741 2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 14 11:37:50.256730 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.018755 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 14 11:37:50.256730 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.018765 2582 kubelet.go:398] "Adding apiserver pod source" Jul 14 11:37:50.256730 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.018775 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 14 11:37:50.256730 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.019180 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.019196 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.022921 2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.024950 2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.024979 2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.026559 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.026594 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.026608 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.026621 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.026640 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.026653 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.026670 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.026689 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.026706 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.026720 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.026738 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.026750 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.027701 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.027717 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:50.030370 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:50.030370 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-205.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.031177 2582 server.go:1268] "Started kubelet" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.031277 2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.031259 2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.031338 2582 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.032443 2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.033826 2582 server.go:310] "Adding debug handlers to kubelet server" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.035748 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zqjh6" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.036470 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.036469 2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:50.036642 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-205.ec2.internal\" not found" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.037158 2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.037160 2582 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.037180 2582 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.037262 2582 reconstruct.go:97] "Volume reconstruction finished" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.037273 2582 reconciler.go:29] "Reconciler: start to sync state" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.040206 2582 factory.go:55] Registering systemd factory Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.040220 2582 factory.go:223] Registration of the systemd container factory successfully Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.040424 2582 factory.go:153] Registering CRI-O factory Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.040439 2582 factory.go:223] Registration of the crio container factory successfully Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.040487 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.040515 2582 factory.go:103] Registering Raw factory Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.040530 2582 manager.go:1196] Started watching for new ooms in manager Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.040913 2582 manager.go:349] Starting recovery of all containers Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.043201 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zqjh6" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.045489 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 14 11:37:50.257496 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:50.046835 2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-205.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:50.046904 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.046991 2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-205.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:50.047019 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-205.ec2.internal.18c224fcac2d32d9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-205.ec2.internal,UID:ip-10-0-136-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-205.ec2.internal,},FirstTimestamp:2026-07-14 11:37:50.031139545 +0000 UTC m=+0.393790841,LastTimestamp:2026-07-14 11:37:50.031139545 +0000 UTC m=+0.393790841,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-205.ec2.internal,}" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.052229 2582 manager.go:354] Recovery completed Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.058940 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.061392 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-205.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.061421 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-205.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.061434 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-205.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.062125 2582 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.062143 2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.062163 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.062133 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.063088 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-205.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.063125 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-205.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.063135 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-205.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.063358 2582 policy_none.go:49] "None policy: Start" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.063380 2582 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.063394 2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:50.063677 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-205.ec2.internal.18c224fcadfb0055 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-205.ec2.internal,UID:ip-10-0-136-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-205.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-205.ec2.internal,},FirstTimestamp:2026-07-14 11:37:50.061404245 +0000 UTC m=+0.424055540,LastTimestamp:2026-07-14 11:37:50.061404245 +0000 UTC m=+0.424055540,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-205.ec2.internal,}" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.070759 2582 policy_none.go:47] "Start" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.107937 2582 manager.go:337] "Starting Device Plugin manager" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:50.108204 2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.108220 2582 server.go:87] "Starting device plugin registration server" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.108482 2582 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.108496 2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.108601 2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.108696 2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.108706 2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:50.109252 2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:50.109306 2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-205.ec2.internal\" not found" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.209403 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:37:50.258745 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.210471 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-205.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:37:50.259900 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.210499 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-205.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:37:50.259900 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.210509 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-205.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:37:50.259900 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.210537 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-205.ec2.internal" Jul 14 11:37:50.259900 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.219553 2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-205.ec2.internal" Jul 14 11:37:50.259900 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:50.219579 2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-205.ec2.internal\": node \"ip-10-0-136-205.ec2.internal\" not found" Jul 14 11:37:50.259900 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:50.237033 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-205.ec2.internal\" not found" Jul 14 11:37:50.435386 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.285113 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 14 11:37:50.435386 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.285151 2582 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 14 11:37:50.435386 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.285169 2582 kubelet.go:2448] "Starting kubelet main sync loop" Jul 14 11:37:50.435386 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:50.285199 2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 14 11:37:50.435386 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.288407 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 11:37:50.435386 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:50.338010 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-205.ec2.internal\" not found" Jul 14 11:37:50.435386 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.386249 2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-205.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-205.ec2.internal"] Jul 14 11:37:50.435386 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.386364 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:37:50.435386 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.387335 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-205.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:37:50.435386 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.387357 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-205.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:37:50.435386 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.387376 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-205.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:37:50.435386 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.389591 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:37:50.435386 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.389704 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-205.ec2.internal" Jul 14 11:37:50.435386 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.389734 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:37:50.435386 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.390305 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-205.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:37:50.435386 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.390326 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-205.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:37:50.435386 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.390338 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-205.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:37:50.435386 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.390352 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-205.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:37:50.435386 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.390374 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-205.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:37:50.435386 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.390388 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-205.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:37:50.435386 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.392448 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-205.ec2.internal" Jul 14 11:37:50.435386 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.392469 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:37:50.435386 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.393205 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-205.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:37:50.435386 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.393226 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-205.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:37:50.435386 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.393236 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-205.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:37:50.435386 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:50.414617 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-205.ec2.internal\" not found" node="ip-10-0-136-205.ec2.internal" Jul 14 11:37:50.435386 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:50.419863 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-205.ec2.internal\" not found" node="ip-10-0-136-205.ec2.internal" Jul 14 11:37:50.612738 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:50.438053 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-205.ec2.internal\" not found" Jul 14 11:37:50.612738 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.438129 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8007adcc2fcfc5f67cc32826f90757af-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-205.ec2.internal\" (UID: \"8007adcc2fcfc5f67cc32826f90757af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-205.ec2.internal" Jul 14 11:37:50.612738 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.438152 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0f2609a843c4dae5cfd321dd4169d5da-config\") pod \"kube-apiserver-proxy-ip-10-0-136-205.ec2.internal\" (UID: \"0f2609a843c4dae5cfd321dd4169d5da\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-205.ec2.internal" Jul 14 11:37:50.612738 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.438169 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8007adcc2fcfc5f67cc32826f90757af-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-205.ec2.internal\" (UID: \"8007adcc2fcfc5f67cc32826f90757af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-205.ec2.internal" Jul 14 11:37:50.612738 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:50.538594 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-205.ec2.internal\" not found" Jul 14 11:37:50.612738 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.538644 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8007adcc2fcfc5f67cc32826f90757af-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-205.ec2.internal\" (UID: \"8007adcc2fcfc5f67cc32826f90757af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-205.ec2.internal" Jul 14 11:37:50.612738 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.538678 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0f2609a843c4dae5cfd321dd4169d5da-config\") pod \"kube-apiserver-proxy-ip-10-0-136-205.ec2.internal\" (UID: \"0f2609a843c4dae5cfd321dd4169d5da\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-205.ec2.internal" Jul 14 11:37:50.612738 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.538696 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8007adcc2fcfc5f67cc32826f90757af-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-205.ec2.internal\" (UID: \"8007adcc2fcfc5f67cc32826f90757af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-205.ec2.internal" Jul 14 11:37:50.612738 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.538747 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8007adcc2fcfc5f67cc32826f90757af-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-205.ec2.internal\" (UID: \"8007adcc2fcfc5f67cc32826f90757af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-205.ec2.internal" Jul 14 11:37:50.612738 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.538806 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8007adcc2fcfc5f67cc32826f90757af-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-205.ec2.internal\" (UID: \"8007adcc2fcfc5f67cc32826f90757af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-205.ec2.internal" Jul 14 11:37:50.612738 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.538837 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0f2609a843c4dae5cfd321dd4169d5da-config\") pod \"kube-apiserver-proxy-ip-10-0-136-205.ec2.internal\" (UID: \"0f2609a843c4dae5cfd321dd4169d5da\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-205.ec2.internal" Jul 14 11:37:50.786289 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:50.639023 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-205.ec2.internal\" not found" Jul 14 11:37:50.786289 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.717233 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-205.ec2.internal" Jul 14 11:37:50.786289 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.723383 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-205.ec2.internal" Jul 14 11:37:50.786289 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:50.739457 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-205.ec2.internal\" not found" Jul 14 11:37:50.993552 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:50.839860 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-205.ec2.internal\" not found" Jul 14 11:37:50.993552 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:50.940297 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-205.ec2.internal\" not found" Jul 14 11:37:50.993552 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.973480 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 14 11:37:50.993552 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:50.973653 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 11:37:51.009436 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:51.009404 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 11:37:51.041066 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:51.041034 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-205.ec2.internal\" not found" Jul 14 11:37:51.047238 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:51.047207 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 11:32:50 +0000 UTC" deadline="2028-04-25 13:37:37.827365994 +0000 UTC" Jul 14 11:37:51.047292 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:51.047240 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15625h59m46.78013015s" Jul 14 11:37:51.048809 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:51.048792 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 11:37:51.051651 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:51.051632 2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 11:37:51.137606 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:51.137576 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-205.ec2.internal" Jul 14 11:37:51.149580 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:51.149560 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 11:37:51.150435 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:51.150421 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-205.ec2.internal" Jul 14 11:37:51.159168 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:51.159156 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 11:37:51.338984 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:51.338952 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f2609a843c4dae5cfd321dd4169d5da.slice/crio-ee975680c926ec1258546d6e9b8fa5761415515910fbab8f378e660acc291e3e WatchSource:0}: Error finding container ee975680c926ec1258546d6e9b8fa5761415515910fbab8f378e660acc291e3e: Status 404 returned error can't find the container with id ee975680c926ec1258546d6e9b8fa5761415515910fbab8f378e660acc291e3e Jul 14 11:37:51.339451 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:51.339426 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8007adcc2fcfc5f67cc32826f90757af.slice/crio-9b9262907edf5f97bb9c046100961d7a7fd4fef1f6bf431d2f632f396ed82e2c WatchSource:0}: Error finding container 9b9262907edf5f97bb9c046100961d7a7fd4fef1f6bf431d2f632f396ed82e2c: Status 404 returned error can't find the container with id 9b9262907edf5f97bb9c046100961d7a7fd4fef1f6bf431d2f632f396ed82e2c Jul 14 11:37:51.345975 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:51.345959 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 11:37:52.019894 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.019856 2582 apiserver.go:52] "Watching apiserver" Jul 14 11:37:52.030470 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.030056 2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 14 11:37:52.031447 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.031414 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-khpgc","openshift-multus/multus-additional-cni-plugins-cf87x","openshift-ovn-kubernetes/ovnkube-node-z62fl","kube-system/konnectivity-agent-d5t8j","kube-system/kube-apiserver-proxy-ip-10-0-136-205.ec2.internal","openshift-image-registry/node-ca-trjql","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-205.ec2.internal","openshift-multus/multus-4ckdz","openshift-multus/network-metrics-daemon-gphmx","openshift-network-diagnostics/network-check-target-glc7q","openshift-network-operator/iptables-alerter-z4l6s","kube-system/global-pull-secret-syncer-tzr85","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4tmvk","openshift-cluster-node-tuning-operator/tuned-tnppw"] Jul 14 11:37:52.034102 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.034076 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:37:52.034207 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:52.034170 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glc7q" podUID="fa03e907-e470-4ad5-b38e-06f4662d3ec0" Jul 14 11:37:52.036138 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.036110 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z4l6s" Jul 14 11:37:52.038038 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.038014 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 14 11:37:52.038601 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.038579 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.038851 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.038834 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 14 11:37:52.039286 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.039188 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 14 11:37:52.039396 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.039337 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 14 11:37:52.039516 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.039499 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wm6ph\"" Jul 14 11:37:52.040916 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.040864 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d5t8j" Jul 14 11:37:52.041303 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.041287 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 14 11:37:52.041412 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.041311 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4wb2t\"" Jul 14 11:37:52.041412 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.041377 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 14 11:37:52.042747 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.042727 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 14 11:37:52.042840 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.042736 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 14 11:37:52.042840 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.042781 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 14 11:37:52.042840 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.042826 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 14 11:37:52.043350 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.043328 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.043657 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.043510 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 14 11:37:52.043925 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.043803 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 14 11:37:52.043925 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.043909 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8xk6f\"" Jul 14 11:37:52.046413 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.045911 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-trjql" Jul 14 11:37:52.046413 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.046040 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 14 11:37:52.046413 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.046078 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4bbp5\"" Jul 14 11:37:52.046413 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.046387 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 14 11:37:52.048482 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.047824 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/97342d9e-98be-4bd1-8ac6-8f5d387fb287-iptables-alerter-script\") pod \"iptables-alerter-z4l6s\" (UID: \"97342d9e-98be-4bd1-8ac6-8f5d387fb287\") " pod="openshift-network-operator/iptables-alerter-z4l6s" Jul 14 11:37:52.048482 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.047860 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-run-systemd\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.048482 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.047879 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:37:52.048482 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.047886 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-etc-openvswitch\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.048482 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.047909 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-host-run-ovn-kubernetes\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.048482 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.047935 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-env-overrides\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.048482 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.047958 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-ovnkube-script-lib\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.048482 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:52.047970 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gphmx" podUID="2d1625cf-fd45-4ff6-9571-9220ac046239" Jul 14 11:37:52.048482 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.047982 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-host-kubelet\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.048482 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.048077 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-host-slash\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.048482 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.048121 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-host-run-netns\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.048482 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.048137 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-var-lib-openvswitch\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.048482 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.048161 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-ovn-node-metrics-cert\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.048482 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.048184 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjmd9\" (UniqueName: \"kubernetes.io/projected/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-kube-api-access-mjmd9\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.048482 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.048209 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97342d9e-98be-4bd1-8ac6-8f5d387fb287-host-slash\") pod \"iptables-alerter-z4l6s\" (UID: \"97342d9e-98be-4bd1-8ac6-8f5d387fb287\") " pod="openshift-network-operator/iptables-alerter-z4l6s" Jul 14 11:37:52.048482 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.048232 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nxtw\" (UniqueName: \"kubernetes.io/projected/97342d9e-98be-4bd1-8ac6-8f5d387fb287-kube-api-access-2nxtw\") pod \"iptables-alerter-z4l6s\" (UID: \"97342d9e-98be-4bd1-8ac6-8f5d387fb287\") " pod="openshift-network-operator/iptables-alerter-z4l6s" Jul 14 11:37:52.048482 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.048272 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-host-cni-bin\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.049313 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.048304 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-host-cni-netd\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.049313 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.048336 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-systemd-units\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.049313 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.048361 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-run-openvswitch\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.049313 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.048412 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-run-ovn\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.049313 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.048446 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-node-log\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.049313 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.048472 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-log-socket\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.049313 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.048495 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.049313 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.048519 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-ovnkube-config\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.049313 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.048543 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqft8\" (UniqueName: \"kubernetes.io/projected/fa03e907-e470-4ad5-b38e-06f4662d3ec0-kube-api-access-nqft8\") pod \"network-check-target-glc7q\" (UID: \"fa03e907-e470-4ad5-b38e-06f4662d3ec0\") " pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:37:52.049313 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.048822 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 14 11:37:52.049313 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.048945 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 14 11:37:52.049313 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.049109 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 11:37:52.049313 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.049179 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 14 11:37:52.049888 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.049369 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lxr9q\"" Jul 14 11:37:52.050406 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.050388 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4tmvk" Jul 14 11:37:52.052919 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.052852 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cf87x" Jul 14 11:37:52.053438 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.053366 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 14 11:37:52.053438 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.053377 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 14 11:37:52.053606 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.053441 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 14 11:37:52.053606 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.053562 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xtwcs\"" Jul 14 11:37:52.059599 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.055313 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-khpgc" Jul 14 11:37:52.059599 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.057804 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 14 11:37:52.059599 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.057833 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 14 11:37:52.059599 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.058034 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 14 11:37:52.059599 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.058143 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 14 11:37:52.059599 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.058511 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 14 11:37:52.059599 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.058532 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zgzrx\"" Jul 14 11:37:52.059599 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.059070 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 14 11:37:52.059599 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.059344 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-46h8g\"" Jul 14 11:37:52.060037 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.059724 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.060037 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.059739 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 14 11:37:52.062494 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.062441 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ngbcl\"" Jul 14 11:37:52.062596 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.062525 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 14 11:37:52.062596 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.062577 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:37:52.062695 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:52.062643 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzr85" podUID="58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed" Jul 14 11:37:52.073763 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.073741 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kc27n" Jul 14 11:37:52.084219 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.084196 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kc27n" Jul 14 11:37:52.138407 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.138374 2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 14 11:37:52.149276 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.149241 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-node-log\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.149488 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.149288 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4ceff054-c0dd-4638-8b83-a4a84fb109e1-cnibin\") pod \"multus-additional-cni-plugins-cf87x\" (UID: \"4ceff054-c0dd-4638-8b83-a4a84fb109e1\") " pod="openshift-multus/multus-additional-cni-plugins-cf87x" Jul 14 11:37:52.149488 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.149314 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-host-var-lib-kubelet\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.149488 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.149328 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-node-log\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.149488 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.149355 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-etc-kubernetes\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.149488 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.149379 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ceff054-c0dd-4638-8b83-a4a84fb109e1-system-cni-dir\") pod \"multus-additional-cni-plugins-cf87x\" (UID: \"4ceff054-c0dd-4638-8b83-a4a84fb109e1\") " pod="openshift-multus/multus-additional-cni-plugins-cf87x" Jul 14 11:37:52.149488 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.149415 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqft8\" (UniqueName: \"kubernetes.io/projected/fa03e907-e470-4ad5-b38e-06f4662d3ec0-kube-api-access-nqft8\") pod \"network-check-target-glc7q\" (UID: \"fa03e907-e470-4ad5-b38e-06f4662d3ec0\") " pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:37:52.149488 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.149442 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-etc-openvswitch\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.149488 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.149467 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-host-run-ovn-kubernetes\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.149488 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.149491 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-hostroot\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.150065 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.149514 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/26896a0a-efe8-47c3-8ba4-725363407c4f-konnectivity-ca\") pod \"konnectivity-agent-d5t8j\" (UID: \"26896a0a-efe8-47c3-8ba4-725363407c4f\") " pod="kube-system/konnectivity-agent-d5t8j" Jul 14 11:37:52.150065 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.149536 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-etc-systemd\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.150065 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.149544 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-etc-openvswitch\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.150065 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.149559 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-var-lib-openvswitch\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.150065 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.149592 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-var-lib-openvswitch\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.150065 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.149619 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjmd9\" (UniqueName: \"kubernetes.io/projected/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-kube-api-access-mjmd9\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.150065 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.149631 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-host-run-ovn-kubernetes\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.150065 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.149648 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-host-run-k8s-cni-cncf-io\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.150065 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.149677 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-multus-conf-dir\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.150065 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.149721 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-etc-kubernetes\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.150065 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.149760 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a59961e-8988-4654-a707-2d8eebcfd740-tmp-dir\") pod \"node-resolver-khpgc\" (UID: \"3a59961e-8988-4654-a707-2d8eebcfd740\") " pod="openshift-dns/node-resolver-khpgc" Jul 14 11:37:52.150065 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.149787 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-run\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.150065 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.149811 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea5c34bb-6876-46ea-891f-02cbcf0ba9fe-host\") pod \"node-ca-trjql\" (UID: \"ea5c34bb-6876-46ea-891f-02cbcf0ba9fe\") " pod="openshift-image-registry/node-ca-trjql" Jul 14 11:37:52.150065 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.149860 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-host-run-netns\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.150065 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.149895 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-etc-modprobe-d\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.150065 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.149920 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-host\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.150065 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.149944 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6698d51-507d-42a3-a123-cbf47abb0fc7-etc-selinux\") pod \"aws-ebs-csi-driver-node-4tmvk\" (UID: \"e6698d51-507d-42a3-a123-cbf47abb0fc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4tmvk" Jul 14 11:37:52.150862 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.149972 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-systemd-units\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.150862 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.149999 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.150862 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150042 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-systemd-units\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.150862 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150054 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.150862 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150077 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-ovnkube-config\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.150862 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150121 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prkcd\" (UniqueName: \"kubernetes.io/projected/bf48c046-e649-4f0d-b391-bcc30e7c1717-kube-api-access-prkcd\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.150862 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150147 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-kubelet-config\") pod \"global-pull-secret-syncer-tzr85\" (UID: \"58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed\") " pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:37:52.150862 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150168 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ea5c34bb-6876-46ea-891f-02cbcf0ba9fe-serviceca\") pod \"node-ca-trjql\" (UID: \"ea5c34bb-6876-46ea-891f-02cbcf0ba9fe\") " pod="openshift-image-registry/node-ca-trjql" Jul 14 11:37:52.150862 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150194 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d1625cf-fd45-4ff6-9571-9220ac046239-metrics-certs\") pod \"network-metrics-daemon-gphmx\" (UID: \"2d1625cf-fd45-4ff6-9571-9220ac046239\") " pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:37:52.150862 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150219 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/97342d9e-98be-4bd1-8ac6-8f5d387fb287-iptables-alerter-script\") pod \"iptables-alerter-z4l6s\" (UID: \"97342d9e-98be-4bd1-8ac6-8f5d387fb287\") " pod="openshift-network-operator/iptables-alerter-z4l6s" Jul 14 11:37:52.150862 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150239 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-env-overrides\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.150862 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150264 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4ceff054-c0dd-4638-8b83-a4a84fb109e1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cf87x\" (UID: \"4ceff054-c0dd-4638-8b83-a4a84fb109e1\") " pod="openshift-multus/multus-additional-cni-plugins-cf87x" Jul 14 11:37:52.150862 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150284 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/26896a0a-efe8-47c3-8ba4-725363407c4f-agent-certs\") pod \"konnectivity-agent-d5t8j\" (UID: \"26896a0a-efe8-47c3-8ba4-725363407c4f\") " pod="kube-system/konnectivity-agent-d5t8j" Jul 14 11:37:52.150862 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150312 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a59961e-8988-4654-a707-2d8eebcfd740-hosts-file\") pod \"node-resolver-khpgc\" (UID: \"3a59961e-8988-4654-a707-2d8eebcfd740\") " pod="openshift-dns/node-resolver-khpgc" Jul 14 11:37:52.150862 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150336 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-host-run-netns\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.150862 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150358 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-ovn-node-metrics-cert\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.150862 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150373 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-os-release\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.151678 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150401 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nxtw\" (UniqueName: \"kubernetes.io/projected/97342d9e-98be-4bd1-8ac6-8f5d387fb287-kube-api-access-2nxtw\") pod \"iptables-alerter-z4l6s\" (UID: \"97342d9e-98be-4bd1-8ac6-8f5d387fb287\") " pod="openshift-network-operator/iptables-alerter-z4l6s" Jul 14 11:37:52.151678 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150418 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-host-cni-bin\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.151678 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150455 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-multus-socket-dir-parent\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.151678 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150488 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-etc-sysctl-conf\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.151678 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150507 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6698d51-507d-42a3-a123-cbf47abb0fc7-socket-dir\") pod \"aws-ebs-csi-driver-node-4tmvk\" (UID: \"e6698d51-507d-42a3-a123-cbf47abb0fc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4tmvk" Jul 14 11:37:52.151678 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150549 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-log-socket\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.151678 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150571 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4ceff054-c0dd-4638-8b83-a4a84fb109e1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cf87x\" (UID: \"4ceff054-c0dd-4638-8b83-a4a84fb109e1\") " pod="openshift-multus/multus-additional-cni-plugins-cf87x" Jul 14 11:37:52.151678 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150588 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bf48c046-e649-4f0d-b391-bcc30e7c1717-multus-daemon-config\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.151678 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150606 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-run-systemd\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.151678 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150653 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4ceff054-c0dd-4638-8b83-a4a84fb109e1-os-release\") pod \"multus-additional-cni-plugins-cf87x\" (UID: \"4ceff054-c0dd-4638-8b83-a4a84fb109e1\") " pod="openshift-multus/multus-additional-cni-plugins-cf87x" Jul 14 11:37:52.151678 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150692 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-etc-sysctl-d\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.151678 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150694 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-host-run-netns\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.151678 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150717 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4ceff054-c0dd-4638-8b83-a4a84fb109e1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cf87x\" (UID: \"4ceff054-c0dd-4638-8b83-a4a84fb109e1\") " pod="openshift-multus/multus-additional-cni-plugins-cf87x" Jul 14 11:37:52.151678 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150779 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-log-socket\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.151678 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150779 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-run-systemd\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.151678 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150784 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-etc-sysconfig\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.151678 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150826 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-tmp\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.152382 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150838 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-host-cni-bin\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.152382 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150884 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7pvr\" (UniqueName: \"kubernetes.io/projected/e6698d51-507d-42a3-a123-cbf47abb0fc7-kube-api-access-d7pvr\") pod \"aws-ebs-csi-driver-node-4tmvk\" (UID: \"e6698d51-507d-42a3-a123-cbf47abb0fc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4tmvk" Jul 14 11:37:52.152382 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150918 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97342d9e-98be-4bd1-8ac6-8f5d387fb287-host-slash\") pod \"iptables-alerter-z4l6s\" (UID: \"97342d9e-98be-4bd1-8ac6-8f5d387fb287\") " pod="openshift-network-operator/iptables-alerter-z4l6s" Jul 14 11:37:52.152382 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150943 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-host-cni-netd\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.152382 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150968 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-multus-cni-dir\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.152382 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.150991 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-host-var-lib-cni-bin\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.152382 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151001 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-host-cni-netd\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.152382 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151018 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-host-run-multus-certs\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.152382 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151033 2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 14 11:37:52.152382 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151043 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97342d9e-98be-4bd1-8ac6-8f5d387fb287-host-slash\") pod \"iptables-alerter-z4l6s\" (UID: \"97342d9e-98be-4bd1-8ac6-8f5d387fb287\") " pod="openshift-network-operator/iptables-alerter-z4l6s" Jul 14 11:37:52.152382 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151045 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-original-pull-secret\") pod \"global-pull-secret-syncer-tzr85\" (UID: \"58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed\") " pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:37:52.152382 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151076 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn77p\" (UniqueName: \"kubernetes.io/projected/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-kube-api-access-gn77p\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.152382 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151124 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-run-openvswitch\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.152382 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151172 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-run-openvswitch\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.152382 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151209 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-run-ovn\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.152382 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151244 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-run-ovn\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.152382 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151277 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-host-var-lib-cni-multus\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.152935 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151289 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-env-overrides\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.152935 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151315 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-ovnkube-config\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.152935 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151278 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/97342d9e-98be-4bd1-8ac6-8f5d387fb287-iptables-alerter-script\") pod \"iptables-alerter-z4l6s\" (UID: \"97342d9e-98be-4bd1-8ac6-8f5d387fb287\") " pod="openshift-network-operator/iptables-alerter-z4l6s" Jul 14 11:37:52.152935 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151382 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6698d51-507d-42a3-a123-cbf47abb0fc7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4tmvk\" (UID: \"e6698d51-507d-42a3-a123-cbf47abb0fc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4tmvk" Jul 14 11:37:52.152935 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151425 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-ovnkube-script-lib\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.152935 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151473 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-cnibin\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.152935 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151527 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf48c046-e649-4f0d-b391-bcc30e7c1717-cni-binary-copy\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.152935 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151554 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-dbus\") pod \"global-pull-secret-syncer-tzr85\" (UID: \"58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed\") " pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:37:52.152935 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151593 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-sys\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.152935 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151622 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-var-lib-kubelet\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.152935 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151646 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6698d51-507d-42a3-a123-cbf47abb0fc7-registration-dir\") pod \"aws-ebs-csi-driver-node-4tmvk\" (UID: \"e6698d51-507d-42a3-a123-cbf47abb0fc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4tmvk" Jul 14 11:37:52.152935 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151678 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-host-kubelet\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.152935 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151702 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-host-slash\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.152935 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151743 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4ceff054-c0dd-4638-8b83-a4a84fb109e1-cni-binary-copy\") pod \"multus-additional-cni-plugins-cf87x\" (UID: \"4ceff054-c0dd-4638-8b83-a4a84fb109e1\") " pod="openshift-multus/multus-additional-cni-plugins-cf87x" Jul 14 11:37:52.152935 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151767 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dnmk\" (UniqueName: \"kubernetes.io/projected/4ceff054-c0dd-4638-8b83-a4a84fb109e1-kube-api-access-8dnmk\") pod \"multus-additional-cni-plugins-cf87x\" (UID: \"4ceff054-c0dd-4638-8b83-a4a84fb109e1\") " pod="openshift-multus/multus-additional-cni-plugins-cf87x" Jul 14 11:37:52.152935 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151806 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-system-cni-dir\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.152935 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151833 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-ovnkube-script-lib\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.153842 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151832 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd8vd\" (UniqueName: \"kubernetes.io/projected/3a59961e-8988-4654-a707-2d8eebcfd740-kube-api-access-hd8vd\") pod \"node-resolver-khpgc\" (UID: \"3a59961e-8988-4654-a707-2d8eebcfd740\") " pod="openshift-dns/node-resolver-khpgc" Jul 14 11:37:52.153842 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151873 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-etc-tuned\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.153842 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151897 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6698d51-507d-42a3-a123-cbf47abb0fc7-device-dir\") pod \"aws-ebs-csi-driver-node-4tmvk\" (UID: \"e6698d51-507d-42a3-a123-cbf47abb0fc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4tmvk" Jul 14 11:37:52.153842 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151907 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-host-kubelet\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.153842 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151918 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-lib-modules\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.153842 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151958 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpw6f\" (UniqueName: \"kubernetes.io/projected/ea5c34bb-6876-46ea-891f-02cbcf0ba9fe-kube-api-access-jpw6f\") pod \"node-ca-trjql\" (UID: \"ea5c34bb-6876-46ea-891f-02cbcf0ba9fe\") " pod="openshift-image-registry/node-ca-trjql" Jul 14 11:37:52.153842 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151973 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-host-slash\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.153842 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.151983 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc4dw\" (UniqueName: \"kubernetes.io/projected/2d1625cf-fd45-4ff6-9571-9220ac046239-kube-api-access-lc4dw\") pod \"network-metrics-daemon-gphmx\" (UID: \"2d1625cf-fd45-4ff6-9571-9220ac046239\") " pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:37:52.153842 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.152014 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6698d51-507d-42a3-a123-cbf47abb0fc7-sys-fs\") pod \"aws-ebs-csi-driver-node-4tmvk\" (UID: \"e6698d51-507d-42a3-a123-cbf47abb0fc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4tmvk" Jul 14 11:37:52.155071 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.155050 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-ovn-node-metrics-cert\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.157667 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:52.157392 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 11:37:52.157667 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:52.157420 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 11:37:52.157667 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:52.157433 2582 projected.go:196] Error preparing data for projected volume kube-api-access-nqft8 for pod openshift-network-diagnostics/network-check-target-glc7q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:37:52.157667 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:52.157504 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa03e907-e470-4ad5-b38e-06f4662d3ec0-kube-api-access-nqft8 podName:fa03e907-e470-4ad5-b38e-06f4662d3ec0 nodeName:}" failed. No retries permitted until 2026-07-14 11:37:52.657483479 +0000 UTC m=+3.020134780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nqft8" (UniqueName: "kubernetes.io/projected/fa03e907-e470-4ad5-b38e-06f4662d3ec0-kube-api-access-nqft8") pod "network-check-target-glc7q" (UID: "fa03e907-e470-4ad5-b38e-06f4662d3ec0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:37:52.160082 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.160062 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nxtw\" (UniqueName: \"kubernetes.io/projected/97342d9e-98be-4bd1-8ac6-8f5d387fb287-kube-api-access-2nxtw\") pod \"iptables-alerter-z4l6s\" (UID: \"97342d9e-98be-4bd1-8ac6-8f5d387fb287\") " pod="openshift-network-operator/iptables-alerter-z4l6s" Jul 14 11:37:52.160420 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.160395 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjmd9\" (UniqueName: \"kubernetes.io/projected/6033bdfb-e0c3-40ae-9f7a-9f52361ca839-kube-api-access-mjmd9\") pod \"ovnkube-node-z62fl\" (UID: \"6033bdfb-e0c3-40ae-9f7a-9f52361ca839\") " pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.253016 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.252978 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-multus-socket-dir-parent\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.253016 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253015 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-etc-sysctl-conf\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.253266 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253038 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6698d51-507d-42a3-a123-cbf47abb0fc7-socket-dir\") pod \"aws-ebs-csi-driver-node-4tmvk\" (UID: \"e6698d51-507d-42a3-a123-cbf47abb0fc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4tmvk" Jul 14 11:37:52.253266 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253057 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4ceff054-c0dd-4638-8b83-a4a84fb109e1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cf87x\" (UID: \"4ceff054-c0dd-4638-8b83-a4a84fb109e1\") " pod="openshift-multus/multus-additional-cni-plugins-cf87x" Jul 14 11:37:52.253266 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253074 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bf48c046-e649-4f0d-b391-bcc30e7c1717-multus-daemon-config\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.253266 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253108 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4ceff054-c0dd-4638-8b83-a4a84fb109e1-os-release\") pod \"multus-additional-cni-plugins-cf87x\" (UID: \"4ceff054-c0dd-4638-8b83-a4a84fb109e1\") " pod="openshift-multus/multus-additional-cni-plugins-cf87x" Jul 14 11:37:52.253266 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253130 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-etc-sysctl-d\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.253266 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253154 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4ceff054-c0dd-4638-8b83-a4a84fb109e1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cf87x\" (UID: \"4ceff054-c0dd-4638-8b83-a4a84fb109e1\") " pod="openshift-multus/multus-additional-cni-plugins-cf87x" Jul 14 11:37:52.253266 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253174 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-etc-sysconfig\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.253266 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253194 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-tmp\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.253266 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253218 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7pvr\" (UniqueName: \"kubernetes.io/projected/e6698d51-507d-42a3-a123-cbf47abb0fc7-kube-api-access-d7pvr\") pod \"aws-ebs-csi-driver-node-4tmvk\" (UID: \"e6698d51-507d-42a3-a123-cbf47abb0fc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4tmvk" Jul 14 11:37:52.253266 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253216 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-multus-socket-dir-parent\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.253266 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253242 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-multus-cni-dir\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.253266 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253216 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-etc-sysctl-conf\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.253266 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253251 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4ceff054-c0dd-4638-8b83-a4a84fb109e1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cf87x\" (UID: \"4ceff054-c0dd-4638-8b83-a4a84fb109e1\") " pod="openshift-multus/multus-additional-cni-plugins-cf87x" Jul 14 11:37:52.253266 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253268 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-host-var-lib-cni-bin\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.253747 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253280 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4ceff054-c0dd-4638-8b83-a4a84fb109e1-os-release\") pod \"multus-additional-cni-plugins-cf87x\" (UID: \"4ceff054-c0dd-4638-8b83-a4a84fb109e1\") " pod="openshift-multus/multus-additional-cni-plugins-cf87x" Jul 14 11:37:52.253747 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253220 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6698d51-507d-42a3-a123-cbf47abb0fc7-socket-dir\") pod \"aws-ebs-csi-driver-node-4tmvk\" (UID: \"e6698d51-507d-42a3-a123-cbf47abb0fc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4tmvk" Jul 14 11:37:52.253747 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253299 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-host-run-multus-certs\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.253747 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253324 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-original-pull-secret\") pod \"global-pull-secret-syncer-tzr85\" (UID: \"58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed\") " pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:37:52.253747 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253349 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn77p\" (UniqueName: \"kubernetes.io/projected/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-kube-api-access-gn77p\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.253747 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253361 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-etc-sysctl-d\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.253747 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253374 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-host-var-lib-cni-multus\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.253747 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253411 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-multus-cni-dir\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.253747 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253419 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-host-var-lib-cni-multus\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.253747 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253447 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6698d51-507d-42a3-a123-cbf47abb0fc7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4tmvk\" (UID: \"e6698d51-507d-42a3-a123-cbf47abb0fc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4tmvk" Jul 14 11:37:52.253747 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253470 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-etc-sysconfig\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.253747 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:52.253526 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 11:37:52.253747 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253558 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-host-var-lib-cni-bin\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.253747 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:52.253590 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-original-pull-secret podName:58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed nodeName:}" failed. No retries permitted until 2026-07-14 11:37:52.75356854 +0000 UTC m=+3.116219833 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-original-pull-secret") pod "global-pull-secret-syncer-tzr85" (UID: "58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed") : object "kube-system"/"original-pull-secret" not registered Jul 14 11:37:52.253747 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253606 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-host-run-multus-certs\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.253747 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253411 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6698d51-507d-42a3-a123-cbf47abb0fc7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4tmvk\" (UID: \"e6698d51-507d-42a3-a123-cbf47abb0fc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4tmvk" Jul 14 11:37:52.253747 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253647 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-cnibin\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.254544 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253672 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf48c046-e649-4f0d-b391-bcc30e7c1717-cni-binary-copy\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.254544 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253695 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-dbus\") pod \"global-pull-secret-syncer-tzr85\" (UID: \"58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed\") " pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:37:52.254544 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253707 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bf48c046-e649-4f0d-b391-bcc30e7c1717-multus-daemon-config\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.254544 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253719 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-cnibin\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.254544 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253721 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-sys\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.254544 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253750 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4ceff054-c0dd-4638-8b83-a4a84fb109e1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cf87x\" (UID: \"4ceff054-c0dd-4638-8b83-a4a84fb109e1\") " pod="openshift-multus/multus-additional-cni-plugins-cf87x" Jul 14 11:37:52.254544 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253763 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-sys\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.254544 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253792 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-var-lib-kubelet\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.254544 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253819 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6698d51-507d-42a3-a123-cbf47abb0fc7-registration-dir\") pod \"aws-ebs-csi-driver-node-4tmvk\" (UID: \"e6698d51-507d-42a3-a123-cbf47abb0fc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4tmvk" Jul 14 11:37:52.254544 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253843 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4ceff054-c0dd-4638-8b83-a4a84fb109e1-cni-binary-copy\") pod \"multus-additional-cni-plugins-cf87x\" (UID: \"4ceff054-c0dd-4638-8b83-a4a84fb109e1\") " pod="openshift-multus/multus-additional-cni-plugins-cf87x" Jul 14 11:37:52.254544 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253859 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-var-lib-kubelet\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.254544 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253867 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dnmk\" (UniqueName: \"kubernetes.io/projected/4ceff054-c0dd-4638-8b83-a4a84fb109e1-kube-api-access-8dnmk\") pod \"multus-additional-cni-plugins-cf87x\" (UID: \"4ceff054-c0dd-4638-8b83-a4a84fb109e1\") " pod="openshift-multus/multus-additional-cni-plugins-cf87x" Jul 14 11:37:52.254544 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253785 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-dbus\") pod \"global-pull-secret-syncer-tzr85\" (UID: \"58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed\") " pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:37:52.254544 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253891 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6698d51-507d-42a3-a123-cbf47abb0fc7-registration-dir\") pod \"aws-ebs-csi-driver-node-4tmvk\" (UID: \"e6698d51-507d-42a3-a123-cbf47abb0fc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4tmvk" Jul 14 11:37:52.254544 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253904 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-system-cni-dir\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.254544 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253945 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-system-cni-dir\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.254544 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253946 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd8vd\" (UniqueName: \"kubernetes.io/projected/3a59961e-8988-4654-a707-2d8eebcfd740-kube-api-access-hd8vd\") pod \"node-resolver-khpgc\" (UID: \"3a59961e-8988-4654-a707-2d8eebcfd740\") " pod="openshift-dns/node-resolver-khpgc" Jul 14 11:37:52.255285 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.253980 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-etc-tuned\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.255285 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254002 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6698d51-507d-42a3-a123-cbf47abb0fc7-device-dir\") pod \"aws-ebs-csi-driver-node-4tmvk\" (UID: \"e6698d51-507d-42a3-a123-cbf47abb0fc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4tmvk" Jul 14 11:37:52.255285 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254026 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-lib-modules\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.255285 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254051 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpw6f\" (UniqueName: \"kubernetes.io/projected/ea5c34bb-6876-46ea-891f-02cbcf0ba9fe-kube-api-access-jpw6f\") pod \"node-ca-trjql\" (UID: \"ea5c34bb-6876-46ea-891f-02cbcf0ba9fe\") " pod="openshift-image-registry/node-ca-trjql" Jul 14 11:37:52.255285 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254079 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc4dw\" (UniqueName: \"kubernetes.io/projected/2d1625cf-fd45-4ff6-9571-9220ac046239-kube-api-access-lc4dw\") pod \"network-metrics-daemon-gphmx\" (UID: \"2d1625cf-fd45-4ff6-9571-9220ac046239\") " pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:37:52.255285 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254114 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6698d51-507d-42a3-a123-cbf47abb0fc7-device-dir\") pod \"aws-ebs-csi-driver-node-4tmvk\" (UID: \"e6698d51-507d-42a3-a123-cbf47abb0fc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4tmvk" Jul 14 11:37:52.255285 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254120 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6698d51-507d-42a3-a123-cbf47abb0fc7-sys-fs\") pod \"aws-ebs-csi-driver-node-4tmvk\" (UID: \"e6698d51-507d-42a3-a123-cbf47abb0fc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4tmvk" Jul 14 11:37:52.255285 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254170 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6698d51-507d-42a3-a123-cbf47abb0fc7-sys-fs\") pod \"aws-ebs-csi-driver-node-4tmvk\" (UID: \"e6698d51-507d-42a3-a123-cbf47abb0fc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4tmvk" Jul 14 11:37:52.255285 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254199 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4ceff054-c0dd-4638-8b83-a4a84fb109e1-cnibin\") pod \"multus-additional-cni-plugins-cf87x\" (UID: \"4ceff054-c0dd-4638-8b83-a4a84fb109e1\") " pod="openshift-multus/multus-additional-cni-plugins-cf87x" Jul 14 11:37:52.255285 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254207 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf48c046-e649-4f0d-b391-bcc30e7c1717-cni-binary-copy\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.255285 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254222 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-host-var-lib-kubelet\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.255285 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254248 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-etc-kubernetes\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.255285 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254276 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4ceff054-c0dd-4638-8b83-a4a84fb109e1-cnibin\") pod \"multus-additional-cni-plugins-cf87x\" (UID: \"4ceff054-c0dd-4638-8b83-a4a84fb109e1\") " pod="openshift-multus/multus-additional-cni-plugins-cf87x" Jul 14 11:37:52.255285 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254306 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4ceff054-c0dd-4638-8b83-a4a84fb109e1-cni-binary-copy\") pod \"multus-additional-cni-plugins-cf87x\" (UID: \"4ceff054-c0dd-4638-8b83-a4a84fb109e1\") " pod="openshift-multus/multus-additional-cni-plugins-cf87x" Jul 14 11:37:52.255285 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254321 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-host-var-lib-kubelet\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.255285 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254272 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ceff054-c0dd-4638-8b83-a4a84fb109e1-system-cni-dir\") pod \"multus-additional-cni-plugins-cf87x\" (UID: \"4ceff054-c0dd-4638-8b83-a4a84fb109e1\") " pod="openshift-multus/multus-additional-cni-plugins-cf87x" Jul 14 11:37:52.255285 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254348 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-etc-kubernetes\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.256079 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254357 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ceff054-c0dd-4638-8b83-a4a84fb109e1-system-cni-dir\") pod \"multus-additional-cni-plugins-cf87x\" (UID: \"4ceff054-c0dd-4638-8b83-a4a84fb109e1\") " pod="openshift-multus/multus-additional-cni-plugins-cf87x" Jul 14 11:37:52.256079 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254374 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-lib-modules\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.256079 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254381 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-hostroot\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.256079 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254426 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/26896a0a-efe8-47c3-8ba4-725363407c4f-konnectivity-ca\") pod \"konnectivity-agent-d5t8j\" (UID: \"26896a0a-efe8-47c3-8ba4-725363407c4f\") " pod="kube-system/konnectivity-agent-d5t8j" Jul 14 11:37:52.256079 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254419 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-hostroot\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.256079 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254452 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-etc-systemd\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.256079 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254499 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-host-run-k8s-cni-cncf-io\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.256079 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254524 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-multus-conf-dir\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.256079 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254549 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-etc-kubernetes\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.256079 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254560 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-etc-systemd\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.256079 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254573 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a59961e-8988-4654-a707-2d8eebcfd740-tmp-dir\") pod \"node-resolver-khpgc\" (UID: \"3a59961e-8988-4654-a707-2d8eebcfd740\") " pod="openshift-dns/node-resolver-khpgc" Jul 14 11:37:52.256079 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254603 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-multus-conf-dir\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.256079 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254596 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-run\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.256079 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254634 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea5c34bb-6876-46ea-891f-02cbcf0ba9fe-host\") pod \"node-ca-trjql\" (UID: \"ea5c34bb-6876-46ea-891f-02cbcf0ba9fe\") " pod="openshift-image-registry/node-ca-trjql" Jul 14 11:37:52.256079 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254641 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-host-run-k8s-cni-cncf-io\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.256079 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254657 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-host-run-netns\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.256079 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254681 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-etc-modprobe-d\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.256079 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254695 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-etc-kubernetes\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.256876 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254704 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-host\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.256876 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254728 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6698d51-507d-42a3-a123-cbf47abb0fc7-etc-selinux\") pod \"aws-ebs-csi-driver-node-4tmvk\" (UID: \"e6698d51-507d-42a3-a123-cbf47abb0fc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4tmvk" Jul 14 11:37:52.256876 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254734 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-host-run-netns\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.256876 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254759 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prkcd\" (UniqueName: \"kubernetes.io/projected/bf48c046-e649-4f0d-b391-bcc30e7c1717-kube-api-access-prkcd\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.256876 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254775 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea5c34bb-6876-46ea-891f-02cbcf0ba9fe-host\") pod \"node-ca-trjql\" (UID: \"ea5c34bb-6876-46ea-891f-02cbcf0ba9fe\") " pod="openshift-image-registry/node-ca-trjql" Jul 14 11:37:52.256876 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254789 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-kubelet-config\") pod \"global-pull-secret-syncer-tzr85\" (UID: \"58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed\") " pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:37:52.256876 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254817 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ea5c34bb-6876-46ea-891f-02cbcf0ba9fe-serviceca\") pod \"node-ca-trjql\" (UID: \"ea5c34bb-6876-46ea-891f-02cbcf0ba9fe\") " pod="openshift-image-registry/node-ca-trjql" Jul 14 11:37:52.256876 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254821 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-host\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.256876 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254845 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d1625cf-fd45-4ff6-9571-9220ac046239-metrics-certs\") pod \"network-metrics-daemon-gphmx\" (UID: \"2d1625cf-fd45-4ff6-9571-9220ac046239\") " pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:37:52.256876 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254874 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4ceff054-c0dd-4638-8b83-a4a84fb109e1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cf87x\" (UID: \"4ceff054-c0dd-4638-8b83-a4a84fb109e1\") " pod="openshift-multus/multus-additional-cni-plugins-cf87x" Jul 14 11:37:52.256876 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254900 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/26896a0a-efe8-47c3-8ba4-725363407c4f-agent-certs\") pod \"konnectivity-agent-d5t8j\" (UID: \"26896a0a-efe8-47c3-8ba4-725363407c4f\") " pod="kube-system/konnectivity-agent-d5t8j" Jul 14 11:37:52.256876 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254911 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-etc-modprobe-d\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.256876 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254925 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a59961e-8988-4654-a707-2d8eebcfd740-hosts-file\") pod \"node-resolver-khpgc\" (UID: \"3a59961e-8988-4654-a707-2d8eebcfd740\") " pod="openshift-dns/node-resolver-khpgc" Jul 14 11:37:52.256876 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254937 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/26896a0a-efe8-47c3-8ba4-725363407c4f-konnectivity-ca\") pod \"konnectivity-agent-d5t8j\" (UID: \"26896a0a-efe8-47c3-8ba4-725363407c4f\") " pod="kube-system/konnectivity-agent-d5t8j" Jul 14 11:37:52.256876 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.254953 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-os-release\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.256876 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.255011 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bf48c046-e649-4f0d-b391-bcc30e7c1717-os-release\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.256876 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.256195 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a59961e-8988-4654-a707-2d8eebcfd740-tmp-dir\") pod \"node-resolver-khpgc\" (UID: \"3a59961e-8988-4654-a707-2d8eebcfd740\") " pod="openshift-dns/node-resolver-khpgc" Jul 14 11:37:52.256876 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:52.256225 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:37:52.257710 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:52.256294 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d1625cf-fd45-4ff6-9571-9220ac046239-metrics-certs podName:2d1625cf-fd45-4ff6-9571-9220ac046239 nodeName:}" failed. No retries permitted until 2026-07-14 11:37:52.756276983 +0000 UTC m=+3.118928279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d1625cf-fd45-4ff6-9571-9220ac046239-metrics-certs") pod "network-metrics-daemon-gphmx" (UID: "2d1625cf-fd45-4ff6-9571-9220ac046239") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:37:52.257710 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.256492 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-tmp\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.257710 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.256722 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ea5c34bb-6876-46ea-891f-02cbcf0ba9fe-serviceca\") pod \"node-ca-trjql\" (UID: \"ea5c34bb-6876-46ea-891f-02cbcf0ba9fe\") " pod="openshift-image-registry/node-ca-trjql" Jul 14 11:37:52.257710 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.256827 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a59961e-8988-4654-a707-2d8eebcfd740-hosts-file\") pod \"node-resolver-khpgc\" (UID: \"3a59961e-8988-4654-a707-2d8eebcfd740\") " pod="openshift-dns/node-resolver-khpgc" Jul 14 11:37:52.257710 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.257408 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4ceff054-c0dd-4638-8b83-a4a84fb109e1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cf87x\" (UID: \"4ceff054-c0dd-4638-8b83-a4a84fb109e1\") " pod="openshift-multus/multus-additional-cni-plugins-cf87x" Jul 14 11:37:52.257710 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.257504 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-kubelet-config\") pod \"global-pull-secret-syncer-tzr85\" (UID: \"58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed\") " pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:37:52.257710 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.257573 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-run\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.257710 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.257672 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6698d51-507d-42a3-a123-cbf47abb0fc7-etc-selinux\") pod \"aws-ebs-csi-driver-node-4tmvk\" (UID: \"e6698d51-507d-42a3-a123-cbf47abb0fc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4tmvk" Jul 14 11:37:52.259999 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.258798 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-etc-tuned\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.259999 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.259126 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/26896a0a-efe8-47c3-8ba4-725363407c4f-agent-certs\") pod \"konnectivity-agent-d5t8j\" (UID: \"26896a0a-efe8-47c3-8ba4-725363407c4f\") " pod="kube-system/konnectivity-agent-d5t8j" Jul 14 11:37:52.260209 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.260186 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 11:37:52.267680 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.267603 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7pvr\" (UniqueName: \"kubernetes.io/projected/e6698d51-507d-42a3-a123-cbf47abb0fc7-kube-api-access-d7pvr\") pod \"aws-ebs-csi-driver-node-4tmvk\" (UID: \"e6698d51-507d-42a3-a123-cbf47abb0fc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4tmvk" Jul 14 11:37:52.267865 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.267765 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc4dw\" (UniqueName: \"kubernetes.io/projected/2d1625cf-fd45-4ff6-9571-9220ac046239-kube-api-access-lc4dw\") pod \"network-metrics-daemon-gphmx\" (UID: \"2d1625cf-fd45-4ff6-9571-9220ac046239\") " pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:37:52.267932 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.267902 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn77p\" (UniqueName: \"kubernetes.io/projected/7746b3b3-3c3d-44b6-b78a-c17e33f83a15-kube-api-access-gn77p\") pod \"tuned-tnppw\" (UID: \"7746b3b3-3c3d-44b6-b78a-c17e33f83a15\") " pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.267991 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.267932 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpw6f\" (UniqueName: \"kubernetes.io/projected/ea5c34bb-6876-46ea-891f-02cbcf0ba9fe-kube-api-access-jpw6f\") pod \"node-ca-trjql\" (UID: \"ea5c34bb-6876-46ea-891f-02cbcf0ba9fe\") " pod="openshift-image-registry/node-ca-trjql" Jul 14 11:37:52.267991 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.267945 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd8vd\" (UniqueName: \"kubernetes.io/projected/3a59961e-8988-4654-a707-2d8eebcfd740-kube-api-access-hd8vd\") pod \"node-resolver-khpgc\" (UID: \"3a59961e-8988-4654-a707-2d8eebcfd740\") " pod="openshift-dns/node-resolver-khpgc" Jul 14 11:37:52.269084 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.269059 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prkcd\" (UniqueName: \"kubernetes.io/projected/bf48c046-e649-4f0d-b391-bcc30e7c1717-kube-api-access-prkcd\") pod \"multus-4ckdz\" (UID: \"bf48c046-e649-4f0d-b391-bcc30e7c1717\") " pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.269489 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.269467 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dnmk\" (UniqueName: \"kubernetes.io/projected/4ceff054-c0dd-4638-8b83-a4a84fb109e1-kube-api-access-8dnmk\") pod \"multus-additional-cni-plugins-cf87x\" (UID: \"4ceff054-c0dd-4638-8b83-a4a84fb109e1\") " pod="openshift-multus/multus-additional-cni-plugins-cf87x" Jul 14 11:37:52.290650 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.290543 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-205.ec2.internal" event={"ID":"0f2609a843c4dae5cfd321dd4169d5da","Type":"ContainerStarted","Data":"ee975680c926ec1258546d6e9b8fa5761415515910fbab8f378e660acc291e3e"} Jul 14 11:37:52.291652 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.291622 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-205.ec2.internal" event={"ID":"8007adcc2fcfc5f67cc32826f90757af","Type":"ContainerStarted","Data":"9b9262907edf5f97bb9c046100961d7a7fd4fef1f6bf431d2f632f396ed82e2c"} Jul 14 11:37:52.350030 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.349987 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z4l6s" Jul 14 11:37:52.362278 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.362239 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:37:52.371404 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.371375 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4tmvk" Jul 14 11:37:52.376266 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.376238 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d5t8j" Jul 14 11:37:52.384139 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.384117 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tnppw" Jul 14 11:37:52.390985 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.390963 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-trjql" Jul 14 11:37:52.396741 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.396718 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cf87x" Jul 14 11:37:52.406430 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.406409 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-khpgc" Jul 14 11:37:52.412040 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.412019 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4ckdz" Jul 14 11:37:52.661266 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.661160 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqft8\" (UniqueName: \"kubernetes.io/projected/fa03e907-e470-4ad5-b38e-06f4662d3ec0-kube-api-access-nqft8\") pod \"network-check-target-glc7q\" (UID: \"fa03e907-e470-4ad5-b38e-06f4662d3ec0\") " pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:37:52.661443 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:52.661357 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 11:37:52.661443 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:52.661384 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 11:37:52.661443 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:52.661396 2582 projected.go:196] Error preparing data for projected volume kube-api-access-nqft8 for pod openshift-network-diagnostics/network-check-target-glc7q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:37:52.661589 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:52.661465 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa03e907-e470-4ad5-b38e-06f4662d3ec0-kube-api-access-nqft8 podName:fa03e907-e470-4ad5-b38e-06f4662d3ec0 nodeName:}" failed. No retries permitted until 2026-07-14 11:37:53.661445555 +0000 UTC m=+4.024096853 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqft8" (UniqueName: "kubernetes.io/projected/fa03e907-e470-4ad5-b38e-06f4662d3ec0-kube-api-access-nqft8") pod "network-check-target-glc7q" (UID: "fa03e907-e470-4ad5-b38e-06f4662d3ec0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:37:52.762115 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.762062 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-original-pull-secret\") pod \"global-pull-secret-syncer-tzr85\" (UID: \"58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed\") " pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:37:52.762296 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:52.762175 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d1625cf-fd45-4ff6-9571-9220ac046239-metrics-certs\") pod \"network-metrics-daemon-gphmx\" (UID: \"2d1625cf-fd45-4ff6-9571-9220ac046239\") " pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:37:52.762296 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:52.762234 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 11:37:52.762296 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:52.762290 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:37:52.762445 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:52.762315 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-original-pull-secret podName:58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed nodeName:}" failed. No retries permitted until 2026-07-14 11:37:53.762294829 +0000 UTC m=+4.124946131 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-original-pull-secret") pod "global-pull-secret-syncer-tzr85" (UID: "58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed") : object "kube-system"/"original-pull-secret" not registered Jul 14 11:37:52.762445 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:52.762343 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d1625cf-fd45-4ff6-9571-9220ac046239-metrics-certs podName:2d1625cf-fd45-4ff6-9571-9220ac046239 nodeName:}" failed. No retries permitted until 2026-07-14 11:37:53.762325534 +0000 UTC m=+4.124976830 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d1625cf-fd45-4ff6-9571-9220ac046239-metrics-certs") pod "network-metrics-daemon-gphmx" (UID: "2d1625cf-fd45-4ff6-9571-9220ac046239") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:37:53.087663 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:53.087571 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 11:32:52 +0000 UTC" deadline="2027-12-14 13:01:48.417275282 +0000 UTC" Jul 14 11:37:53.087663 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:53.087611 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12433h23m55.329669181s" Jul 14 11:37:53.273075 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:53.273043 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea5c34bb_6876_46ea_891f_02cbcf0ba9fe.slice/crio-30b47c70518bae84f2052b82817751b9ecfdc9b0e79ae8e55684b7ff99fc75fe WatchSource:0}: Error finding container 30b47c70518bae84f2052b82817751b9ecfdc9b0e79ae8e55684b7ff99fc75fe: Status 404 returned error can't find the container with id 30b47c70518bae84f2052b82817751b9ecfdc9b0e79ae8e55684b7ff99fc75fe Jul 14 11:37:53.278604 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:53.278576 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26896a0a_efe8_47c3_8ba4_725363407c4f.slice/crio-beb233196787d73362f7eff9dbc7d15c7988d8f7d9ac5e436e8452b3f8779851 WatchSource:0}: Error finding container beb233196787d73362f7eff9dbc7d15c7988d8f7d9ac5e436e8452b3f8779851: Status 404 returned error can't find the container with id beb233196787d73362f7eff9dbc7d15c7988d8f7d9ac5e436e8452b3f8779851 Jul 14 11:37:53.280154 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:53.280126 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf48c046_e649_4f0d_b391_bcc30e7c1717.slice/crio-10416dc710ecaf6d9a751ae7c6750ef6621dd617339e109c6c0542f343e55210 WatchSource:0}: Error finding container 10416dc710ecaf6d9a751ae7c6750ef6621dd617339e109c6c0542f343e55210: Status 404 returned error can't find the container with id 10416dc710ecaf6d9a751ae7c6750ef6621dd617339e109c6c0542f343e55210 Jul 14 11:37:53.281595 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:53.281568 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6698d51_507d_42a3_a123_cbf47abb0fc7.slice/crio-c498f42d27a261eb7cf8c8752ce2c8ceac3d35080145d87b6a8e7d6acc7c0208 WatchSource:0}: Error finding container c498f42d27a261eb7cf8c8752ce2c8ceac3d35080145d87b6a8e7d6acc7c0208: Status 404 returned error can't find the container with id c498f42d27a261eb7cf8c8752ce2c8ceac3d35080145d87b6a8e7d6acc7c0208 Jul 14 11:37:53.282435 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:53.282323 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a59961e_8988_4654_a707_2d8eebcfd740.slice/crio-0049e685c775cc475376378a3d583e88755ad0852cee9a3979faa5d254988849 WatchSource:0}: Error finding container 0049e685c775cc475376378a3d583e88755ad0852cee9a3979faa5d254988849: Status 404 returned error can't find the container with id 0049e685c775cc475376378a3d583e88755ad0852cee9a3979faa5d254988849 Jul 14 11:37:53.283456 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:37:53.283433 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7746b3b3_3c3d_44b6_b78a_c17e33f83a15.slice/crio-3e280f1426559ff8d84f644ccf8260cda18cef0d64adf740ecf50301b1a21197 WatchSource:0}: Error finding container 3e280f1426559ff8d84f644ccf8260cda18cef0d64adf740ecf50301b1a21197: Status 404 returned error can't find the container with id 3e280f1426559ff8d84f644ccf8260cda18cef0d64adf740ecf50301b1a21197 Jul 14 11:37:53.285507 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:53.285363 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:37:53.285507 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:53.285462 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glc7q" podUID="fa03e907-e470-4ad5-b38e-06f4662d3ec0" Jul 14 11:37:53.285741 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:53.285533 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:37:53.285741 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:53.285617 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gphmx" podUID="2d1625cf-fd45-4ff6-9571-9220ac046239" Jul 14 11:37:53.295021 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:53.294991 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" event={"ID":"6033bdfb-e0c3-40ae-9f7a-9f52361ca839","Type":"ContainerStarted","Data":"6825b8b8325a3a6e63d2bbf758c6b27bf92f1d1cbfbc965440ef0d449581975d"} Jul 14 11:37:53.296370 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:53.296311 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-khpgc" event={"ID":"3a59961e-8988-4654-a707-2d8eebcfd740","Type":"ContainerStarted","Data":"0049e685c775cc475376378a3d583e88755ad0852cee9a3979faa5d254988849"} Jul 14 11:37:53.297527 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:53.297498 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4tmvk" event={"ID":"e6698d51-507d-42a3-a123-cbf47abb0fc7","Type":"ContainerStarted","Data":"c498f42d27a261eb7cf8c8752ce2c8ceac3d35080145d87b6a8e7d6acc7c0208"} Jul 14 11:37:53.298663 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:53.298638 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4ckdz" event={"ID":"bf48c046-e649-4f0d-b391-bcc30e7c1717","Type":"ContainerStarted","Data":"10416dc710ecaf6d9a751ae7c6750ef6621dd617339e109c6c0542f343e55210"} Jul 14 11:37:53.299820 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:53.299723 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cf87x" event={"ID":"4ceff054-c0dd-4638-8b83-a4a84fb109e1","Type":"ContainerStarted","Data":"bb888e44eee6f6520b7e75da52ba9e9510cfae9c35dff3e12946c3be8193ca7f"} Jul 14 11:37:53.300880 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:53.300855 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tnppw" event={"ID":"7746b3b3-3c3d-44b6-b78a-c17e33f83a15","Type":"ContainerStarted","Data":"3e280f1426559ff8d84f644ccf8260cda18cef0d64adf740ecf50301b1a21197"} Jul 14 11:37:53.301871 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:53.301851 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d5t8j" event={"ID":"26896a0a-efe8-47c3-8ba4-725363407c4f","Type":"ContainerStarted","Data":"beb233196787d73362f7eff9dbc7d15c7988d8f7d9ac5e436e8452b3f8779851"} Jul 14 11:37:53.302925 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:53.302903 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z4l6s" event={"ID":"97342d9e-98be-4bd1-8ac6-8f5d387fb287","Type":"ContainerStarted","Data":"29acf7d625060f70370d9d030e592566d0bb07983e83de1fcfe3c05b5f736040"} Jul 14 11:37:53.304079 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:53.304061 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-trjql" event={"ID":"ea5c34bb-6876-46ea-891f-02cbcf0ba9fe","Type":"ContainerStarted","Data":"30b47c70518bae84f2052b82817751b9ecfdc9b0e79ae8e55684b7ff99fc75fe"} Jul 14 11:37:53.670953 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:53.670506 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqft8\" (UniqueName: \"kubernetes.io/projected/fa03e907-e470-4ad5-b38e-06f4662d3ec0-kube-api-access-nqft8\") pod \"network-check-target-glc7q\" (UID: \"fa03e907-e470-4ad5-b38e-06f4662d3ec0\") " pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:37:53.670953 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:53.670809 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 11:37:53.670953 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:53.670834 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 11:37:53.670953 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:53.670849 2582 projected.go:196] Error preparing data for projected volume kube-api-access-nqft8 for pod openshift-network-diagnostics/network-check-target-glc7q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:37:53.670953 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:53.670916 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa03e907-e470-4ad5-b38e-06f4662d3ec0-kube-api-access-nqft8 podName:fa03e907-e470-4ad5-b38e-06f4662d3ec0 nodeName:}" failed. No retries permitted until 2026-07-14 11:37:55.670897945 +0000 UTC m=+6.033549242 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqft8" (UniqueName: "kubernetes.io/projected/fa03e907-e470-4ad5-b38e-06f4662d3ec0-kube-api-access-nqft8") pod "network-check-target-glc7q" (UID: "fa03e907-e470-4ad5-b38e-06f4662d3ec0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:37:53.772246 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:53.771474 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d1625cf-fd45-4ff6-9571-9220ac046239-metrics-certs\") pod \"network-metrics-daemon-gphmx\" (UID: \"2d1625cf-fd45-4ff6-9571-9220ac046239\") " pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:37:53.772246 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:53.771541 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-original-pull-secret\") pod \"global-pull-secret-syncer-tzr85\" (UID: \"58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed\") " pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:37:53.772246 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:53.771683 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 11:37:53.772246 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:53.771745 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-original-pull-secret podName:58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed nodeName:}" failed. No retries permitted until 2026-07-14 11:37:55.771726058 +0000 UTC m=+6.134377344 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-original-pull-secret") pod "global-pull-secret-syncer-tzr85" (UID: "58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed") : object "kube-system"/"original-pull-secret" not registered Jul 14 11:37:53.772246 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:53.772162 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:37:53.772246 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:53.772212 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d1625cf-fd45-4ff6-9571-9220ac046239-metrics-certs podName:2d1625cf-fd45-4ff6-9571-9220ac046239 nodeName:}" failed. No retries permitted until 2026-07-14 11:37:55.772196172 +0000 UTC m=+6.134847468 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d1625cf-fd45-4ff6-9571-9220ac046239-metrics-certs") pod "network-metrics-daemon-gphmx" (UID: "2d1625cf-fd45-4ff6-9571-9220ac046239") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:37:54.088269 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:54.088157 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 11:32:52 +0000 UTC" deadline="2028-04-01 04:18:51.007966882 +0000 UTC" Jul 14 11:37:54.088269 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:54.088219 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15040h40m56.91975182s" Jul 14 11:37:54.295618 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:54.295578 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:37:54.295806 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:54.295717 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gphmx" podUID="2d1625cf-fd45-4ff6-9571-9220ac046239" Jul 14 11:37:54.295806 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:54.295802 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:37:54.295916 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:54.295874 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzr85" podUID="58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed" Jul 14 11:37:54.335488 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:54.335447 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-205.ec2.internal" event={"ID":"0f2609a843c4dae5cfd321dd4169d5da","Type":"ContainerStarted","Data":"b4ef1b0e76b593a9e50ee9377d2d5f00f139fc050b3acb07e6b7105486db7309"} Jul 14 11:37:54.360208 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:54.359672 2582 generic.go:356] "Generic (PLEG): container finished" podID="8007adcc2fcfc5f67cc32826f90757af" containerID="b7057094e13df0e521acbaede77f6d713a4e1162907a51bd9fc35bd7af3c7f51" exitCode=0 Jul 14 11:37:54.360208 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:54.359729 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-205.ec2.internal" event={"ID":"8007adcc2fcfc5f67cc32826f90757af","Type":"ContainerDied","Data":"b7057094e13df0e521acbaede77f6d713a4e1162907a51bd9fc35bd7af3c7f51"} Jul 14 11:37:54.378820 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:54.378752 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-205.ec2.internal" podStartSLOduration=3.378711721 podStartE2EDuration="3.378711721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:37:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:37:54.356193434 +0000 UTC m=+4.718844739" watchObservedRunningTime="2026-07-14 11:37:54.378711721 +0000 UTC m=+4.741363018" Jul 14 11:37:55.286028 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:55.285991 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:37:55.286497 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:55.286145 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glc7q" podUID="fa03e907-e470-4ad5-b38e-06f4662d3ec0" Jul 14 11:37:55.382060 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:55.382018 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-205.ec2.internal" event={"ID":"8007adcc2fcfc5f67cc32826f90757af","Type":"ContainerStarted","Data":"02356be157bbb53b59edb43551fc5e057453b862082578a814d697319e3952e4"} Jul 14 11:37:55.688296 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:55.688158 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqft8\" (UniqueName: \"kubernetes.io/projected/fa03e907-e470-4ad5-b38e-06f4662d3ec0-kube-api-access-nqft8\") pod \"network-check-target-glc7q\" (UID: \"fa03e907-e470-4ad5-b38e-06f4662d3ec0\") " pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:37:55.688461 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:55.688348 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 11:37:55.688461 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:55.688370 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 11:37:55.688461 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:55.688384 2582 projected.go:196] Error preparing data for projected volume kube-api-access-nqft8 for pod openshift-network-diagnostics/network-check-target-glc7q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:37:55.688461 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:55.688448 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa03e907-e470-4ad5-b38e-06f4662d3ec0-kube-api-access-nqft8 podName:fa03e907-e470-4ad5-b38e-06f4662d3ec0 nodeName:}" failed. No retries permitted until 2026-07-14 11:37:59.688421561 +0000 UTC m=+10.051072857 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqft8" (UniqueName: "kubernetes.io/projected/fa03e907-e470-4ad5-b38e-06f4662d3ec0-kube-api-access-nqft8") pod "network-check-target-glc7q" (UID: "fa03e907-e470-4ad5-b38e-06f4662d3ec0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:37:55.789259 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:55.789216 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-original-pull-secret\") pod \"global-pull-secret-syncer-tzr85\" (UID: \"58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed\") " pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:37:55.789443 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:55.789302 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d1625cf-fd45-4ff6-9571-9220ac046239-metrics-certs\") pod \"network-metrics-daemon-gphmx\" (UID: \"2d1625cf-fd45-4ff6-9571-9220ac046239\") " pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:37:55.789514 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:55.789441 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:37:55.789514 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:55.789502 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d1625cf-fd45-4ff6-9571-9220ac046239-metrics-certs podName:2d1625cf-fd45-4ff6-9571-9220ac046239 nodeName:}" failed. No retries permitted until 2026-07-14 11:37:59.789483724 +0000 UTC m=+10.152135023 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d1625cf-fd45-4ff6-9571-9220ac046239-metrics-certs") pod "network-metrics-daemon-gphmx" (UID: "2d1625cf-fd45-4ff6-9571-9220ac046239") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:37:55.790208 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:55.789915 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 11:37:55.790208 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:55.789972 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-original-pull-secret podName:58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed nodeName:}" failed. No retries permitted until 2026-07-14 11:37:59.789954448 +0000 UTC m=+10.152605734 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-original-pull-secret") pod "global-pull-secret-syncer-tzr85" (UID: "58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed") : object "kube-system"/"original-pull-secret" not registered Jul 14 11:37:56.286616 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:56.286578 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:37:56.287077 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:56.286734 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gphmx" podUID="2d1625cf-fd45-4ff6-9571-9220ac046239" Jul 14 11:37:56.287077 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:56.286948 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:37:56.287077 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:56.287050 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzr85" podUID="58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed" Jul 14 11:37:57.286213 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:57.286178 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:37:57.286402 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:57.286293 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glc7q" podUID="fa03e907-e470-4ad5-b38e-06f4662d3ec0" Jul 14 11:37:58.286373 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:58.286296 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:37:58.286711 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:58.286297 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:37:58.286711 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:58.286442 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzr85" podUID="58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed" Jul 14 11:37:58.286711 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:58.286558 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gphmx" podUID="2d1625cf-fd45-4ff6-9571-9220ac046239" Jul 14 11:37:59.286401 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:59.286355 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:37:59.286879 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:59.286498 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glc7q" podUID="fa03e907-e470-4ad5-b38e-06f4662d3ec0" Jul 14 11:37:59.721591 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:59.721510 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqft8\" (UniqueName: \"kubernetes.io/projected/fa03e907-e470-4ad5-b38e-06f4662d3ec0-kube-api-access-nqft8\") pod \"network-check-target-glc7q\" (UID: \"fa03e907-e470-4ad5-b38e-06f4662d3ec0\") " pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:37:59.721754 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:59.721676 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 11:37:59.721754 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:59.721696 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 11:37:59.721754 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:59.721709 2582 projected.go:196] Error preparing data for projected volume kube-api-access-nqft8 for pod openshift-network-diagnostics/network-check-target-glc7q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:37:59.721876 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:59.721777 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa03e907-e470-4ad5-b38e-06f4662d3ec0-kube-api-access-nqft8 podName:fa03e907-e470-4ad5-b38e-06f4662d3ec0 nodeName:}" failed. No retries permitted until 2026-07-14 11:38:07.721757038 +0000 UTC m=+18.084408341 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqft8" (UniqueName: "kubernetes.io/projected/fa03e907-e470-4ad5-b38e-06f4662d3ec0-kube-api-access-nqft8") pod "network-check-target-glc7q" (UID: "fa03e907-e470-4ad5-b38e-06f4662d3ec0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:37:59.822672 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:59.822628 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d1625cf-fd45-4ff6-9571-9220ac046239-metrics-certs\") pod \"network-metrics-daemon-gphmx\" (UID: \"2d1625cf-fd45-4ff6-9571-9220ac046239\") " pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:37:59.822870 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:37:59.822697 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-original-pull-secret\") pod \"global-pull-secret-syncer-tzr85\" (UID: \"58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed\") " pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:37:59.822870 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:59.822851 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 11:37:59.822870 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:59.822856 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:37:59.823051 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:59.822913 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-original-pull-secret podName:58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed nodeName:}" failed. No retries permitted until 2026-07-14 11:38:07.82289433 +0000 UTC m=+18.185545623 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-original-pull-secret") pod "global-pull-secret-syncer-tzr85" (UID: "58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed") : object "kube-system"/"original-pull-secret" not registered Jul 14 11:37:59.823051 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:37:59.822934 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d1625cf-fd45-4ff6-9571-9220ac046239-metrics-certs podName:2d1625cf-fd45-4ff6-9571-9220ac046239 nodeName:}" failed. No retries permitted until 2026-07-14 11:38:07.822922801 +0000 UTC m=+18.185574086 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d1625cf-fd45-4ff6-9571-9220ac046239-metrics-certs") pod "network-metrics-daemon-gphmx" (UID: "2d1625cf-fd45-4ff6-9571-9220ac046239") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:38:00.287551 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:00.287088 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:38:00.287551 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:00.287199 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzr85" podUID="58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed" Jul 14 11:38:00.287551 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:00.287247 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:38:00.287551 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:00.287392 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gphmx" podUID="2d1625cf-fd45-4ff6-9571-9220ac046239" Jul 14 11:38:01.285796 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:01.285760 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:38:01.285965 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:01.285887 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glc7q" podUID="fa03e907-e470-4ad5-b38e-06f4662d3ec0" Jul 14 11:38:02.286470 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:02.286441 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:38:02.286991 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:02.286581 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gphmx" podUID="2d1625cf-fd45-4ff6-9571-9220ac046239" Jul 14 11:38:02.286991 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:02.286634 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:38:02.286991 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:02.286750 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzr85" podUID="58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed" Jul 14 11:38:03.286379 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:03.286338 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:38:03.286544 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:03.286482 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glc7q" podUID="fa03e907-e470-4ad5-b38e-06f4662d3ec0" Jul 14 11:38:04.286111 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:04.286060 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:38:04.286280 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:04.286220 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gphmx" podUID="2d1625cf-fd45-4ff6-9571-9220ac046239" Jul 14 11:38:04.286280 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:04.286261 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:38:04.286399 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:04.286334 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzr85" podUID="58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed" Jul 14 11:38:05.285821 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:05.285781 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:38:05.286242 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:05.285897 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glc7q" podUID="fa03e907-e470-4ad5-b38e-06f4662d3ec0" Jul 14 11:38:06.285451 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:06.285414 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:38:06.285634 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:06.285463 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:38:06.285634 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:06.285566 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gphmx" podUID="2d1625cf-fd45-4ff6-9571-9220ac046239" Jul 14 11:38:06.285762 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:06.285686 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzr85" podUID="58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed" Jul 14 11:38:07.285773 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:07.285736 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:38:07.286265 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:07.285840 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glc7q" podUID="fa03e907-e470-4ad5-b38e-06f4662d3ec0" Jul 14 11:38:07.788142 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:07.788085 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqft8\" (UniqueName: \"kubernetes.io/projected/fa03e907-e470-4ad5-b38e-06f4662d3ec0-kube-api-access-nqft8\") pod \"network-check-target-glc7q\" (UID: \"fa03e907-e470-4ad5-b38e-06f4662d3ec0\") " pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:38:07.788289 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:07.788224 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 11:38:07.788289 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:07.788243 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 11:38:07.788289 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:07.788253 2582 projected.go:196] Error preparing data for projected volume kube-api-access-nqft8 for pod openshift-network-diagnostics/network-check-target-glc7q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:38:07.788425 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:07.788313 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa03e907-e470-4ad5-b38e-06f4662d3ec0-kube-api-access-nqft8 podName:fa03e907-e470-4ad5-b38e-06f4662d3ec0 nodeName:}" failed. No retries permitted until 2026-07-14 11:38:23.788296659 +0000 UTC m=+34.150947955 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqft8" (UniqueName: "kubernetes.io/projected/fa03e907-e470-4ad5-b38e-06f4662d3ec0-kube-api-access-nqft8") pod "network-check-target-glc7q" (UID: "fa03e907-e470-4ad5-b38e-06f4662d3ec0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:38:07.888484 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:07.888447 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d1625cf-fd45-4ff6-9571-9220ac046239-metrics-certs\") pod \"network-metrics-daemon-gphmx\" (UID: \"2d1625cf-fd45-4ff6-9571-9220ac046239\") " pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:38:07.888655 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:07.888503 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-original-pull-secret\") pod \"global-pull-secret-syncer-tzr85\" (UID: \"58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed\") " pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:38:07.888655 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:07.888618 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:38:07.888788 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:07.888677 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d1625cf-fd45-4ff6-9571-9220ac046239-metrics-certs podName:2d1625cf-fd45-4ff6-9571-9220ac046239 nodeName:}" failed. No retries permitted until 2026-07-14 11:38:23.888660642 +0000 UTC m=+34.251311927 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d1625cf-fd45-4ff6-9571-9220ac046239-metrics-certs") pod "network-metrics-daemon-gphmx" (UID: "2d1625cf-fd45-4ff6-9571-9220ac046239") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:38:07.888788 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:07.888618 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 11:38:07.888788 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:07.888746 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-original-pull-secret podName:58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed nodeName:}" failed. No retries permitted until 2026-07-14 11:38:23.888734735 +0000 UTC m=+34.251386034 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-original-pull-secret") pod "global-pull-secret-syncer-tzr85" (UID: "58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed") : object "kube-system"/"original-pull-secret" not registered Jul 14 11:38:08.286176 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:08.286135 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:38:08.286660 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:08.286283 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gphmx" podUID="2d1625cf-fd45-4ff6-9571-9220ac046239" Jul 14 11:38:08.286660 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:08.286151 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:38:08.286800 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:08.286775 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzr85" podUID="58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed" Jul 14 11:38:09.285669 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:09.285628 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:38:09.285849 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:09.285764 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glc7q" podUID="fa03e907-e470-4ad5-b38e-06f4662d3ec0" Jul 14 11:38:10.287258 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:10.287192 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:38:10.287725 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:10.287319 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzr85" podUID="58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed" Jul 14 11:38:10.287725 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:10.287371 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:38:10.287725 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:10.287512 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gphmx" podUID="2d1625cf-fd45-4ff6-9571-9220ac046239" Jul 14 11:38:11.285366 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:11.285331 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:38:11.285543 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:11.285446 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glc7q" podUID="fa03e907-e470-4ad5-b38e-06f4662d3ec0" Jul 14 11:38:12.286422 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:12.286002 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:38:12.287195 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:12.286061 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:38:12.287195 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:12.286554 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gphmx" podUID="2d1625cf-fd45-4ff6-9571-9220ac046239" Jul 14 11:38:12.287195 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:12.286673 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzr85" podUID="58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed" Jul 14 11:38:12.417061 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:12.416956 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-khpgc" event={"ID":"3a59961e-8988-4654-a707-2d8eebcfd740","Type":"ContainerStarted","Data":"163850e04698eeb35ace516f6cae029b96401272df65af9e1b602a796b5534b8"} Jul 14 11:38:12.418390 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:12.418368 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4tmvk" event={"ID":"e6698d51-507d-42a3-a123-cbf47abb0fc7","Type":"ContainerStarted","Data":"f199e9206da077beafbb3deb592446cc926b7e915059a954a58bf85fb8873a18"} Jul 14 11:38:12.419577 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:12.419555 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4ckdz" event={"ID":"bf48c046-e649-4f0d-b391-bcc30e7c1717","Type":"ContainerStarted","Data":"c1cac5a0100c2411d7a28877720660e01af0b2cc7055216077c222d2c5de7eb7"} Jul 14 11:38:12.422288 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:12.422259 2582 generic.go:356] "Generic (PLEG): container finished" podID="4ceff054-c0dd-4638-8b83-a4a84fb109e1" containerID="281a65c728b1016c85673325d2f8019a4fa4604e09c19f7eecd1d6a61fda7fff" exitCode=0 Jul 14 11:38:12.422389 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:12.422356 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cf87x" event={"ID":"4ceff054-c0dd-4638-8b83-a4a84fb109e1","Type":"ContainerDied","Data":"281a65c728b1016c85673325d2f8019a4fa4604e09c19f7eecd1d6a61fda7fff"} Jul 14 11:38:12.423986 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:12.423966 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tnppw" event={"ID":"7746b3b3-3c3d-44b6-b78a-c17e33f83a15","Type":"ContainerStarted","Data":"6fe0c12d5c696ae50d81216e5c06bdb9c4be714696cd0a0a0ee0d53073627929"} Jul 14 11:38:12.425331 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:12.425292 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d5t8j" event={"ID":"26896a0a-efe8-47c3-8ba4-725363407c4f","Type":"ContainerStarted","Data":"548a6cc3539e819773267675343232da00235593b4f5531d103c9a9fbee6458e"} Jul 14 11:38:12.426588 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:12.426570 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-trjql" event={"ID":"ea5c34bb-6876-46ea-891f-02cbcf0ba9fe","Type":"ContainerStarted","Data":"4fcdd71461a50300dd14acc5f5b6ad16187f02e915840e7856e15d19ca70a196"} Jul 14 11:38:12.428485 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:12.428466 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" event={"ID":"6033bdfb-e0c3-40ae-9f7a-9f52361ca839","Type":"ContainerStarted","Data":"f8491413556c33030e321445a0602ecd9c6b7a4abaec5feeff8b3075ee70f825"} Jul 14 11:38:12.428573 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:12.428536 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" event={"ID":"6033bdfb-e0c3-40ae-9f7a-9f52361ca839","Type":"ContainerStarted","Data":"a2e155041e2bc4e7689f4bb27c55b3e9717e6d368fbd214159414b2d2026428d"} Jul 14 11:38:12.428629 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:12.428586 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" event={"ID":"6033bdfb-e0c3-40ae-9f7a-9f52361ca839","Type":"ContainerStarted","Data":"3a82b4451c8aa0a5e6e21fca621b57bc581d40f0c13a1677188a9cb08cddf46e"} Jul 14 11:38:12.436257 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:12.436218 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-205.ec2.internal" podStartSLOduration=21.436205415 podStartE2EDuration="21.436205415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:37:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:37:55.404404193 +0000 UTC m=+5.767055498" watchObservedRunningTime="2026-07-14 11:38:12.436205415 +0000 UTC m=+22.798856713" Jul 14 11:38:12.436631 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:12.436605 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-khpgc" podStartSLOduration=3.803146483 podStartE2EDuration="22.436598834s" totalImagesPullingTime="18.633452351s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:37:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:38:12.436136508 +0000 UTC m=+22.798787812" watchObservedRunningTime="2026-07-14 11:38:12.436598834 +0000 UTC m=+22.799250137" Jul 14 11:38:12.453335 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:12.453292 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-d5t8j" podStartSLOduration=3.823492885 podStartE2EDuration="22.453276805s" totalImagesPullingTime="18.62978392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:37:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:38:12.452796094 +0000 UTC m=+22.815447398" watchObservedRunningTime="2026-07-14 11:38:12.453276805 +0000 UTC m=+22.815928319" Jul 14 11:38:12.515708 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:12.515665 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tnppw" podStartSLOduration=3.888756001 podStartE2EDuration="22.515649974s" totalImagesPullingTime="18.626893973s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:37:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:38:12.498954667 +0000 UTC m=+22.861605972" watchObservedRunningTime="2026-07-14 11:38:12.515649974 +0000 UTC m=+22.878301278" Jul 14 11:38:12.536619 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:12.536578 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-trjql" podStartSLOduration=3.900102062 podStartE2EDuration="22.536563132s" totalImagesPullingTime="18.63646107s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:37:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:38:12.515351675 +0000 UTC m=+22.878002957" watchObservedRunningTime="2026-07-14 11:38:12.536563132 +0000 UTC m=+22.899214517" Jul 14 11:38:12.536732 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:12.536684 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4ckdz" podStartSLOduration=3.852893797 podStartE2EDuration="22.536679239s" totalImagesPullingTime="18.683785442s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:37:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:38:12.536230945 +0000 UTC m=+22.898882249" watchObservedRunningTime="2026-07-14 11:38:12.536679239 +0000 UTC m=+22.899330543" Jul 14 11:38:13.285878 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:13.285838 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:38:13.286050 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:13.285967 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glc7q" podUID="fa03e907-e470-4ad5-b38e-06f4662d3ec0" Jul 14 11:38:13.433001 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:13.432965 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z4l6s" event={"ID":"97342d9e-98be-4bd1-8ac6-8f5d387fb287","Type":"ContainerStarted","Data":"70fa80c04ad51d9f2cc1a74c4bb158077dbb36aa2f5d2b6944796c9e651d1228"} Jul 14 11:38:13.436814 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:13.436783 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" event={"ID":"6033bdfb-e0c3-40ae-9f7a-9f52361ca839","Type":"ContainerStarted","Data":"1c8449d6e59bd7206fcd8fc21ab6cf1adca231014765246bc4619385a1668c3f"} Jul 14 11:38:13.436936 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:13.436859 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" event={"ID":"6033bdfb-e0c3-40ae-9f7a-9f52361ca839","Type":"ContainerStarted","Data":"74d88fa11c712f7a1a7c9d53440519093405c222ca8def2812666644f1efad91"} Jul 14 11:38:13.436936 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:13.436900 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" event={"ID":"6033bdfb-e0c3-40ae-9f7a-9f52361ca839","Type":"ContainerStarted","Data":"279d20c0aa7ad728b966849ea732c407993936f2000d88c791eb24990f064466"} Jul 14 11:38:13.451173 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:13.451125 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z4l6s" podStartSLOduration=4.818285913 podStartE2EDuration="23.451090639s" totalImagesPullingTime="18.632804726s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:37:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:38:13.450489191 +0000 UTC m=+23.813140496" watchObservedRunningTime="2026-07-14 11:38:13.451090639 +0000 UTC m=+23.813741943" Jul 14 11:38:13.469905 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:13.469877 2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 14 11:38:14.122359 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:14.122257 2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T11:38:13.469897053Z","UUID":"a9cbe804-6bc4-4d93-8643-b39f3384c0c5","Handler":null,"Name":"","Endpoint":""} Jul 14 11:38:14.124156 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:14.124136 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 14 11:38:14.124302 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:14.124176 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 14 11:38:14.285674 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:14.285642 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:38:14.285858 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:14.285642 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:38:14.285858 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:14.285783 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gphmx" podUID="2d1625cf-fd45-4ff6-9571-9220ac046239" Jul 14 11:38:14.285977 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:14.285866 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzr85" podUID="58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed" Jul 14 11:38:14.443778 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:14.443732 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4tmvk" event={"ID":"e6698d51-507d-42a3-a123-cbf47abb0fc7","Type":"ContainerStarted","Data":"35373363d966eeefdc2fbbb0b275cb925139bde547cab3c3a015d39fcd969ed2"} Jul 14 11:38:15.285931 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:15.285894 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:38:15.286215 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:15.286020 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glc7q" podUID="fa03e907-e470-4ad5-b38e-06f4662d3ec0" Jul 14 11:38:15.449916 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:15.449873 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" event={"ID":"6033bdfb-e0c3-40ae-9f7a-9f52361ca839","Type":"ContainerStarted","Data":"34d1acbcb984e4f903a9099b7b8d3b76c83c173f421b6e7598fdd73eda44970c"} Jul 14 11:38:15.452209 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:15.452173 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4tmvk" event={"ID":"e6698d51-507d-42a3-a123-cbf47abb0fc7","Type":"ContainerStarted","Data":"485228abdb6f2181c24f5de12f04ed22f3e2034033df207881ea08b55b9ab100"} Jul 14 11:38:15.473789 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:15.473727 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4tmvk" podStartSLOduration=4.4640024369999995 podStartE2EDuration="25.473707709s" totalImagesPullingTime="21.009705272s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:37:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:38:15.47340518 +0000 UTC m=+25.836056483" watchObservedRunningTime="2026-07-14 11:38:15.473707709 +0000 UTC m=+25.836359015" Jul 14 11:38:15.617818 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:15.617716 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-d5t8j" Jul 14 11:38:15.618490 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:15.618465 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-d5t8j" Jul 14 11:38:16.286403 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:16.286193 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:38:16.286572 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:16.286211 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:38:16.286572 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:16.286493 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzr85" podUID="58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed" Jul 14 11:38:16.286674 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:16.286572 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gphmx" podUID="2d1625cf-fd45-4ff6-9571-9220ac046239" Jul 14 11:38:16.454469 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:16.454435 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-d5t8j" Jul 14 11:38:16.454838 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:16.454528 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-d5t8j" Jul 14 11:38:17.285823 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:17.285746 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:38:17.285971 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:17.285868 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glc7q" podUID="fa03e907-e470-4ad5-b38e-06f4662d3ec0" Jul 14 11:38:17.464881 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:17.464843 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" event={"ID":"6033bdfb-e0c3-40ae-9f7a-9f52361ca839","Type":"ContainerStarted","Data":"f30b4faf3099f063eeb75411b5895367c3aed80fa1fbafbd2a223cbf7d386e27"} Jul 14 11:38:17.465909 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:17.465051 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:38:17.465909 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:17.465137 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:38:17.466764 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:17.466736 2582 generic.go:356] "Generic (PLEG): container finished" podID="4ceff054-c0dd-4638-8b83-a4a84fb109e1" containerID="f8ed62eadefae61afee125cec61ae5fca14a8285b30eced85365d579dd857484" exitCode=0 Jul 14 11:38:17.466889 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:17.466820 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cf87x" event={"ID":"4ceff054-c0dd-4638-8b83-a4a84fb109e1","Type":"ContainerDied","Data":"f8ed62eadefae61afee125cec61ae5fca14a8285b30eced85365d579dd857484"} Jul 14 11:38:17.481640 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:17.481471 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:38:17.496677 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:17.496632 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" podStartSLOduration=8.751818208 podStartE2EDuration="27.496618603s" totalImagesPullingTime="18.744800395s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:37:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:38:17.496414531 +0000 UTC m=+27.859065835" watchObservedRunningTime="2026-07-14 11:38:17.496618603 +0000 UTC m=+27.859269906" Jul 14 11:38:18.285924 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:18.285890 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:38:18.285924 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:18.285925 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:38:18.286268 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:18.286050 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gphmx" podUID="2d1625cf-fd45-4ff6-9571-9220ac046239" Jul 14 11:38:18.286268 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:18.286197 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzr85" podUID="58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed" Jul 14 11:38:18.468808 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:18.468780 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:38:18.484456 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:18.484431 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:38:19.286144 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:19.286090 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:38:19.286342 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:19.286211 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glc7q" podUID="fa03e907-e470-4ad5-b38e-06f4662d3ec0" Jul 14 11:38:19.382227 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:19.382192 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gphmx"] Jul 14 11:38:19.382381 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:19.382323 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:38:19.382436 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:19.382417 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gphmx" podUID="2d1625cf-fd45-4ff6-9571-9220ac046239" Jul 14 11:38:19.386654 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:19.386623 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tzr85"] Jul 14 11:38:19.386809 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:19.386762 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:38:19.386890 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:19.386868 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzr85" podUID="58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed" Jul 14 11:38:19.387232 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:19.387208 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-glc7q"] Jul 14 11:38:19.472695 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:19.472659 2582 generic.go:356] "Generic (PLEG): container finished" podID="4ceff054-c0dd-4638-8b83-a4a84fb109e1" containerID="7caf258baeb6a1f5e20dc8523b0937d592e92ddd761e09e2abee82bf56177637" exitCode=0 Jul 14 11:38:19.473259 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:19.472749 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cf87x" event={"ID":"4ceff054-c0dd-4638-8b83-a4a84fb109e1","Type":"ContainerDied","Data":"7caf258baeb6a1f5e20dc8523b0937d592e92ddd761e09e2abee82bf56177637"} Jul 14 11:38:19.473259 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:19.472806 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:38:19.473259 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:19.472888 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glc7q" podUID="fa03e907-e470-4ad5-b38e-06f4662d3ec0" Jul 14 11:38:21.285878 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:21.285636 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:38:21.285878 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:21.285647 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:38:21.286408 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:21.285889 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glc7q" podUID="fa03e907-e470-4ad5-b38e-06f4662d3ec0" Jul 14 11:38:21.286408 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:21.285980 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gphmx" podUID="2d1625cf-fd45-4ff6-9571-9220ac046239" Jul 14 11:38:21.286408 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:21.285647 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:38:21.286408 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:21.286064 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzr85" podUID="58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed" Jul 14 11:38:21.479838 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:21.479808 2582 generic.go:356] "Generic (PLEG): container finished" podID="4ceff054-c0dd-4638-8b83-a4a84fb109e1" containerID="63e20ded102f8587ec26e512b719c3a1abce9b45fc79ae78364342172ab8be9c" exitCode=0 Jul 14 11:38:21.480008 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:21.479846 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cf87x" event={"ID":"4ceff054-c0dd-4638-8b83-a4a84fb109e1","Type":"ContainerDied","Data":"63e20ded102f8587ec26e512b719c3a1abce9b45fc79ae78364342172ab8be9c"} Jul 14 11:38:23.285407 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:23.285362 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:38:23.286063 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:23.285362 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:38:23.286063 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:23.285494 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tzr85" podUID="58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed" Jul 14 11:38:23.286063 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:23.285377 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:38:23.286063 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:23.285597 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gphmx" podUID="2d1625cf-fd45-4ff6-9571-9220ac046239" Jul 14 11:38:23.286063 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:23.285666 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-glc7q" podUID="fa03e907-e470-4ad5-b38e-06f4662d3ec0" Jul 14 11:38:23.810236 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:23.810199 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqft8\" (UniqueName: \"kubernetes.io/projected/fa03e907-e470-4ad5-b38e-06f4662d3ec0-kube-api-access-nqft8\") pod \"network-check-target-glc7q\" (UID: \"fa03e907-e470-4ad5-b38e-06f4662d3ec0\") " pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:38:23.810446 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:23.810422 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 11:38:23.810519 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:23.810454 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 11:38:23.810519 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:23.810468 2582 projected.go:196] Error preparing data for projected volume kube-api-access-nqft8 for pod openshift-network-diagnostics/network-check-target-glc7q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:38:23.810620 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:23.810538 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa03e907-e470-4ad5-b38e-06f4662d3ec0-kube-api-access-nqft8 podName:fa03e907-e470-4ad5-b38e-06f4662d3ec0 nodeName:}" failed. No retries permitted until 2026-07-14 11:38:55.810516422 +0000 UTC m=+66.173167719 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqft8" (UniqueName: "kubernetes.io/projected/fa03e907-e470-4ad5-b38e-06f4662d3ec0-kube-api-access-nqft8") pod "network-check-target-glc7q" (UID: "fa03e907-e470-4ad5-b38e-06f4662d3ec0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:38:23.910574 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:23.910537 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d1625cf-fd45-4ff6-9571-9220ac046239-metrics-certs\") pod \"network-metrics-daemon-gphmx\" (UID: \"2d1625cf-fd45-4ff6-9571-9220ac046239\") " pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:38:23.910759 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:23.910602 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-original-pull-secret\") pod \"global-pull-secret-syncer-tzr85\" (UID: \"58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed\") " pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:38:23.910759 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:23.910716 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:38:23.910855 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:23.910803 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d1625cf-fd45-4ff6-9571-9220ac046239-metrics-certs podName:2d1625cf-fd45-4ff6-9571-9220ac046239 nodeName:}" failed. No retries permitted until 2026-07-14 11:38:55.910779901 +0000 UTC m=+66.273431195 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d1625cf-fd45-4ff6-9571-9220ac046239-metrics-certs") pod "network-metrics-daemon-gphmx" (UID: "2d1625cf-fd45-4ff6-9571-9220ac046239") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:38:23.910855 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:23.910723 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 11:38:23.910972 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:23.910868 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-original-pull-secret podName:58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed nodeName:}" failed. No retries permitted until 2026-07-14 11:38:55.910854677 +0000 UTC m=+66.273505963 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-original-pull-secret") pod "global-pull-secret-syncer-tzr85" (UID: "58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed") : object "kube-system"/"original-pull-secret" not registered Jul 14 11:38:24.944484 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:24.944456 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-205.ec2.internal" event="NodeReady" Jul 14 11:38:24.945078 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:24.944605 2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 14 11:38:24.993321 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:24.993291 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hmwlj"] Jul 14 11:38:24.995729 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:24.995707 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hmwlj" Jul 14 11:38:24.999889 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:24.999862 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 14 11:38:25.000602 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.000581 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9dtrp\"" Jul 14 11:38:25.000766 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.000644 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fvzhp"] Jul 14 11:38:25.000766 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.000744 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 14 11:38:25.002344 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.002318 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fvzhp" Jul 14 11:38:25.005189 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.005064 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 14 11:38:25.005263 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.005242 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 14 11:38:25.005480 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.005461 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 14 11:38:25.005573 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.005503 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8ht88\"" Jul 14 11:38:25.009233 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.009164 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hmwlj"] Jul 14 11:38:25.015494 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.015469 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fvzhp"] Jul 14 11:38:25.119869 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.119839 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x74h4\" (UniqueName: \"kubernetes.io/projected/4ceae2d9-3ec8-41c4-99b6-34be1f78fb82-kube-api-access-x74h4\") pod \"ingress-canary-fvzhp\" (UID: \"4ceae2d9-3ec8-41c4-99b6-34be1f78fb82\") " pod="openshift-ingress-canary/ingress-canary-fvzhp" Jul 14 11:38:25.120039 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.119903 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d964c90c-a221-44a2-809c-d274d60ceb0c-config-volume\") pod \"dns-default-hmwlj\" (UID: \"d964c90c-a221-44a2-809c-d274d60ceb0c\") " pod="openshift-dns/dns-default-hmwlj" Jul 14 11:38:25.120039 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.119930 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d964c90c-a221-44a2-809c-d274d60ceb0c-tmp-dir\") pod \"dns-default-hmwlj\" (UID: \"d964c90c-a221-44a2-809c-d274d60ceb0c\") " pod="openshift-dns/dns-default-hmwlj" Jul 14 11:38:25.120039 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.119958 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t87k\" (UniqueName: \"kubernetes.io/projected/d964c90c-a221-44a2-809c-d274d60ceb0c-kube-api-access-7t87k\") pod \"dns-default-hmwlj\" (UID: \"d964c90c-a221-44a2-809c-d274d60ceb0c\") " pod="openshift-dns/dns-default-hmwlj" Jul 14 11:38:25.120039 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.119976 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d964c90c-a221-44a2-809c-d274d60ceb0c-metrics-tls\") pod \"dns-default-hmwlj\" (UID: \"d964c90c-a221-44a2-809c-d274d60ceb0c\") " pod="openshift-dns/dns-default-hmwlj" Jul 14 11:38:25.120236 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.120086 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ceae2d9-3ec8-41c4-99b6-34be1f78fb82-cert\") pod \"ingress-canary-fvzhp\" (UID: \"4ceae2d9-3ec8-41c4-99b6-34be1f78fb82\") " pod="openshift-ingress-canary/ingress-canary-fvzhp" Jul 14 11:38:25.221450 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.221366 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ceae2d9-3ec8-41c4-99b6-34be1f78fb82-cert\") pod \"ingress-canary-fvzhp\" (UID: \"4ceae2d9-3ec8-41c4-99b6-34be1f78fb82\") " pod="openshift-ingress-canary/ingress-canary-fvzhp" Jul 14 11:38:25.221450 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.221408 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x74h4\" (UniqueName: \"kubernetes.io/projected/4ceae2d9-3ec8-41c4-99b6-34be1f78fb82-kube-api-access-x74h4\") pod \"ingress-canary-fvzhp\" (UID: \"4ceae2d9-3ec8-41c4-99b6-34be1f78fb82\") " pod="openshift-ingress-canary/ingress-canary-fvzhp" Jul 14 11:38:25.221677 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.221460 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d964c90c-a221-44a2-809c-d274d60ceb0c-config-volume\") pod \"dns-default-hmwlj\" (UID: \"d964c90c-a221-44a2-809c-d274d60ceb0c\") " pod="openshift-dns/dns-default-hmwlj" Jul 14 11:38:25.221677 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.221485 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d964c90c-a221-44a2-809c-d274d60ceb0c-tmp-dir\") pod \"dns-default-hmwlj\" (UID: \"d964c90c-a221-44a2-809c-d274d60ceb0c\") " pod="openshift-dns/dns-default-hmwlj" Jul 14 11:38:25.221677 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.221511 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t87k\" (UniqueName: \"kubernetes.io/projected/d964c90c-a221-44a2-809c-d274d60ceb0c-kube-api-access-7t87k\") pod \"dns-default-hmwlj\" (UID: \"d964c90c-a221-44a2-809c-d274d60ceb0c\") " pod="openshift-dns/dns-default-hmwlj" Jul 14 11:38:25.221677 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.221534 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d964c90c-a221-44a2-809c-d274d60ceb0c-metrics-tls\") pod \"dns-default-hmwlj\" (UID: \"d964c90c-a221-44a2-809c-d274d60ceb0c\") " pod="openshift-dns/dns-default-hmwlj" Jul 14 11:38:25.221677 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:25.221621 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:38:25.221677 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:25.221680 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d964c90c-a221-44a2-809c-d274d60ceb0c-metrics-tls podName:d964c90c-a221-44a2-809c-d274d60ceb0c nodeName:}" failed. No retries permitted until 2026-07-14 11:38:25.721662392 +0000 UTC m=+36.084313687 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d964c90c-a221-44a2-809c-d274d60ceb0c-metrics-tls") pod "dns-default-hmwlj" (UID: "d964c90c-a221-44a2-809c-d274d60ceb0c") : secret "dns-default-metrics-tls" not found Jul 14 11:38:25.221971 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.221850 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d964c90c-a221-44a2-809c-d274d60ceb0c-tmp-dir\") pod \"dns-default-hmwlj\" (UID: \"d964c90c-a221-44a2-809c-d274d60ceb0c\") " pod="openshift-dns/dns-default-hmwlj" Jul 14 11:38:25.222179 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.222152 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d964c90c-a221-44a2-809c-d274d60ceb0c-config-volume\") pod \"dns-default-hmwlj\" (UID: \"d964c90c-a221-44a2-809c-d274d60ceb0c\") " pod="openshift-dns/dns-default-hmwlj" Jul 14 11:38:25.226026 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.226003 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ceae2d9-3ec8-41c4-99b6-34be1f78fb82-cert\") pod \"ingress-canary-fvzhp\" (UID: \"4ceae2d9-3ec8-41c4-99b6-34be1f78fb82\") " pod="openshift-ingress-canary/ingress-canary-fvzhp" Jul 14 11:38:25.232578 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.232552 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x74h4\" (UniqueName: \"kubernetes.io/projected/4ceae2d9-3ec8-41c4-99b6-34be1f78fb82-kube-api-access-x74h4\") pod \"ingress-canary-fvzhp\" (UID: \"4ceae2d9-3ec8-41c4-99b6-34be1f78fb82\") " pod="openshift-ingress-canary/ingress-canary-fvzhp" Jul 14 11:38:25.232717 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.232593 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t87k\" (UniqueName: \"kubernetes.io/projected/d964c90c-a221-44a2-809c-d274d60ceb0c-kube-api-access-7t87k\") pod \"dns-default-hmwlj\" (UID: \"d964c90c-a221-44a2-809c-d274d60ceb0c\") " pod="openshift-dns/dns-default-hmwlj" Jul 14 11:38:25.286344 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.286305 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:38:25.286344 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.286329 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:38:25.286588 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.286329 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:38:25.289835 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.289810 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 11:38:25.289978 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.289915 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 11:38:25.289978 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.289939 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-26j7k\"" Jul 14 11:38:25.289978 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.289973 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 11:38:25.290171 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.289975 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 11:38:25.290171 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.290062 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9256t\"" Jul 14 11:38:25.317088 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.317062 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fvzhp" Jul 14 11:38:25.664004 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.663788 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fvzhp"] Jul 14 11:38:25.668831 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:38:25.668797 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ceae2d9_3ec8_41c4_99b6_34be1f78fb82.slice/crio-70fa75071960ef2b14cd08281c30518e0b8626e0eec5f30a772defce25a61132 WatchSource:0}: Error finding container 70fa75071960ef2b14cd08281c30518e0b8626e0eec5f30a772defce25a61132: Status 404 returned error can't find the container with id 70fa75071960ef2b14cd08281c30518e0b8626e0eec5f30a772defce25a61132 Jul 14 11:38:25.725409 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:25.725377 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d964c90c-a221-44a2-809c-d274d60ceb0c-metrics-tls\") pod \"dns-default-hmwlj\" (UID: \"d964c90c-a221-44a2-809c-d274d60ceb0c\") " pod="openshift-dns/dns-default-hmwlj" Jul 14 11:38:25.725548 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:25.725517 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:38:25.725595 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:25.725570 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d964c90c-a221-44a2-809c-d274d60ceb0c-metrics-tls podName:d964c90c-a221-44a2-809c-d274d60ceb0c nodeName:}" failed. No retries permitted until 2026-07-14 11:38:26.725555831 +0000 UTC m=+37.088207116 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d964c90c-a221-44a2-809c-d274d60ceb0c-metrics-tls") pod "dns-default-hmwlj" (UID: "d964c90c-a221-44a2-809c-d274d60ceb0c") : secret "dns-default-metrics-tls" not found Jul 14 11:38:26.494214 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:26.494181 2582 generic.go:356] "Generic (PLEG): container finished" podID="4ceff054-c0dd-4638-8b83-a4a84fb109e1" containerID="c53cf805e704f25e79956fabf7f437f4348699bb5d9462de33859d828a2b2e54" exitCode=0 Jul 14 11:38:26.494828 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:26.494264 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cf87x" event={"ID":"4ceff054-c0dd-4638-8b83-a4a84fb109e1","Type":"ContainerDied","Data":"c53cf805e704f25e79956fabf7f437f4348699bb5d9462de33859d828a2b2e54"} Jul 14 11:38:26.495608 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:26.495581 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fvzhp" event={"ID":"4ceae2d9-3ec8-41c4-99b6-34be1f78fb82","Type":"ContainerStarted","Data":"70fa75071960ef2b14cd08281c30518e0b8626e0eec5f30a772defce25a61132"} Jul 14 11:38:26.734618 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:26.734580 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d964c90c-a221-44a2-809c-d274d60ceb0c-metrics-tls\") pod \"dns-default-hmwlj\" (UID: \"d964c90c-a221-44a2-809c-d274d60ceb0c\") " pod="openshift-dns/dns-default-hmwlj" Jul 14 11:38:26.734784 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:26.734700 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:38:26.734784 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:26.734769 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d964c90c-a221-44a2-809c-d274d60ceb0c-metrics-tls podName:d964c90c-a221-44a2-809c-d274d60ceb0c nodeName:}" failed. No retries permitted until 2026-07-14 11:38:28.73474921 +0000 UTC m=+39.097400492 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d964c90c-a221-44a2-809c-d274d60ceb0c-metrics-tls") pod "dns-default-hmwlj" (UID: "d964c90c-a221-44a2-809c-d274d60ceb0c") : secret "dns-default-metrics-tls" not found Jul 14 11:38:27.502462 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:27.502418 2582 generic.go:356] "Generic (PLEG): container finished" podID="4ceff054-c0dd-4638-8b83-a4a84fb109e1" containerID="4368da898c39a1312797d9e7c2f00e7fafeea295411a00b833ae142b2253434c" exitCode=0 Jul 14 11:38:27.502462 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:27.502459 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cf87x" event={"ID":"4ceff054-c0dd-4638-8b83-a4a84fb109e1","Type":"ContainerDied","Data":"4368da898c39a1312797d9e7c2f00e7fafeea295411a00b833ae142b2253434c"} Jul 14 11:38:28.506487 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:28.506270 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fvzhp" event={"ID":"4ceae2d9-3ec8-41c4-99b6-34be1f78fb82","Type":"ContainerStarted","Data":"6d3b36764d3ce72f705acf5626012a088f9ac95c2311304851042e0cb6982c4c"} Jul 14 11:38:28.509439 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:28.509412 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cf87x" event={"ID":"4ceff054-c0dd-4638-8b83-a4a84fb109e1","Type":"ContainerStarted","Data":"5f12b88cd6a5c6e19ba5c7bd222f70576f3e1ee092b41ebd9e9e758f13ef1f65"} Jul 14 11:38:28.526834 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:28.526779 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fvzhp" podStartSLOduration=2.571033414 podStartE2EDuration="4.526760614s" totalImagesPullingTime="1.9557272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:38:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:38:28.526526973 +0000 UTC m=+38.889178280" watchObservedRunningTime="2026-07-14 11:38:28.526760614 +0000 UTC m=+38.889411917" Jul 14 11:38:28.552899 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:28.552843 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cf87x" podStartSLOduration=9.31291345 podStartE2EDuration="38.552821461s" totalImagesPullingTime="29.239908011s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:37:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:38:28.551454875 +0000 UTC m=+38.914106183" watchObservedRunningTime="2026-07-14 11:38:28.552821461 +0000 UTC m=+38.915472766" Jul 14 11:38:28.752437 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:28.752396 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d964c90c-a221-44a2-809c-d274d60ceb0c-metrics-tls\") pod \"dns-default-hmwlj\" (UID: \"d964c90c-a221-44a2-809c-d274d60ceb0c\") " pod="openshift-dns/dns-default-hmwlj" Jul 14 11:38:28.752584 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:28.752523 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:38:28.752584 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:28.752575 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d964c90c-a221-44a2-809c-d274d60ceb0c-metrics-tls podName:d964c90c-a221-44a2-809c-d274d60ceb0c nodeName:}" failed. No retries permitted until 2026-07-14 11:38:32.752561101 +0000 UTC m=+43.115212383 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d964c90c-a221-44a2-809c-d274d60ceb0c-metrics-tls") pod "dns-default-hmwlj" (UID: "d964c90c-a221-44a2-809c-d274d60ceb0c") : secret "dns-default-metrics-tls" not found Jul 14 11:38:32.783294 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:32.783247 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d964c90c-a221-44a2-809c-d274d60ceb0c-metrics-tls\") pod \"dns-default-hmwlj\" (UID: \"d964c90c-a221-44a2-809c-d274d60ceb0c\") " pod="openshift-dns/dns-default-hmwlj" Jul 14 11:38:32.783783 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:32.783427 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:38:32.783783 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:32.783494 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d964c90c-a221-44a2-809c-d274d60ceb0c-metrics-tls podName:d964c90c-a221-44a2-809c-d274d60ceb0c nodeName:}" failed. No retries permitted until 2026-07-14 11:38:40.783478474 +0000 UTC m=+51.146129755 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d964c90c-a221-44a2-809c-d274d60ceb0c-metrics-tls") pod "dns-default-hmwlj" (UID: "d964c90c-a221-44a2-809c-d274d60ceb0c") : secret "dns-default-metrics-tls" not found Jul 14 11:38:40.841951 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:40.841911 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d964c90c-a221-44a2-809c-d274d60ceb0c-metrics-tls\") pod \"dns-default-hmwlj\" (UID: \"d964c90c-a221-44a2-809c-d274d60ceb0c\") " pod="openshift-dns/dns-default-hmwlj" Jul 14 11:38:40.842459 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:40.842075 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:38:40.842459 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:40.842171 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d964c90c-a221-44a2-809c-d274d60ceb0c-metrics-tls podName:d964c90c-a221-44a2-809c-d274d60ceb0c nodeName:}" failed. No retries permitted until 2026-07-14 11:38:56.842153494 +0000 UTC m=+67.204804776 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d964c90c-a221-44a2-809c-d274d60ceb0c-metrics-tls") pod "dns-default-hmwlj" (UID: "d964c90c-a221-44a2-809c-d274d60ceb0c") : secret "dns-default-metrics-tls" not found Jul 14 11:38:50.485326 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:50.485293 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z62fl" Jul 14 11:38:51.419362 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.419329 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9fhh5"] Jul 14 11:38:51.421784 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.421764 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9fhh5" Jul 14 11:38:51.426164 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.426133 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 14 11:38:51.428211 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.427732 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 14 11:38:51.428211 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.427784 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5khhw\"" Jul 14 11:38:51.428211 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.427841 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 14 11:38:51.428211 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.428049 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 14 11:38:51.434158 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.434134 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9fhh5"] Jul 14 11:38:51.519398 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.519366 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-9hz66"] Jul 14 11:38:51.521149 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.521134 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-9hz66" Jul 14 11:38:51.522729 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.522698 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/33570f3c-7195-4140-abde-620064e6a076-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9fhh5\" (UID: \"33570f3c-7195-4140-abde-620064e6a076\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9fhh5" Jul 14 11:38:51.522858 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.522751 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4j6x\" (UniqueName: \"kubernetes.io/projected/33570f3c-7195-4140-abde-620064e6a076-kube-api-access-b4j6x\") pod \"cluster-monitoring-operator-5f7f494dd4-9fhh5\" (UID: \"33570f3c-7195-4140-abde-620064e6a076\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9fhh5" Jul 14 11:38:51.522924 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.522878 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/33570f3c-7195-4140-abde-620064e6a076-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-9fhh5\" (UID: \"33570f3c-7195-4140-abde-620064e6a076\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9fhh5" Jul 14 11:38:51.523608 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.523588 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 14 11:38:51.523869 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.523854 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 14 11:38:51.523952 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.523886 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-85gvc\"" Jul 14 11:38:51.523952 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.523920 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 14 11:38:51.524072 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.524053 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 14 11:38:51.532545 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.532522 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 14 11:38:51.537161 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.537139 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-9hz66"] Jul 14 11:38:51.621209 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.621175 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcr6z"] Jul 14 11:38:51.623080 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.623063 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcr6z" Jul 14 11:38:51.623411 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.623382 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4j6x\" (UniqueName: \"kubernetes.io/projected/33570f3c-7195-4140-abde-620064e6a076-kube-api-access-b4j6x\") pod \"cluster-monitoring-operator-5f7f494dd4-9fhh5\" (UID: \"33570f3c-7195-4140-abde-620064e6a076\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9fhh5" Jul 14 11:38:51.623518 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.623432 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blnbj\" (UniqueName: \"kubernetes.io/projected/865b8f11-fdb0-430a-93c5-aa4901f6cf08-kube-api-access-blnbj\") pod \"insights-operator-68d9dd94cf-9hz66\" (UID: \"865b8f11-fdb0-430a-93c5-aa4901f6cf08\") " pod="openshift-insights/insights-operator-68d9dd94cf-9hz66" Jul 14 11:38:51.623518 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.623483 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/33570f3c-7195-4140-abde-620064e6a076-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-9fhh5\" (UID: \"33570f3c-7195-4140-abde-620064e6a076\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9fhh5" Jul 14 11:38:51.623518 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.623500 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/865b8f11-fdb0-430a-93c5-aa4901f6cf08-serving-cert\") pod \"insights-operator-68d9dd94cf-9hz66\" (UID: \"865b8f11-fdb0-430a-93c5-aa4901f6cf08\") " pod="openshift-insights/insights-operator-68d9dd94cf-9hz66" Jul 14 11:38:51.623660 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.623539 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/865b8f11-fdb0-430a-93c5-aa4901f6cf08-tmp\") pod \"insights-operator-68d9dd94cf-9hz66\" (UID: \"865b8f11-fdb0-430a-93c5-aa4901f6cf08\") " pod="openshift-insights/insights-operator-68d9dd94cf-9hz66" Jul 14 11:38:51.623660 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.623588 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/865b8f11-fdb0-430a-93c5-aa4901f6cf08-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-9hz66\" (UID: \"865b8f11-fdb0-430a-93c5-aa4901f6cf08\") " pod="openshift-insights/insights-operator-68d9dd94cf-9hz66" Jul 14 11:38:51.623660 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.623645 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/865b8f11-fdb0-430a-93c5-aa4901f6cf08-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-9hz66\" (UID: \"865b8f11-fdb0-430a-93c5-aa4901f6cf08\") " pod="openshift-insights/insights-operator-68d9dd94cf-9hz66" Jul 14 11:38:51.623771 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.623739 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/33570f3c-7195-4140-abde-620064e6a076-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9fhh5\" (UID: \"33570f3c-7195-4140-abde-620064e6a076\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9fhh5" Jul 14 11:38:51.623771 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.623765 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/865b8f11-fdb0-430a-93c5-aa4901f6cf08-snapshots\") pod \"insights-operator-68d9dd94cf-9hz66\" (UID: \"865b8f11-fdb0-430a-93c5-aa4901f6cf08\") " pod="openshift-insights/insights-operator-68d9dd94cf-9hz66" Jul 14 11:38:51.623855 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:51.623838 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 11:38:51.623943 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:51.623924 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33570f3c-7195-4140-abde-620064e6a076-cluster-monitoring-operator-tls podName:33570f3c-7195-4140-abde-620064e6a076 nodeName:}" failed. No retries permitted until 2026-07-14 11:38:52.123903946 +0000 UTC m=+62.486555247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/33570f3c-7195-4140-abde-620064e6a076-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9fhh5" (UID: "33570f3c-7195-4140-abde-620064e6a076") : secret "cluster-monitoring-operator-tls" not found Jul 14 11:38:51.624362 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.624340 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/33570f3c-7195-4140-abde-620064e6a076-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-9fhh5\" (UID: \"33570f3c-7195-4140-abde-620064e6a076\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9fhh5" Jul 14 11:38:51.627155 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.627118 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 14 11:38:51.627246 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.627230 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 14 11:38:51.627429 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.627413 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jx8tb\"" Jul 14 11:38:51.627565 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.627545 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 14 11:38:51.635676 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.635658 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcr6z"] Jul 14 11:38:51.643572 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.643550 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4j6x\" (UniqueName: \"kubernetes.io/projected/33570f3c-7195-4140-abde-620064e6a076-kube-api-access-b4j6x\") pod \"cluster-monitoring-operator-5f7f494dd4-9fhh5\" (UID: \"33570f3c-7195-4140-abde-620064e6a076\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9fhh5" Jul 14 11:38:51.725043 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.724939 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/865b8f11-fdb0-430a-93c5-aa4901f6cf08-serving-cert\") pod \"insights-operator-68d9dd94cf-9hz66\" (UID: \"865b8f11-fdb0-430a-93c5-aa4901f6cf08\") " pod="openshift-insights/insights-operator-68d9dd94cf-9hz66" Jul 14 11:38:51.725253 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.725114 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/865b8f11-fdb0-430a-93c5-aa4901f6cf08-tmp\") pod \"insights-operator-68d9dd94cf-9hz66\" (UID: \"865b8f11-fdb0-430a-93c5-aa4901f6cf08\") " pod="openshift-insights/insights-operator-68d9dd94cf-9hz66" Jul 14 11:38:51.725253 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.725141 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/865b8f11-fdb0-430a-93c5-aa4901f6cf08-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-9hz66\" (UID: \"865b8f11-fdb0-430a-93c5-aa4901f6cf08\") " pod="openshift-insights/insights-operator-68d9dd94cf-9hz66" Jul 14 11:38:51.725253 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.725167 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/865b8f11-fdb0-430a-93c5-aa4901f6cf08-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-9hz66\" (UID: \"865b8f11-fdb0-430a-93c5-aa4901f6cf08\") " pod="openshift-insights/insights-operator-68d9dd94cf-9hz66" Jul 14 11:38:51.725253 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.725203 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/282a1c0c-a8ec-4135-9054-67d76922aae1-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mcr6z\" (UID: \"282a1c0c-a8ec-4135-9054-67d76922aae1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcr6z" Jul 14 11:38:51.725467 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.725275 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/865b8f11-fdb0-430a-93c5-aa4901f6cf08-snapshots\") pod \"insights-operator-68d9dd94cf-9hz66\" (UID: \"865b8f11-fdb0-430a-93c5-aa4901f6cf08\") " pod="openshift-insights/insights-operator-68d9dd94cf-9hz66" Jul 14 11:38:51.725467 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.725321 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szrx6\" (UniqueName: \"kubernetes.io/projected/282a1c0c-a8ec-4135-9054-67d76922aae1-kube-api-access-szrx6\") pod \"cluster-samples-operator-65db858894-mcr6z\" (UID: \"282a1c0c-a8ec-4135-9054-67d76922aae1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcr6z" Jul 14 11:38:51.725467 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.725352 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blnbj\" (UniqueName: \"kubernetes.io/projected/865b8f11-fdb0-430a-93c5-aa4901f6cf08-kube-api-access-blnbj\") pod \"insights-operator-68d9dd94cf-9hz66\" (UID: \"865b8f11-fdb0-430a-93c5-aa4901f6cf08\") " pod="openshift-insights/insights-operator-68d9dd94cf-9hz66" Jul 14 11:38:51.725597 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.725512 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/865b8f11-fdb0-430a-93c5-aa4901f6cf08-tmp\") pod \"insights-operator-68d9dd94cf-9hz66\" (UID: \"865b8f11-fdb0-430a-93c5-aa4901f6cf08\") " pod="openshift-insights/insights-operator-68d9dd94cf-9hz66" Jul 14 11:38:51.725788 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.725764 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/865b8f11-fdb0-430a-93c5-aa4901f6cf08-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-9hz66\" (UID: \"865b8f11-fdb0-430a-93c5-aa4901f6cf08\") " pod="openshift-insights/insights-operator-68d9dd94cf-9hz66" Jul 14 11:38:51.725850 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.725836 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/865b8f11-fdb0-430a-93c5-aa4901f6cf08-snapshots\") pod \"insights-operator-68d9dd94cf-9hz66\" (UID: \"865b8f11-fdb0-430a-93c5-aa4901f6cf08\") " pod="openshift-insights/insights-operator-68d9dd94cf-9hz66" Jul 14 11:38:51.726073 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.726056 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/865b8f11-fdb0-430a-93c5-aa4901f6cf08-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-9hz66\" (UID: \"865b8f11-fdb0-430a-93c5-aa4901f6cf08\") " pod="openshift-insights/insights-operator-68d9dd94cf-9hz66" Jul 14 11:38:51.727197 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.727180 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/865b8f11-fdb0-430a-93c5-aa4901f6cf08-serving-cert\") pod \"insights-operator-68d9dd94cf-9hz66\" (UID: \"865b8f11-fdb0-430a-93c5-aa4901f6cf08\") " pod="openshift-insights/insights-operator-68d9dd94cf-9hz66" Jul 14 11:38:51.734666 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.734646 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blnbj\" (UniqueName: \"kubernetes.io/projected/865b8f11-fdb0-430a-93c5-aa4901f6cf08-kube-api-access-blnbj\") pod \"insights-operator-68d9dd94cf-9hz66\" (UID: \"865b8f11-fdb0-430a-93c5-aa4901f6cf08\") " pod="openshift-insights/insights-operator-68d9dd94cf-9hz66" Jul 14 11:38:51.826189 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.826147 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/282a1c0c-a8ec-4135-9054-67d76922aae1-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mcr6z\" (UID: \"282a1c0c-a8ec-4135-9054-67d76922aae1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcr6z" Jul 14 11:38:51.826351 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.826230 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szrx6\" (UniqueName: \"kubernetes.io/projected/282a1c0c-a8ec-4135-9054-67d76922aae1-kube-api-access-szrx6\") pod \"cluster-samples-operator-65db858894-mcr6z\" (UID: \"282a1c0c-a8ec-4135-9054-67d76922aae1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcr6z" Jul 14 11:38:51.826351 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:51.826298 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 11:38:51.826421 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:51.826378 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/282a1c0c-a8ec-4135-9054-67d76922aae1-samples-operator-tls podName:282a1c0c-a8ec-4135-9054-67d76922aae1 nodeName:}" failed. No retries permitted until 2026-07-14 11:38:52.326360979 +0000 UTC m=+62.689012277 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/282a1c0c-a8ec-4135-9054-67d76922aae1-samples-operator-tls") pod "cluster-samples-operator-65db858894-mcr6z" (UID: "282a1c0c-a8ec-4135-9054-67d76922aae1") : secret "samples-operator-tls" not found Jul 14 11:38:51.832142 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.832116 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-9hz66" Jul 14 11:38:51.837904 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.837878 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szrx6\" (UniqueName: \"kubernetes.io/projected/282a1c0c-a8ec-4135-9054-67d76922aae1-kube-api-access-szrx6\") pod \"cluster-samples-operator-65db858894-mcr6z\" (UID: \"282a1c0c-a8ec-4135-9054-67d76922aae1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcr6z" Jul 14 11:38:51.959556 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:51.959516 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-9hz66"] Jul 14 11:38:51.963258 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:38:51.963228 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod865b8f11_fdb0_430a_93c5_aa4901f6cf08.slice/crio-a34cfd7ad7faf624ee246288804c357c42b1f36c31262b37b908f9b8ba8f1df4 WatchSource:0}: Error finding container a34cfd7ad7faf624ee246288804c357c42b1f36c31262b37b908f9b8ba8f1df4: Status 404 returned error can't find the container with id a34cfd7ad7faf624ee246288804c357c42b1f36c31262b37b908f9b8ba8f1df4 Jul 14 11:38:52.128794 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:52.128709 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/33570f3c-7195-4140-abde-620064e6a076-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9fhh5\" (UID: \"33570f3c-7195-4140-abde-620064e6a076\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9fhh5" Jul 14 11:38:52.128939 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:52.128832 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 11:38:52.128973 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:52.128950 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33570f3c-7195-4140-abde-620064e6a076-cluster-monitoring-operator-tls podName:33570f3c-7195-4140-abde-620064e6a076 nodeName:}" failed. No retries permitted until 2026-07-14 11:38:53.128870526 +0000 UTC m=+63.491521821 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/33570f3c-7195-4140-abde-620064e6a076-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9fhh5" (UID: "33570f3c-7195-4140-abde-620064e6a076") : secret "cluster-monitoring-operator-tls" not found Jul 14 11:38:52.330669 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:52.330626 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/282a1c0c-a8ec-4135-9054-67d76922aae1-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mcr6z\" (UID: \"282a1c0c-a8ec-4135-9054-67d76922aae1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcr6z" Jul 14 11:38:52.330843 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:52.330764 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 11:38:52.330843 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:52.330841 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/282a1c0c-a8ec-4135-9054-67d76922aae1-samples-operator-tls podName:282a1c0c-a8ec-4135-9054-67d76922aae1 nodeName:}" failed. No retries permitted until 2026-07-14 11:38:53.330824055 +0000 UTC m=+63.693475337 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/282a1c0c-a8ec-4135-9054-67d76922aae1-samples-operator-tls") pod "cluster-samples-operator-65db858894-mcr6z" (UID: "282a1c0c-a8ec-4135-9054-67d76922aae1") : secret "samples-operator-tls" not found Jul 14 11:38:52.569692 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:52.569655 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-9hz66" event={"ID":"865b8f11-fdb0-430a-93c5-aa4901f6cf08","Type":"ContainerStarted","Data":"a34cfd7ad7faf624ee246288804c357c42b1f36c31262b37b908f9b8ba8f1df4"} Jul 14 11:38:53.136001 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:53.135962 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/33570f3c-7195-4140-abde-620064e6a076-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9fhh5\" (UID: \"33570f3c-7195-4140-abde-620064e6a076\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9fhh5" Jul 14 11:38:53.136285 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:53.136125 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 11:38:53.136285 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:53.136212 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33570f3c-7195-4140-abde-620064e6a076-cluster-monitoring-operator-tls podName:33570f3c-7195-4140-abde-620064e6a076 nodeName:}" failed. No retries permitted until 2026-07-14 11:38:55.136193328 +0000 UTC m=+65.498844609 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/33570f3c-7195-4140-abde-620064e6a076-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9fhh5" (UID: "33570f3c-7195-4140-abde-620064e6a076") : secret "cluster-monitoring-operator-tls" not found Jul 14 11:38:53.337320 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:53.337282 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/282a1c0c-a8ec-4135-9054-67d76922aae1-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mcr6z\" (UID: \"282a1c0c-a8ec-4135-9054-67d76922aae1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcr6z" Jul 14 11:38:53.337513 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:53.337453 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 11:38:53.337580 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:53.337553 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/282a1c0c-a8ec-4135-9054-67d76922aae1-samples-operator-tls podName:282a1c0c-a8ec-4135-9054-67d76922aae1 nodeName:}" failed. No retries permitted until 2026-07-14 11:38:55.337530015 +0000 UTC m=+65.700181315 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/282a1c0c-a8ec-4135-9054-67d76922aae1-samples-operator-tls") pod "cluster-samples-operator-65db858894-mcr6z" (UID: "282a1c0c-a8ec-4135-9054-67d76922aae1") : secret "samples-operator-tls" not found Jul 14 11:38:54.391566 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:54.391531 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vlcxr"] Jul 14 11:38:54.393410 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:54.393395 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vlcxr" Jul 14 11:38:54.396368 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:54.396338 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 14 11:38:54.396497 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:54.396338 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 14 11:38:54.396497 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:54.396343 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 14 11:38:54.397522 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:54.397504 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 14 11:38:54.397609 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:54.397505 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-lm6dc\"" Jul 14 11:38:54.404470 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:54.404449 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vlcxr"] Jul 14 11:38:54.448005 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:54.447973 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nglwc\" (UniqueName: \"kubernetes.io/projected/9e885a07-b134-4b34-a639-b2f8fdcd7547-kube-api-access-nglwc\") pod \"service-ca-operator-7695fc6c8c-vlcxr\" (UID: \"9e885a07-b134-4b34-a639-b2f8fdcd7547\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vlcxr" Jul 14 11:38:54.448198 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:54.448016 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e885a07-b134-4b34-a639-b2f8fdcd7547-serving-cert\") pod \"service-ca-operator-7695fc6c8c-vlcxr\" (UID: \"9e885a07-b134-4b34-a639-b2f8fdcd7547\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vlcxr" Jul 14 11:38:54.448198 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:54.448037 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e885a07-b134-4b34-a639-b2f8fdcd7547-config\") pod \"service-ca-operator-7695fc6c8c-vlcxr\" (UID: \"9e885a07-b134-4b34-a639-b2f8fdcd7547\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vlcxr" Jul 14 11:38:54.549176 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:54.549135 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e885a07-b134-4b34-a639-b2f8fdcd7547-serving-cert\") pod \"service-ca-operator-7695fc6c8c-vlcxr\" (UID: \"9e885a07-b134-4b34-a639-b2f8fdcd7547\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vlcxr" Jul 14 11:38:54.549176 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:54.549178 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e885a07-b134-4b34-a639-b2f8fdcd7547-config\") pod \"service-ca-operator-7695fc6c8c-vlcxr\" (UID: \"9e885a07-b134-4b34-a639-b2f8fdcd7547\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vlcxr" Jul 14 11:38:54.549413 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:54.549270 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nglwc\" (UniqueName: \"kubernetes.io/projected/9e885a07-b134-4b34-a639-b2f8fdcd7547-kube-api-access-nglwc\") pod \"service-ca-operator-7695fc6c8c-vlcxr\" (UID: \"9e885a07-b134-4b34-a639-b2f8fdcd7547\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vlcxr" Jul 14 11:38:54.549904 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:54.549878 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e885a07-b134-4b34-a639-b2f8fdcd7547-config\") pod \"service-ca-operator-7695fc6c8c-vlcxr\" (UID: \"9e885a07-b134-4b34-a639-b2f8fdcd7547\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vlcxr" Jul 14 11:38:54.551531 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:54.551498 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e885a07-b134-4b34-a639-b2f8fdcd7547-serving-cert\") pod \"service-ca-operator-7695fc6c8c-vlcxr\" (UID: \"9e885a07-b134-4b34-a639-b2f8fdcd7547\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vlcxr" Jul 14 11:38:54.565888 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:54.565856 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nglwc\" (UniqueName: \"kubernetes.io/projected/9e885a07-b134-4b34-a639-b2f8fdcd7547-kube-api-access-nglwc\") pod \"service-ca-operator-7695fc6c8c-vlcxr\" (UID: \"9e885a07-b134-4b34-a639-b2f8fdcd7547\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vlcxr" Jul 14 11:38:54.577405 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:54.577372 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-9hz66" event={"ID":"865b8f11-fdb0-430a-93c5-aa4901f6cf08","Type":"ContainerStarted","Data":"d18e39a9f2bd6b88749b145cc392b62ddf69362a9a7fc5b5950668846baf4b27"} Jul 14 11:38:54.615984 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:54.615921 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-9hz66" podStartSLOduration=1.898535742 podStartE2EDuration="3.615905928s" totalImagesPullingTime="1.717370186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:38:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:38:54.615382454 +0000 UTC m=+64.978033757" watchObservedRunningTime="2026-07-14 11:38:54.615905928 +0000 UTC m=+64.978557281" Jul 14 11:38:54.703046 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:54.703013 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vlcxr" Jul 14 11:38:54.853751 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:54.853717 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vlcxr"] Jul 14 11:38:54.856661 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:38:54.856634 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e885a07_b134_4b34_a639_b2f8fdcd7547.slice/crio-32d898f6005ff7ce7570000b0a467a0b795d1e8e12784874a2668271d39a9e0c WatchSource:0}: Error finding container 32d898f6005ff7ce7570000b0a467a0b795d1e8e12784874a2668271d39a9e0c: Status 404 returned error can't find the container with id 32d898f6005ff7ce7570000b0a467a0b795d1e8e12784874a2668271d39a9e0c Jul 14 11:38:55.154058 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:55.153954 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/33570f3c-7195-4140-abde-620064e6a076-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9fhh5\" (UID: \"33570f3c-7195-4140-abde-620064e6a076\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9fhh5" Jul 14 11:38:55.154252 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:55.154146 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 11:38:55.154252 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:55.154225 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33570f3c-7195-4140-abde-620064e6a076-cluster-monitoring-operator-tls podName:33570f3c-7195-4140-abde-620064e6a076 nodeName:}" failed. No retries permitted until 2026-07-14 11:38:59.154203398 +0000 UTC m=+69.516854694 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/33570f3c-7195-4140-abde-620064e6a076-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9fhh5" (UID: "33570f3c-7195-4140-abde-620064e6a076") : secret "cluster-monitoring-operator-tls" not found Jul 14 11:38:55.356258 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:55.356225 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/282a1c0c-a8ec-4135-9054-67d76922aae1-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mcr6z\" (UID: \"282a1c0c-a8ec-4135-9054-67d76922aae1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcr6z" Jul 14 11:38:55.356415 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:55.356356 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 11:38:55.356475 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:55.356423 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/282a1c0c-a8ec-4135-9054-67d76922aae1-samples-operator-tls podName:282a1c0c-a8ec-4135-9054-67d76922aae1 nodeName:}" failed. No retries permitted until 2026-07-14 11:38:59.356406096 +0000 UTC m=+69.719057392 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/282a1c0c-a8ec-4135-9054-67d76922aae1-samples-operator-tls") pod "cluster-samples-operator-65db858894-mcr6z" (UID: "282a1c0c-a8ec-4135-9054-67d76922aae1") : secret "samples-operator-tls" not found Jul 14 11:38:55.581753 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:55.581694 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vlcxr" event={"ID":"9e885a07-b134-4b34-a639-b2f8fdcd7547","Type":"ContainerStarted","Data":"32d898f6005ff7ce7570000b0a467a0b795d1e8e12784874a2668271d39a9e0c"} Jul 14 11:38:55.860965 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:55.860876 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqft8\" (UniqueName: \"kubernetes.io/projected/fa03e907-e470-4ad5-b38e-06f4662d3ec0-kube-api-access-nqft8\") pod \"network-check-target-glc7q\" (UID: \"fa03e907-e470-4ad5-b38e-06f4662d3ec0\") " pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:38:55.864349 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:55.864322 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 11:38:55.875430 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:55.875400 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 11:38:55.885124 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:55.885084 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqft8\" (UniqueName: \"kubernetes.io/projected/fa03e907-e470-4ad5-b38e-06f4662d3ec0-kube-api-access-nqft8\") pod \"network-check-target-glc7q\" (UID: \"fa03e907-e470-4ad5-b38e-06f4662d3ec0\") " pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:38:55.901401 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:55.901365 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9256t\"" Jul 14 11:38:55.908834 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:55.908798 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:38:55.961515 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:55.961473 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d1625cf-fd45-4ff6-9571-9220ac046239-metrics-certs\") pod \"network-metrics-daemon-gphmx\" (UID: \"2d1625cf-fd45-4ff6-9571-9220ac046239\") " pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:38:55.961681 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:55.961581 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-original-pull-secret\") pod \"global-pull-secret-syncer-tzr85\" (UID: \"58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed\") " pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:38:55.964526 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:55.964493 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 11:38:55.964633 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:55.964527 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 11:38:55.971984 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:55.971958 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 14 11:38:55.972118 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:55.972033 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d1625cf-fd45-4ff6-9571-9220ac046239-metrics-certs podName:2d1625cf-fd45-4ff6-9571-9220ac046239 nodeName:}" failed. No retries permitted until 2026-07-14 11:39:59.972012653 +0000 UTC m=+130.334663948 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d1625cf-fd45-4ff6-9571-9220ac046239-metrics-certs") pod "network-metrics-daemon-gphmx" (UID: "2d1625cf-fd45-4ff6-9571-9220ac046239") : secret "metrics-daemon-secret" not found Jul 14 11:38:55.974134 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:55.974107 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed-original-pull-secret\") pod \"global-pull-secret-syncer-tzr85\" (UID: \"58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed\") " pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:38:56.065251 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:56.065213 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-glc7q"] Jul 14 11:38:56.068681 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:38:56.068637 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa03e907_e470_4ad5_b38e_06f4662d3ec0.slice/crio-35baec351cca7cb1fed09f7e105ff9dfb1a1f13559f7042d197a3b88b81ac1ad WatchSource:0}: Error finding container 35baec351cca7cb1fed09f7e105ff9dfb1a1f13559f7042d197a3b88b81ac1ad: Status 404 returned error can't find the container with id 35baec351cca7cb1fed09f7e105ff9dfb1a1f13559f7042d197a3b88b81ac1ad Jul 14 11:38:56.200938 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:56.200907 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dwps6"] Jul 14 11:38:56.203931 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:56.203908 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tzr85" Jul 14 11:38:56.226696 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:56.226667 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dwps6"] Jul 14 11:38:56.226842 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:56.226782 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dwps6" Jul 14 11:38:56.230196 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:56.230169 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 14 11:38:56.230196 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:56.230197 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mf86b\"" Jul 14 11:38:56.230373 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:56.230171 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 14 11:38:56.263875 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:56.263834 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dwps6\" (UID: \"405ed3ed-1f94-4ce6-8bb4-73432f5aace9\") " pod="openshift-insights/insights-runtime-extractor-dwps6" Jul 14 11:38:56.264110 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:56.263916 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-data-volume\") pod \"insights-runtime-extractor-dwps6\" (UID: \"405ed3ed-1f94-4ce6-8bb4-73432f5aace9\") " pod="openshift-insights/insights-runtime-extractor-dwps6" Jul 14 11:38:56.264110 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:56.263956 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwps6\" (UID: \"405ed3ed-1f94-4ce6-8bb4-73432f5aace9\") " pod="openshift-insights/insights-runtime-extractor-dwps6" Jul 14 11:38:56.264110 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:56.264001 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-crio-socket\") pod \"insights-runtime-extractor-dwps6\" (UID: \"405ed3ed-1f94-4ce6-8bb4-73432f5aace9\") " pod="openshift-insights/insights-runtime-extractor-dwps6" Jul 14 11:38:56.264110 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:56.264066 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp8vg\" (UniqueName: \"kubernetes.io/projected/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-kube-api-access-xp8vg\") pod \"insights-runtime-extractor-dwps6\" (UID: \"405ed3ed-1f94-4ce6-8bb4-73432f5aace9\") " pod="openshift-insights/insights-runtime-extractor-dwps6" Jul 14 11:38:56.364697 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:56.364662 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwps6\" (UID: \"405ed3ed-1f94-4ce6-8bb4-73432f5aace9\") " pod="openshift-insights/insights-runtime-extractor-dwps6" Jul 14 11:38:56.364859 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:56.364717 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-crio-socket\") pod \"insights-runtime-extractor-dwps6\" (UID: \"405ed3ed-1f94-4ce6-8bb4-73432f5aace9\") " pod="openshift-insights/insights-runtime-extractor-dwps6" Jul 14 11:38:56.364859 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:56.364800 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-crio-socket\") pod \"insights-runtime-extractor-dwps6\" (UID: \"405ed3ed-1f94-4ce6-8bb4-73432f5aace9\") " pod="openshift-insights/insights-runtime-extractor-dwps6" Jul 14 11:38:56.364859 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:56.364834 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 11:38:56.364982 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:56.364899 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-insights-runtime-extractor-tls podName:405ed3ed-1f94-4ce6-8bb4-73432f5aace9 nodeName:}" failed. No retries permitted until 2026-07-14 11:38:56.864879989 +0000 UTC m=+67.227531271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dwps6" (UID: "405ed3ed-1f94-4ce6-8bb4-73432f5aace9") : secret "insights-runtime-extractor-tls" not found Jul 14 11:38:56.364982 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:56.364935 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp8vg\" (UniqueName: \"kubernetes.io/projected/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-kube-api-access-xp8vg\") pod \"insights-runtime-extractor-dwps6\" (UID: \"405ed3ed-1f94-4ce6-8bb4-73432f5aace9\") " pod="openshift-insights/insights-runtime-extractor-dwps6" Jul 14 11:38:56.365080 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:56.364978 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dwps6\" (UID: \"405ed3ed-1f94-4ce6-8bb4-73432f5aace9\") " pod="openshift-insights/insights-runtime-extractor-dwps6" Jul 14 11:38:56.365080 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:56.365019 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-data-volume\") pod \"insights-runtime-extractor-dwps6\" (UID: \"405ed3ed-1f94-4ce6-8bb4-73432f5aace9\") " pod="openshift-insights/insights-runtime-extractor-dwps6" Jul 14 11:38:56.365195 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:56.365088 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 11:38:56.365195 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:56.365170 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-kube-rbac-proxy-cm podName:405ed3ed-1f94-4ce6-8bb4-73432f5aace9 nodeName:}" failed. No retries permitted until 2026-07-14 11:38:56.865155829 +0000 UTC m=+67.227807111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dwps6" (UID: "405ed3ed-1f94-4ce6-8bb4-73432f5aace9") : configmap "kube-rbac-proxy" not found Jul 14 11:38:56.365337 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:56.365321 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-data-volume\") pod \"insights-runtime-extractor-dwps6\" (UID: \"405ed3ed-1f94-4ce6-8bb4-73432f5aace9\") " pod="openshift-insights/insights-runtime-extractor-dwps6" Jul 14 11:38:56.375994 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:56.375975 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp8vg\" (UniqueName: \"kubernetes.io/projected/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-kube-api-access-xp8vg\") pod \"insights-runtime-extractor-dwps6\" (UID: \"405ed3ed-1f94-4ce6-8bb4-73432f5aace9\") " pod="openshift-insights/insights-runtime-extractor-dwps6" Jul 14 11:38:56.379727 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:56.379707 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tzr85"] Jul 14 11:38:56.382409 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:38:56.382388 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58e8bad1_cbf8_4e99_a3c4_e1ed762ac2ed.slice/crio-98f13cfbf8a632dd44be1d8de03c281cf36e3bb9f3dc46185dce5da92128bb49 WatchSource:0}: Error finding container 98f13cfbf8a632dd44be1d8de03c281cf36e3bb9f3dc46185dce5da92128bb49: Status 404 returned error can't find the container with id 98f13cfbf8a632dd44be1d8de03c281cf36e3bb9f3dc46185dce5da92128bb49 Jul 14 11:38:56.585806 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:56.585715 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-glc7q" event={"ID":"fa03e907-e470-4ad5-b38e-06f4662d3ec0","Type":"ContainerStarted","Data":"35baec351cca7cb1fed09f7e105ff9dfb1a1f13559f7042d197a3b88b81ac1ad"} Jul 14 11:38:56.587172 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:56.587133 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tzr85" event={"ID":"58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed","Type":"ContainerStarted","Data":"98f13cfbf8a632dd44be1d8de03c281cf36e3bb9f3dc46185dce5da92128bb49"} Jul 14 11:38:56.869660 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:56.869548 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dwps6\" (UID: \"405ed3ed-1f94-4ce6-8bb4-73432f5aace9\") " pod="openshift-insights/insights-runtime-extractor-dwps6" Jul 14 11:38:56.869660 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:56.869646 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwps6\" (UID: \"405ed3ed-1f94-4ce6-8bb4-73432f5aace9\") " pod="openshift-insights/insights-runtime-extractor-dwps6" Jul 14 11:38:56.869836 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:56.869678 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d964c90c-a221-44a2-809c-d274d60ceb0c-metrics-tls\") pod \"dns-default-hmwlj\" (UID: \"d964c90c-a221-44a2-809c-d274d60ceb0c\") " pod="openshift-dns/dns-default-hmwlj" Jul 14 11:38:56.869836 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:56.869747 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 11:38:56.869836 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:56.869785 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 11:38:56.869836 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:56.869821 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:38:56.869836 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:56.869831 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-kube-rbac-proxy-cm podName:405ed3ed-1f94-4ce6-8bb4-73432f5aace9 nodeName:}" failed. No retries permitted until 2026-07-14 11:38:57.869808596 +0000 UTC m=+68.232459897 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dwps6" (UID: "405ed3ed-1f94-4ce6-8bb4-73432f5aace9") : configmap "kube-rbac-proxy" not found Jul 14 11:38:56.870052 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:56.869851 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-insights-runtime-extractor-tls podName:405ed3ed-1f94-4ce6-8bb4-73432f5aace9 nodeName:}" failed. No retries permitted until 2026-07-14 11:38:57.869840362 +0000 UTC m=+68.232491654 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dwps6" (UID: "405ed3ed-1f94-4ce6-8bb4-73432f5aace9") : secret "insights-runtime-extractor-tls" not found Jul 14 11:38:56.870052 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:56.869866 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d964c90c-a221-44a2-809c-d274d60ceb0c-metrics-tls podName:d964c90c-a221-44a2-809c-d274d60ceb0c nodeName:}" failed. No retries permitted until 2026-07-14 11:39:28.869857639 +0000 UTC m=+99.232508924 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d964c90c-a221-44a2-809c-d274d60ceb0c-metrics-tls") pod "dns-default-hmwlj" (UID: "d964c90c-a221-44a2-809c-d274d60ceb0c") : secret "dns-default-metrics-tls" not found Jul 14 11:38:57.593261 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:57.593172 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vlcxr" event={"ID":"9e885a07-b134-4b34-a639-b2f8fdcd7547","Type":"ContainerStarted","Data":"0725c68678c8cfa721839f67a8043bbccf22cdf32c30d5994df33d7587d3092f"} Jul 14 11:38:57.646948 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:57.646890 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vlcxr" podStartSLOduration=1.187698855 podStartE2EDuration="3.646866s" totalImagesPullingTime="2.459167145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:38:57.645522116 +0000 UTC m=+68.008173421" watchObservedRunningTime="2026-07-14 11:38:57.646866 +0000 UTC m=+68.009517306" Jul 14 11:38:57.720079 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:57.720045 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kxzcq"] Jul 14 11:38:57.742603 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:57.742427 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kxzcq"] Jul 14 11:38:57.742603 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:57.742529 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kxzcq" Jul 14 11:38:57.745781 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:57.745756 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 14 11:38:57.746068 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:57.745756 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 14 11:38:57.746183 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:57.746088 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-qjnlw\"" Jul 14 11:38:57.777862 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:57.777825 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44kxq\" (UniqueName: \"kubernetes.io/projected/e57d45f0-e629-444a-bdc7-81b770051d10-kube-api-access-44kxq\") pod \"migrator-7f59b54f6c-kxzcq\" (UID: \"e57d45f0-e629-444a-bdc7-81b770051d10\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kxzcq" Jul 14 11:38:57.878586 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:57.878496 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dwps6\" (UID: \"405ed3ed-1f94-4ce6-8bb4-73432f5aace9\") " pod="openshift-insights/insights-runtime-extractor-dwps6" Jul 14 11:38:57.878586 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:57.878568 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44kxq\" (UniqueName: \"kubernetes.io/projected/e57d45f0-e629-444a-bdc7-81b770051d10-kube-api-access-44kxq\") pod \"migrator-7f59b54f6c-kxzcq\" (UID: \"e57d45f0-e629-444a-bdc7-81b770051d10\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kxzcq" Jul 14 11:38:57.878812 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:57.878612 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwps6\" (UID: \"405ed3ed-1f94-4ce6-8bb4-73432f5aace9\") " pod="openshift-insights/insights-runtime-extractor-dwps6" Jul 14 11:38:57.878812 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:57.878635 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 11:38:57.878812 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:57.878713 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-kube-rbac-proxy-cm podName:405ed3ed-1f94-4ce6-8bb4-73432f5aace9 nodeName:}" failed. No retries permitted until 2026-07-14 11:38:59.878691093 +0000 UTC m=+70.241342391 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dwps6" (UID: "405ed3ed-1f94-4ce6-8bb4-73432f5aace9") : configmap "kube-rbac-proxy" not found Jul 14 11:38:57.878812 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:57.878771 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 11:38:57.879005 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:57.878845 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-insights-runtime-extractor-tls podName:405ed3ed-1f94-4ce6-8bb4-73432f5aace9 nodeName:}" failed. No retries permitted until 2026-07-14 11:38:59.878828651 +0000 UTC m=+70.241479949 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dwps6" (UID: "405ed3ed-1f94-4ce6-8bb4-73432f5aace9") : secret "insights-runtime-extractor-tls" not found Jul 14 11:38:57.899795 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:57.899761 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44kxq\" (UniqueName: \"kubernetes.io/projected/e57d45f0-e629-444a-bdc7-81b770051d10-kube-api-access-44kxq\") pod \"migrator-7f59b54f6c-kxzcq\" (UID: \"e57d45f0-e629-444a-bdc7-81b770051d10\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kxzcq" Jul 14 11:38:58.048504 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:58.048454 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-khpgc_3a59961e-8988-4654-a707-2d8eebcfd740/dns-node-resolver/0.log" Jul 14 11:38:58.054894 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:58.054865 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kxzcq" Jul 14 11:38:59.190656 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:59.190609 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/33570f3c-7195-4140-abde-620064e6a076-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9fhh5\" (UID: \"33570f3c-7195-4140-abde-620064e6a076\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9fhh5" Jul 14 11:38:59.191205 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:59.190778 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 11:38:59.191205 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:59.191055 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33570f3c-7195-4140-abde-620064e6a076-cluster-monitoring-operator-tls podName:33570f3c-7195-4140-abde-620064e6a076 nodeName:}" failed. No retries permitted until 2026-07-14 11:39:07.19083847 +0000 UTC m=+77.553489757 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/33570f3c-7195-4140-abde-620064e6a076-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9fhh5" (UID: "33570f3c-7195-4140-abde-620064e6a076") : secret "cluster-monitoring-operator-tls" not found Jul 14 11:38:59.253645 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:59.253621 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-trjql_ea5c34bb-6876-46ea-891f-02cbcf0ba9fe/node-ca/0.log" Jul 14 11:38:59.391837 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:59.391799 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/282a1c0c-a8ec-4135-9054-67d76922aae1-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mcr6z\" (UID: \"282a1c0c-a8ec-4135-9054-67d76922aae1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcr6z" Jul 14 11:38:59.392011 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:59.391957 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 11:38:59.392083 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:59.392036 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/282a1c0c-a8ec-4135-9054-67d76922aae1-samples-operator-tls podName:282a1c0c-a8ec-4135-9054-67d76922aae1 nodeName:}" failed. No retries permitted until 2026-07-14 11:39:07.392015329 +0000 UTC m=+77.754666633 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/282a1c0c-a8ec-4135-9054-67d76922aae1-samples-operator-tls") pod "cluster-samples-operator-65db858894-mcr6z" (UID: "282a1c0c-a8ec-4135-9054-67d76922aae1") : secret "samples-operator-tls" not found Jul 14 11:38:59.416788 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:59.416756 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kxzcq"] Jul 14 11:38:59.601389 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:59.601300 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-glc7q" event={"ID":"fa03e907-e470-4ad5-b38e-06f4662d3ec0","Type":"ContainerStarted","Data":"981f2beeb3a8ccf21f26d6f2fbdec8bb8d58c9335fa9d4df548203110e0364fb"} Jul 14 11:38:59.601552 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:59.601409 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:38:59.652549 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:59.652495 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-glc7q" podStartSLOduration=66.425299915 podStartE2EDuration="1m9.652476016s" totalImagesPullingTime="3.227176101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:37:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:38:59.650710383 +0000 UTC m=+70.013361756" watchObservedRunningTime="2026-07-14 11:38:59.652476016 +0000 UTC m=+70.015127321" Jul 14 11:38:59.868239 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:59.868146 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fvzhp_4ceae2d9-3ec8-41c4-99b6-34be1f78fb82/serve-healthcheck-canary/0.log" Jul 14 11:38:59.896046 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:59.895997 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dwps6\" (UID: \"405ed3ed-1f94-4ce6-8bb4-73432f5aace9\") " pod="openshift-insights/insights-runtime-extractor-dwps6" Jul 14 11:38:59.896245 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:38:59.896079 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwps6\" (UID: \"405ed3ed-1f94-4ce6-8bb4-73432f5aace9\") " pod="openshift-insights/insights-runtime-extractor-dwps6" Jul 14 11:38:59.896245 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:59.896109 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 11:38:59.896245 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:59.896176 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-kube-rbac-proxy-cm podName:405ed3ed-1f94-4ce6-8bb4-73432f5aace9 nodeName:}" failed. No retries permitted until 2026-07-14 11:39:03.896155379 +0000 UTC m=+74.258806680 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dwps6" (UID: "405ed3ed-1f94-4ce6-8bb4-73432f5aace9") : configmap "kube-rbac-proxy" not found Jul 14 11:38:59.896245 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:59.896212 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 11:38:59.896422 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:38:59.896251 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-insights-runtime-extractor-tls podName:405ed3ed-1f94-4ce6-8bb4-73432f5aace9 nodeName:}" failed. No retries permitted until 2026-07-14 11:39:03.896238491 +0000 UTC m=+74.258889773 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dwps6" (UID: "405ed3ed-1f94-4ce6-8bb4-73432f5aace9") : secret "insights-runtime-extractor-tls" not found Jul 14 11:39:00.797759 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:39:00.797727 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode57d45f0_e629_444a_bdc7_81b770051d10.slice/crio-6c6448e1dfc5265fe42ada816732cf7e070849b715258b80b5f752f5a38c6c2a WatchSource:0}: Error finding container 6c6448e1dfc5265fe42ada816732cf7e070849b715258b80b5f752f5a38c6c2a: Status 404 returned error can't find the container with id 6c6448e1dfc5265fe42ada816732cf7e070849b715258b80b5f752f5a38c6c2a Jul 14 11:39:01.608370 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:01.608321 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kxzcq" event={"ID":"e57d45f0-e629-444a-bdc7-81b770051d10","Type":"ContainerStarted","Data":"6c6448e1dfc5265fe42ada816732cf7e070849b715258b80b5f752f5a38c6c2a"} Jul 14 11:39:01.610062 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:01.610026 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tzr85" event={"ID":"58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed","Type":"ContainerStarted","Data":"059a40f33d6551266d814e65dc9ed4f5a8d32d2a67dbc78505b2904532b58118"} Jul 14 11:39:01.638924 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:01.638867 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tzr85" podStartSLOduration=67.190624586 podStartE2EDuration="1m11.638848624s" totalImagesPullingTime="4.448224038s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:37:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:39:01.638204969 +0000 UTC m=+72.000856274" watchObservedRunningTime="2026-07-14 11:39:01.638848624 +0000 UTC m=+72.001499906" Jul 14 11:39:02.615387 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:02.615346 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kxzcq" event={"ID":"e57d45f0-e629-444a-bdc7-81b770051d10","Type":"ContainerStarted","Data":"3720c92e12e6963a9a89b73ab5d316fdd366d43215236bec1b2faccae43b34dd"} Jul 14 11:39:02.615755 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:02.615414 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kxzcq" event={"ID":"e57d45f0-e629-444a-bdc7-81b770051d10","Type":"ContainerStarted","Data":"c07b1e75c83bc23c09b228d17daa7702a09539657138d6f46eb4b2c94f4dd895"} Jul 14 11:39:03.933570 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:03.933520 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dwps6\" (UID: \"405ed3ed-1f94-4ce6-8bb4-73432f5aace9\") " pod="openshift-insights/insights-runtime-extractor-dwps6" Jul 14 11:39:03.933964 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:39:03.933647 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 11:39:03.933964 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:03.933688 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwps6\" (UID: \"405ed3ed-1f94-4ce6-8bb4-73432f5aace9\") " pod="openshift-insights/insights-runtime-extractor-dwps6" Jul 14 11:39:03.933964 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:39:03.933713 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-kube-rbac-proxy-cm podName:405ed3ed-1f94-4ce6-8bb4-73432f5aace9 nodeName:}" failed. No retries permitted until 2026-07-14 11:39:11.933698379 +0000 UTC m=+82.296349661 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dwps6" (UID: "405ed3ed-1f94-4ce6-8bb4-73432f5aace9") : configmap "kube-rbac-proxy" not found Jul 14 11:39:03.933964 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:39:03.933783 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 11:39:03.933964 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:39:03.933828 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-insights-runtime-extractor-tls podName:405ed3ed-1f94-4ce6-8bb4-73432f5aace9 nodeName:}" failed. No retries permitted until 2026-07-14 11:39:11.933816676 +0000 UTC m=+82.296467958 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dwps6" (UID: "405ed3ed-1f94-4ce6-8bb4-73432f5aace9") : secret "insights-runtime-extractor-tls" not found Jul 14 11:39:07.262461 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:07.262412 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/33570f3c-7195-4140-abde-620064e6a076-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9fhh5\" (UID: \"33570f3c-7195-4140-abde-620064e6a076\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9fhh5" Jul 14 11:39:07.262860 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:39:07.262575 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 11:39:07.262860 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:39:07.262649 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33570f3c-7195-4140-abde-620064e6a076-cluster-monitoring-operator-tls podName:33570f3c-7195-4140-abde-620064e6a076 nodeName:}" failed. No retries permitted until 2026-07-14 11:39:23.262630664 +0000 UTC m=+93.625281949 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/33570f3c-7195-4140-abde-620064e6a076-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9fhh5" (UID: "33570f3c-7195-4140-abde-620064e6a076") : secret "cluster-monitoring-operator-tls" not found Jul 14 11:39:07.463391 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:07.463351 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/282a1c0c-a8ec-4135-9054-67d76922aae1-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mcr6z\" (UID: \"282a1c0c-a8ec-4135-9054-67d76922aae1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcr6z" Jul 14 11:39:07.465821 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:07.465784 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/282a1c0c-a8ec-4135-9054-67d76922aae1-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mcr6z\" (UID: \"282a1c0c-a8ec-4135-9054-67d76922aae1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcr6z" Jul 14 11:39:07.532307 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:07.532219 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcr6z" Jul 14 11:39:07.657276 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:07.657222 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-kxzcq" podStartSLOduration=9.368962998 podStartE2EDuration="10.657206238s" totalImagesPullingTime="1.28824324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:39:02.640071137 +0000 UTC m=+73.002722441" watchObservedRunningTime="2026-07-14 11:39:07.657206238 +0000 UTC m=+78.019857549" Jul 14 11:39:07.657967 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:07.657942 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcr6z"] Jul 14 11:39:08.638189 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:08.638153 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcr6z" event={"ID":"282a1c0c-a8ec-4135-9054-67d76922aae1","Type":"ContainerStarted","Data":"95800e75574b1a3ff112cd3155b0f22d0b7fd447defdf2b6a6dcc8ac91a001ea"} Jul 14 11:39:09.642733 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:09.642649 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcr6z" event={"ID":"282a1c0c-a8ec-4135-9054-67d76922aae1","Type":"ContainerStarted","Data":"679537fe690fa601070c5e4c7e0539ac8feaa1800a37a3d044fb7310470c7815"} Jul 14 11:39:09.642733 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:09.642699 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcr6z" event={"ID":"282a1c0c-a8ec-4135-9054-67d76922aae1","Type":"ContainerStarted","Data":"a0fa8e14783e608de47f88475fe677b94fc846ec736b8e71bd2105513b89eaf6"} Jul 14 11:39:12.003170 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:12.003020 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dwps6\" (UID: \"405ed3ed-1f94-4ce6-8bb4-73432f5aace9\") " pod="openshift-insights/insights-runtime-extractor-dwps6" Jul 14 11:39:12.003170 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:12.003083 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwps6\" (UID: \"405ed3ed-1f94-4ce6-8bb4-73432f5aace9\") " pod="openshift-insights/insights-runtime-extractor-dwps6" Jul 14 11:39:12.003616 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:39:12.003184 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 11:39:12.003616 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:39:12.003330 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-insights-runtime-extractor-tls podName:405ed3ed-1f94-4ce6-8bb4-73432f5aace9 nodeName:}" failed. No retries permitted until 2026-07-14 11:39:28.003276784 +0000 UTC m=+98.365928066 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dwps6" (UID: "405ed3ed-1f94-4ce6-8bb4-73432f5aace9") : secret "insights-runtime-extractor-tls" not found Jul 14 11:39:12.003688 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:12.003612 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dwps6\" (UID: \"405ed3ed-1f94-4ce6-8bb4-73432f5aace9\") " pod="openshift-insights/insights-runtime-extractor-dwps6" Jul 14 11:39:23.296770 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:23.296730 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/33570f3c-7195-4140-abde-620064e6a076-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9fhh5\" (UID: \"33570f3c-7195-4140-abde-620064e6a076\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9fhh5" Jul 14 11:39:23.299087 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:23.299065 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/33570f3c-7195-4140-abde-620064e6a076-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9fhh5\" (UID: \"33570f3c-7195-4140-abde-620064e6a076\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9fhh5" Jul 14 11:39:23.530067 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:23.530012 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9fhh5" Jul 14 11:39:23.663663 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:23.663475 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcr6z" podStartSLOduration=31.14933517 podStartE2EDuration="32.663451444s" totalImagesPullingTime="1.514116274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:38:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:39:09.67659742 +0000 UTC m=+80.039248723" watchObservedRunningTime="2026-07-14 11:39:23.663451444 +0000 UTC m=+94.026102741" Jul 14 11:39:23.664137 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:23.664120 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9fhh5"] Jul 14 11:39:23.666938 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:39:23.666910 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33570f3c_7195_4140_abde_620064e6a076.slice/crio-ed6f025e388e0a29099e7bb3cb3ef805f12ec9e02d744720cd1c71e6883e96e2 WatchSource:0}: Error finding container ed6f025e388e0a29099e7bb3cb3ef805f12ec9e02d744720cd1c71e6883e96e2: Status 404 returned error can't find the container with id ed6f025e388e0a29099e7bb3cb3ef805f12ec9e02d744720cd1c71e6883e96e2 Jul 14 11:39:23.683135 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:23.683087 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9fhh5" event={"ID":"33570f3c-7195-4140-abde-620064e6a076","Type":"ContainerStarted","Data":"ed6f025e388e0a29099e7bb3cb3ef805f12ec9e02d744720cd1c71e6883e96e2"} Jul 14 11:39:25.691689 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:25.691648 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9fhh5" event={"ID":"33570f3c-7195-4140-abde-620064e6a076","Type":"ContainerStarted","Data":"21cf32c4799d827e979087367a0a1bffdf50635a154876e7464d649ef404cf3e"} Jul 14 11:39:25.713390 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:25.713335 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9fhh5" podStartSLOduration=32.902545372 podStartE2EDuration="34.713317312s" totalImagesPullingTime="1.81077194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:38:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:39:25.711816771 +0000 UTC m=+96.074468077" watchObservedRunningTime="2026-07-14 11:39:25.713317312 +0000 UTC m=+96.075968616" Jul 14 11:39:28.034009 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:28.033969 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwps6\" (UID: \"405ed3ed-1f94-4ce6-8bb4-73432f5aace9\") " pod="openshift-insights/insights-runtime-extractor-dwps6" Jul 14 11:39:28.036315 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:28.036289 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/405ed3ed-1f94-4ce6-8bb4-73432f5aace9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwps6\" (UID: \"405ed3ed-1f94-4ce6-8bb4-73432f5aace9\") " pod="openshift-insights/insights-runtime-extractor-dwps6" Jul 14 11:39:28.335523 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:28.335425 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dwps6" Jul 14 11:39:28.479492 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:28.479456 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dwps6"] Jul 14 11:39:28.481370 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:39:28.481340 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod405ed3ed_1f94_4ce6_8bb4_73432f5aace9.slice/crio-229006b3921f4eefdfa157a89df11a7a089312fa5109dcb22522608f126ef6c7 WatchSource:0}: Error finding container 229006b3921f4eefdfa157a89df11a7a089312fa5109dcb22522608f126ef6c7: Status 404 returned error can't find the container with id 229006b3921f4eefdfa157a89df11a7a089312fa5109dcb22522608f126ef6c7 Jul 14 11:39:28.701274 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:28.701233 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dwps6" event={"ID":"405ed3ed-1f94-4ce6-8bb4-73432f5aace9","Type":"ContainerStarted","Data":"229006b3921f4eefdfa157a89df11a7a089312fa5109dcb22522608f126ef6c7"} Jul 14 11:39:28.941162 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:28.940771 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d964c90c-a221-44a2-809c-d274d60ceb0c-metrics-tls\") pod \"dns-default-hmwlj\" (UID: \"d964c90c-a221-44a2-809c-d274d60ceb0c\") " pod="openshift-dns/dns-default-hmwlj" Jul 14 11:39:28.944970 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:28.944934 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d964c90c-a221-44a2-809c-d274d60ceb0c-metrics-tls\") pod \"dns-default-hmwlj\" (UID: \"d964c90c-a221-44a2-809c-d274d60ceb0c\") " pod="openshift-dns/dns-default-hmwlj" Jul 14 11:39:29.221004 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:29.220763 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9dtrp\"" Jul 14 11:39:29.229802 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:29.229520 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hmwlj" Jul 14 11:39:29.418637 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:29.418550 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hmwlj"] Jul 14 11:39:29.425202 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:39:29.425166 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd964c90c_a221_44a2_809c_d274d60ceb0c.slice/crio-789dfa3d94585fe1933286a5bc4ba245654df3abb1ff9580f2c028551556f602 WatchSource:0}: Error finding container 789dfa3d94585fe1933286a5bc4ba245654df3abb1ff9580f2c028551556f602: Status 404 returned error can't find the container with id 789dfa3d94585fe1933286a5bc4ba245654df3abb1ff9580f2c028551556f602 Jul 14 11:39:29.705945 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:29.705901 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hmwlj" event={"ID":"d964c90c-a221-44a2-809c-d274d60ceb0c","Type":"ContainerStarted","Data":"789dfa3d94585fe1933286a5bc4ba245654df3abb1ff9580f2c028551556f602"} Jul 14 11:39:30.606673 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:30.606637 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-glc7q" Jul 14 11:39:31.711153 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.711117 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-rz5tl"] Jul 14 11:39:31.731373 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.731339 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b4f664466-pjcwj"] Jul 14 11:39:31.731541 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.731470 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-rz5tl" Jul 14 11:39:31.734507 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.734349 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-9gjmd\"" Jul 14 11:39:31.734507 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.734367 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 14 11:39:31.734507 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.734383 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 14 11:39:31.745373 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.745344 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-rz5tl"] Jul 14 11:39:31.745534 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.745391 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b4f664466-pjcwj"] Jul 14 11:39:31.745534 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.745475 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b4f664466-pjcwj" Jul 14 11:39:31.748698 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.748670 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 14 11:39:31.748859 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.748839 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 14 11:39:31.749460 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.749440 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 14 11:39:31.749575 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.749521 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zdzfm\"" Jul 14 11:39:31.755266 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.755240 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 14 11:39:31.763606 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.763572 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b4f664466-pjcwj"] Jul 14 11:39:31.763858 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:39:31.763830 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-bzbt7 registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-bzbt7 registry-certificates registry-tls trusted-ca]: context canceled" pod="openshift-image-registry/image-registry-6b4f664466-pjcwj" podUID="25133769-0662-4a9c-9cf9-befa22cac176" Jul 14 11:39:31.863502 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.863446 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25133769-0662-4a9c-9cf9-befa22cac176-installation-pull-secrets\") pod \"image-registry-6b4f664466-pjcwj\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " pod="openshift-image-registry/image-registry-6b4f664466-pjcwj" Jul 14 11:39:31.863695 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.863513 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25133769-0662-4a9c-9cf9-befa22cac176-trusted-ca\") pod \"image-registry-6b4f664466-pjcwj\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " pod="openshift-image-registry/image-registry-6b4f664466-pjcwj" Jul 14 11:39:31.863695 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.863614 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25133769-0662-4a9c-9cf9-befa22cac176-ca-trust-extracted\") pod \"image-registry-6b4f664466-pjcwj\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " pod="openshift-image-registry/image-registry-6b4f664466-pjcwj" Jul 14 11:39:31.863695 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.863669 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4fd4\" (UniqueName: \"kubernetes.io/projected/a3187fd3-a613-4c7d-8ded-8945d186d2ac-kube-api-access-b4fd4\") pod \"downloads-68c9cbb497-rz5tl\" (UID: \"a3187fd3-a613-4c7d-8ded-8945d186d2ac\") " pod="openshift-console/downloads-68c9cbb497-rz5tl" Jul 14 11:39:31.863860 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.863776 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25133769-0662-4a9c-9cf9-befa22cac176-registry-certificates\") pod \"image-registry-6b4f664466-pjcwj\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " pod="openshift-image-registry/image-registry-6b4f664466-pjcwj" Jul 14 11:39:31.863860 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.863815 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25133769-0662-4a9c-9cf9-befa22cac176-bound-sa-token\") pod \"image-registry-6b4f664466-pjcwj\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " pod="openshift-image-registry/image-registry-6b4f664466-pjcwj" Jul 14 11:39:31.863860 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.863842 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25133769-0662-4a9c-9cf9-befa22cac176-image-registry-private-configuration\") pod \"image-registry-6b4f664466-pjcwj\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " pod="openshift-image-registry/image-registry-6b4f664466-pjcwj" Jul 14 11:39:31.863973 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.863895 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25133769-0662-4a9c-9cf9-befa22cac176-registry-tls\") pod \"image-registry-6b4f664466-pjcwj\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " pod="openshift-image-registry/image-registry-6b4f664466-pjcwj" Jul 14 11:39:31.864022 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.863967 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzbt7\" (UniqueName: \"kubernetes.io/projected/25133769-0662-4a9c-9cf9-befa22cac176-kube-api-access-bzbt7\") pod \"image-registry-6b4f664466-pjcwj\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " pod="openshift-image-registry/image-registry-6b4f664466-pjcwj" Jul 14 11:39:31.965055 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.964976 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25133769-0662-4a9c-9cf9-befa22cac176-registry-certificates\") pod \"image-registry-6b4f664466-pjcwj\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " pod="openshift-image-registry/image-registry-6b4f664466-pjcwj" Jul 14 11:39:31.965055 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.965008 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25133769-0662-4a9c-9cf9-befa22cac176-bound-sa-token\") pod \"image-registry-6b4f664466-pjcwj\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " pod="openshift-image-registry/image-registry-6b4f664466-pjcwj" Jul 14 11:39:31.965055 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.965039 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25133769-0662-4a9c-9cf9-befa22cac176-image-registry-private-configuration\") pod \"image-registry-6b4f664466-pjcwj\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " pod="openshift-image-registry/image-registry-6b4f664466-pjcwj" Jul 14 11:39:31.965349 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.965072 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25133769-0662-4a9c-9cf9-befa22cac176-registry-tls\") pod \"image-registry-6b4f664466-pjcwj\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " pod="openshift-image-registry/image-registry-6b4f664466-pjcwj" Jul 14 11:39:31.965349 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.965155 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzbt7\" (UniqueName: \"kubernetes.io/projected/25133769-0662-4a9c-9cf9-befa22cac176-kube-api-access-bzbt7\") pod \"image-registry-6b4f664466-pjcwj\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " pod="openshift-image-registry/image-registry-6b4f664466-pjcwj" Jul 14 11:39:31.965349 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.965220 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25133769-0662-4a9c-9cf9-befa22cac176-installation-pull-secrets\") pod \"image-registry-6b4f664466-pjcwj\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " pod="openshift-image-registry/image-registry-6b4f664466-pjcwj" Jul 14 11:39:31.965349 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.965249 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25133769-0662-4a9c-9cf9-befa22cac176-trusted-ca\") pod \"image-registry-6b4f664466-pjcwj\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " pod="openshift-image-registry/image-registry-6b4f664466-pjcwj" Jul 14 11:39:31.965349 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.965285 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25133769-0662-4a9c-9cf9-befa22cac176-ca-trust-extracted\") pod \"image-registry-6b4f664466-pjcwj\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " pod="openshift-image-registry/image-registry-6b4f664466-pjcwj" Jul 14 11:39:31.965349 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.965334 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4fd4\" (UniqueName: \"kubernetes.io/projected/a3187fd3-a613-4c7d-8ded-8945d186d2ac-kube-api-access-b4fd4\") pod \"downloads-68c9cbb497-rz5tl\" (UID: \"a3187fd3-a613-4c7d-8ded-8945d186d2ac\") " pod="openshift-console/downloads-68c9cbb497-rz5tl" Jul 14 11:39:31.965932 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.965906 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25133769-0662-4a9c-9cf9-befa22cac176-ca-trust-extracted\") pod \"image-registry-6b4f664466-pjcwj\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " pod="openshift-image-registry/image-registry-6b4f664466-pjcwj" Jul 14 11:39:31.966053 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.965907 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25133769-0662-4a9c-9cf9-befa22cac176-registry-certificates\") pod \"image-registry-6b4f664466-pjcwj\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " pod="openshift-image-registry/image-registry-6b4f664466-pjcwj" Jul 14 11:39:31.966258 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.966236 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25133769-0662-4a9c-9cf9-befa22cac176-trusted-ca\") pod \"image-registry-6b4f664466-pjcwj\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " pod="openshift-image-registry/image-registry-6b4f664466-pjcwj" Jul 14 11:39:31.968310 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.968285 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25133769-0662-4a9c-9cf9-befa22cac176-installation-pull-secrets\") pod \"image-registry-6b4f664466-pjcwj\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " pod="openshift-image-registry/image-registry-6b4f664466-pjcwj" Jul 14 11:39:31.968437 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.968294 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25133769-0662-4a9c-9cf9-befa22cac176-registry-tls\") pod \"image-registry-6b4f664466-pjcwj\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " pod="openshift-image-registry/image-registry-6b4f664466-pjcwj" Jul 14 11:39:31.968518 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.968497 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25133769-0662-4a9c-9cf9-befa22cac176-image-registry-private-configuration\") pod \"image-registry-6b4f664466-pjcwj\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " pod="openshift-image-registry/image-registry-6b4f664466-pjcwj" Jul 14 11:39:31.979083 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.979055 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25133769-0662-4a9c-9cf9-befa22cac176-bound-sa-token\") pod \"image-registry-6b4f664466-pjcwj\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " pod="openshift-image-registry/image-registry-6b4f664466-pjcwj" Jul 14 11:39:31.979243 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.979207 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4fd4\" (UniqueName: \"kubernetes.io/projected/a3187fd3-a613-4c7d-8ded-8945d186d2ac-kube-api-access-b4fd4\") pod \"downloads-68c9cbb497-rz5tl\" (UID: \"a3187fd3-a613-4c7d-8ded-8945d186d2ac\") " pod="openshift-console/downloads-68c9cbb497-rz5tl" Jul 14 11:39:31.979321 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:31.979300 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzbt7\" (UniqueName: \"kubernetes.io/projected/25133769-0662-4a9c-9cf9-befa22cac176-kube-api-access-bzbt7\") pod \"image-registry-6b4f664466-pjcwj\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " pod="openshift-image-registry/image-registry-6b4f664466-pjcwj" Jul 14 11:39:32.043176 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:32.043120 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-rz5tl" Jul 14 11:39:32.718442 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:32.718414 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b4f664466-pjcwj" Jul 14 11:39:32.780824 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:32.780784 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b4f664466-pjcwj" Jul 14 11:39:32.974984 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:32.974902 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25133769-0662-4a9c-9cf9-befa22cac176-bound-sa-token\") pod \"25133769-0662-4a9c-9cf9-befa22cac176\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " Jul 14 11:39:32.974984 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:32.974954 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25133769-0662-4a9c-9cf9-befa22cac176-registry-tls\") pod \"25133769-0662-4a9c-9cf9-befa22cac176\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " Jul 14 11:39:32.974984 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:32.974977 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25133769-0662-4a9c-9cf9-befa22cac176-installation-pull-secrets\") pod \"25133769-0662-4a9c-9cf9-befa22cac176\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " Jul 14 11:39:32.975260 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:32.975111 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzbt7\" (UniqueName: \"kubernetes.io/projected/25133769-0662-4a9c-9cf9-befa22cac176-kube-api-access-bzbt7\") pod \"25133769-0662-4a9c-9cf9-befa22cac176\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " Jul 14 11:39:32.975260 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:32.975170 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25133769-0662-4a9c-9cf9-befa22cac176-trusted-ca\") pod \"25133769-0662-4a9c-9cf9-befa22cac176\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " Jul 14 11:39:32.975260 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:32.975213 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25133769-0662-4a9c-9cf9-befa22cac176-ca-trust-extracted\") pod \"25133769-0662-4a9c-9cf9-befa22cac176\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " Jul 14 11:39:32.975260 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:32.975257 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25133769-0662-4a9c-9cf9-befa22cac176-registry-certificates\") pod \"25133769-0662-4a9c-9cf9-befa22cac176\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " Jul 14 11:39:32.975458 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:32.975305 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25133769-0662-4a9c-9cf9-befa22cac176-image-registry-private-configuration\") pod \"25133769-0662-4a9c-9cf9-befa22cac176\" (UID: \"25133769-0662-4a9c-9cf9-befa22cac176\") " Jul 14 11:39:32.975534 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:32.975468 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25133769-0662-4a9c-9cf9-befa22cac176-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "25133769-0662-4a9c-9cf9-befa22cac176" (UID: "25133769-0662-4a9c-9cf9-befa22cac176"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:39:32.975780 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:32.975724 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25133769-0662-4a9c-9cf9-befa22cac176-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "25133769-0662-4a9c-9cf9-befa22cac176" (UID: "25133769-0662-4a9c-9cf9-befa22cac176"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:39:32.975895 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:32.975872 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25133769-0662-4a9c-9cf9-befa22cac176-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "25133769-0662-4a9c-9cf9-befa22cac176" (UID: "25133769-0662-4a9c-9cf9-befa22cac176"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:39:32.977431 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:32.977369 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25133769-0662-4a9c-9cf9-befa22cac176-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "25133769-0662-4a9c-9cf9-befa22cac176" (UID: "25133769-0662-4a9c-9cf9-befa22cac176"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:39:32.977431 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:32.977409 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25133769-0662-4a9c-9cf9-befa22cac176-kube-api-access-bzbt7" (OuterVolumeSpecName: "kube-api-access-bzbt7") pod "25133769-0662-4a9c-9cf9-befa22cac176" (UID: "25133769-0662-4a9c-9cf9-befa22cac176"). InnerVolumeSpecName "kube-api-access-bzbt7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:39:32.977560 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:32.977446 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25133769-0662-4a9c-9cf9-befa22cac176-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "25133769-0662-4a9c-9cf9-befa22cac176" (UID: "25133769-0662-4a9c-9cf9-befa22cac176"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:39:32.977560 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:32.977468 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25133769-0662-4a9c-9cf9-befa22cac176-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "25133769-0662-4a9c-9cf9-befa22cac176" (UID: "25133769-0662-4a9c-9cf9-befa22cac176"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:39:32.977798 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:32.977776 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25133769-0662-4a9c-9cf9-befa22cac176-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "25133769-0662-4a9c-9cf9-befa22cac176" (UID: "25133769-0662-4a9c-9cf9-befa22cac176"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:39:33.076517 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:33.076479 2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25133769-0662-4a9c-9cf9-befa22cac176-ca-trust-extracted\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:39:33.076517 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:33.076511 2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25133769-0662-4a9c-9cf9-befa22cac176-registry-certificates\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:39:33.076517 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:33.076527 2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25133769-0662-4a9c-9cf9-befa22cac176-image-registry-private-configuration\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:39:33.076758 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:33.076540 2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25133769-0662-4a9c-9cf9-befa22cac176-bound-sa-token\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:39:33.076758 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:33.076552 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25133769-0662-4a9c-9cf9-befa22cac176-registry-tls\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:39:33.076758 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:33.076562 2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25133769-0662-4a9c-9cf9-befa22cac176-installation-pull-secrets\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:39:33.076758 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:33.076573 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzbt7\" (UniqueName: \"kubernetes.io/projected/25133769-0662-4a9c-9cf9-befa22cac176-kube-api-access-bzbt7\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:39:33.076758 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:33.076584 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25133769-0662-4a9c-9cf9-befa22cac176-trusted-ca\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:39:33.589884 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:33.589725 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-rz5tl"] Jul 14 11:39:33.592275 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:39:33.592244 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3187fd3_a613_4c7d_8ded_8945d186d2ac.slice/crio-ca4901b86f162d8b8a73c8044dcd710288873eafdb997e4d8117ee9273479711 WatchSource:0}: Error finding container ca4901b86f162d8b8a73c8044dcd710288873eafdb997e4d8117ee9273479711: Status 404 returned error can't find the container with id ca4901b86f162d8b8a73c8044dcd710288873eafdb997e4d8117ee9273479711 Jul 14 11:39:33.721901 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:33.721871 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-rz5tl" event={"ID":"a3187fd3-a613-4c7d-8ded-8945d186d2ac","Type":"ContainerStarted","Data":"ca4901b86f162d8b8a73c8044dcd710288873eafdb997e4d8117ee9273479711"} Jul 14 11:39:33.723282 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:33.723265 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b4f664466-pjcwj" Jul 14 11:39:33.723282 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:33.723269 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hmwlj" event={"ID":"d964c90c-a221-44a2-809c-d274d60ceb0c","Type":"ContainerStarted","Data":"674306b72a8f0f745b871a350bf658426ba0e14fec8086d58cb72ec20aef5719"} Jul 14 11:39:33.764651 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:33.764620 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b4f664466-pjcwj"] Jul 14 11:39:33.770388 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:33.770362 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6b4f664466-pjcwj"] Jul 14 11:39:34.291284 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:34.291247 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25133769-0662-4a9c-9cf9-befa22cac176" path="/var/lib/kubelet/pods/25133769-0662-4a9c-9cf9-befa22cac176/volumes" Jul 14 11:39:34.729454 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:34.729412 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dwps6" event={"ID":"405ed3ed-1f94-4ce6-8bb4-73432f5aace9","Type":"ContainerStarted","Data":"99fb66fe656e29fff579262c06e4a43eb67af3c160732dfc604a33785999365c"} Jul 14 11:39:34.731598 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:34.731564 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hmwlj" event={"ID":"d964c90c-a221-44a2-809c-d274d60ceb0c","Type":"ContainerStarted","Data":"c8dc71c044e623f4cdb68a5f8172db17071281fe6e671fcb7496265bd9180f75"} Jul 14 11:39:34.731752 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:34.731697 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hmwlj" Jul 14 11:39:34.753522 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:34.753470 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hmwlj" podStartSLOduration=66.727992164 podStartE2EDuration="1m10.753453737s" totalImagesPullingTime="4.025461573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:38:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:39:34.753284995 +0000 UTC m=+105.115936301" watchObservedRunningTime="2026-07-14 11:39:34.753453737 +0000 UTC m=+105.116105041" Jul 14 11:39:35.737041 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:35.736996 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dwps6" event={"ID":"405ed3ed-1f94-4ce6-8bb4-73432f5aace9","Type":"ContainerStarted","Data":"ec65bd2031dffe36dec220ed2040822427ce56d78474f1d70ec6f8a1e997a569"} Jul 14 11:39:36.043628 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:36.043539 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-chck7"] Jul 14 11:39:36.045988 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:36.045958 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-chck7" Jul 14 11:39:36.049004 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:36.048976 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 14 11:39:36.050471 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:36.050205 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 14 11:39:36.050471 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:36.050232 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 14 11:39:36.050471 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:36.050232 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-rkcxq\"" Jul 14 11:39:36.058230 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:36.058141 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-chck7"] Jul 14 11:39:36.098850 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:36.098778 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d297dcf-8d92-45c0-9976-b2a65c64eef9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-chck7\" (UID: \"5d297dcf-8d92-45c0-9976-b2a65c64eef9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-chck7" Jul 14 11:39:36.098850 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:36.098830 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d297dcf-8d92-45c0-9976-b2a65c64eef9-metrics-client-ca\") pod \"prometheus-operator-64785b6675-chck7\" (UID: \"5d297dcf-8d92-45c0-9976-b2a65c64eef9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-chck7" Jul 14 11:39:36.099132 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:36.098866 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgb4k\" (UniqueName: \"kubernetes.io/projected/5d297dcf-8d92-45c0-9976-b2a65c64eef9-kube-api-access-cgb4k\") pod \"prometheus-operator-64785b6675-chck7\" (UID: \"5d297dcf-8d92-45c0-9976-b2a65c64eef9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-chck7" Jul 14 11:39:36.099132 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:36.098938 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d297dcf-8d92-45c0-9976-b2a65c64eef9-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-chck7\" (UID: \"5d297dcf-8d92-45c0-9976-b2a65c64eef9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-chck7" Jul 14 11:39:36.199452 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:36.199405 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d297dcf-8d92-45c0-9976-b2a65c64eef9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-chck7\" (UID: \"5d297dcf-8d92-45c0-9976-b2a65c64eef9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-chck7" Jul 14 11:39:36.199452 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:36.199454 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d297dcf-8d92-45c0-9976-b2a65c64eef9-metrics-client-ca\") pod \"prometheus-operator-64785b6675-chck7\" (UID: \"5d297dcf-8d92-45c0-9976-b2a65c64eef9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-chck7" Jul 14 11:39:36.199694 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:36.199663 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgb4k\" (UniqueName: \"kubernetes.io/projected/5d297dcf-8d92-45c0-9976-b2a65c64eef9-kube-api-access-cgb4k\") pod \"prometheus-operator-64785b6675-chck7\" (UID: \"5d297dcf-8d92-45c0-9976-b2a65c64eef9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-chck7" Jul 14 11:39:36.199774 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:36.199755 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d297dcf-8d92-45c0-9976-b2a65c64eef9-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-chck7\" (UID: \"5d297dcf-8d92-45c0-9976-b2a65c64eef9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-chck7" Jul 14 11:39:36.199907 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:39:36.199890 2582 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 14 11:39:36.199993 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:39:36.199965 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d297dcf-8d92-45c0-9976-b2a65c64eef9-prometheus-operator-tls podName:5d297dcf-8d92-45c0-9976-b2a65c64eef9 nodeName:}" failed. No retries permitted until 2026-07-14 11:39:36.699944027 +0000 UTC m=+107.062595317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/5d297dcf-8d92-45c0-9976-b2a65c64eef9-prometheus-operator-tls") pod "prometheus-operator-64785b6675-chck7" (UID: "5d297dcf-8d92-45c0-9976-b2a65c64eef9") : secret "prometheus-operator-tls" not found Jul 14 11:39:36.200294 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:36.200247 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d297dcf-8d92-45c0-9976-b2a65c64eef9-metrics-client-ca\") pod \"prometheus-operator-64785b6675-chck7\" (UID: \"5d297dcf-8d92-45c0-9976-b2a65c64eef9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-chck7" Jul 14 11:39:36.202458 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:36.202410 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d297dcf-8d92-45c0-9976-b2a65c64eef9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-chck7\" (UID: \"5d297dcf-8d92-45c0-9976-b2a65c64eef9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-chck7" Jul 14 11:39:36.210297 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:36.210238 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgb4k\" (UniqueName: \"kubernetes.io/projected/5d297dcf-8d92-45c0-9976-b2a65c64eef9-kube-api-access-cgb4k\") pod \"prometheus-operator-64785b6675-chck7\" (UID: \"5d297dcf-8d92-45c0-9976-b2a65c64eef9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-chck7" Jul 14 11:39:36.702718 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:36.702679 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d297dcf-8d92-45c0-9976-b2a65c64eef9-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-chck7\" (UID: \"5d297dcf-8d92-45c0-9976-b2a65c64eef9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-chck7" Jul 14 11:39:36.705634 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:36.705575 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d297dcf-8d92-45c0-9976-b2a65c64eef9-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-chck7\" (UID: \"5d297dcf-8d92-45c0-9976-b2a65c64eef9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-chck7" Jul 14 11:39:36.958269 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:36.958191 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-chck7" Jul 14 11:39:38.051651 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:38.051513 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-chck7"] Jul 14 11:39:38.054454 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:39:38.054420 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d297dcf_8d92_45c0_9976_b2a65c64eef9.slice/crio-4b1582e0d8f50ad47df8531c1d427feddb0ce0c772ad00ed40ef4c15f1162b00 WatchSource:0}: Error finding container 4b1582e0d8f50ad47df8531c1d427feddb0ce0c772ad00ed40ef4c15f1162b00: Status 404 returned error can't find the container with id 4b1582e0d8f50ad47df8531c1d427feddb0ce0c772ad00ed40ef4c15f1162b00 Jul 14 11:39:38.750016 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:38.749975 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-chck7" event={"ID":"5d297dcf-8d92-45c0-9976-b2a65c64eef9","Type":"ContainerStarted","Data":"4b1582e0d8f50ad47df8531c1d427feddb0ce0c772ad00ed40ef4c15f1162b00"} Jul 14 11:39:38.752674 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:38.752640 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dwps6" event={"ID":"405ed3ed-1f94-4ce6-8bb4-73432f5aace9","Type":"ContainerStarted","Data":"5731c79bd8e297cc362b9ae346330c7e81150773aa29e266232d99f9550b9eea"} Jul 14 11:39:38.777972 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:38.777908 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dwps6" podStartSLOduration=33.609338128 podStartE2EDuration="42.777885862s" totalImagesPullingTime="9.168547734s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:38:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:39:38.775881686 +0000 UTC m=+109.138532992" watchObservedRunningTime="2026-07-14 11:39:38.777885862 +0000 UTC m=+109.140537167" Jul 14 11:39:39.759120 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:39.759065 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-chck7" event={"ID":"5d297dcf-8d92-45c0-9976-b2a65c64eef9","Type":"ContainerStarted","Data":"9ee79542c6de2035ae9d68bf3ac79b3222bdd720074525c917b431e43c974485"} Jul 14 11:39:39.759584 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:39.759152 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-chck7" event={"ID":"5d297dcf-8d92-45c0-9976-b2a65c64eef9","Type":"ContainerStarted","Data":"93a0bc9c7997a78782e7e6bdb3ecee877d8f258684b57c8b8d328e7e041d3a48"} Jul 14 11:39:39.804384 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:39.804325 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-chck7" podStartSLOduration=2.538738891 podStartE2EDuration="3.804303266s" totalImagesPullingTime="1.265564375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:39:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:39:39.802369833 +0000 UTC m=+110.165021139" watchObservedRunningTime="2026-07-14 11:39:39.804303266 +0000 UTC m=+110.166954569" Jul 14 11:39:41.470309 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.470273 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-kw885"] Jul 14 11:39:41.474478 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.474456 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kw885" Jul 14 11:39:41.477311 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.477261 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 14 11:39:41.477311 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.477305 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 14 11:39:41.477485 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.477356 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-92zgt\"" Jul 14 11:39:41.486170 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.486147 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-kw885"] Jul 14 11:39:41.492265 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.492238 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-wnm9k"] Jul 14 11:39:41.494927 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.494906 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-wnm9k" Jul 14 11:39:41.498084 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.498050 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7dntn\"" Jul 14 11:39:41.498225 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.498112 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 14 11:39:41.498776 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.498615 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 14 11:39:41.499240 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.499215 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 14 11:39:41.508183 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.508146 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dcw2c"] Jul 14 11:39:41.510850 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.510825 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-wnm9k"] Jul 14 11:39:41.511129 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.511028 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:41.514269 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.514004 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-h29qj\"" Jul 14 11:39:41.514269 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.514061 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 14 11:39:41.514269 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.514062 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 14 11:39:41.514269 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.514013 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 14 11:39:41.540994 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.540960 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd9c4153-0a48-42d9-af01-94ac9e4757de-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-kw885\" (UID: \"cd9c4153-0a48-42d9-af01-94ac9e4757de\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kw885" Jul 14 11:39:41.540994 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.540998 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4df7bd22-061c-44c2-bb65-63e702106cd9-node-exporter-accelerators-collector-config\") pod \"node-exporter-dcw2c\" (UID: \"4df7bd22-061c-44c2-bb65-63e702106cd9\") " pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:41.541294 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.541027 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4df7bd22-061c-44c2-bb65-63e702106cd9-metrics-client-ca\") pod \"node-exporter-dcw2c\" (UID: \"4df7bd22-061c-44c2-bb65-63e702106cd9\") " pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:41.541294 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.541121 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbf48\" (UniqueName: \"kubernetes.io/projected/cd9c4153-0a48-42d9-af01-94ac9e4757de-kube-api-access-kbf48\") pod \"openshift-state-metrics-84bd68b896-kw885\" (UID: \"cd9c4153-0a48-42d9-af01-94ac9e4757de\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kw885" Jul 14 11:39:41.541294 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.541186 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4df7bd22-061c-44c2-bb65-63e702106cd9-node-exporter-tls\") pod \"node-exporter-dcw2c\" (UID: \"4df7bd22-061c-44c2-bb65-63e702106cd9\") " pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:41.541294 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.541219 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/63e25b04-9c3d-4e02-93ef-0323a6430f1a-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-wnm9k\" (UID: \"63e25b04-9c3d-4e02-93ef-0323a6430f1a\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wnm9k" Jul 14 11:39:41.541294 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.541284 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4df7bd22-061c-44c2-bb65-63e702106cd9-root\") pod \"node-exporter-dcw2c\" (UID: \"4df7bd22-061c-44c2-bb65-63e702106cd9\") " pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:41.541538 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.541310 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4df7bd22-061c-44c2-bb65-63e702106cd9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dcw2c\" (UID: \"4df7bd22-061c-44c2-bb65-63e702106cd9\") " pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:41.541538 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.541358 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4df7bd22-061c-44c2-bb65-63e702106cd9-node-exporter-textfile\") pod \"node-exporter-dcw2c\" (UID: \"4df7bd22-061c-44c2-bb65-63e702106cd9\") " pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:41.541538 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.541418 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd9c4153-0a48-42d9-af01-94ac9e4757de-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-kw885\" (UID: \"cd9c4153-0a48-42d9-af01-94ac9e4757de\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kw885" Jul 14 11:39:41.541538 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.541444 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63e25b04-9c3d-4e02-93ef-0323a6430f1a-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-wnm9k\" (UID: \"63e25b04-9c3d-4e02-93ef-0323a6430f1a\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wnm9k" Jul 14 11:39:41.541538 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.541466 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd9c4153-0a48-42d9-af01-94ac9e4757de-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-kw885\" (UID: \"cd9c4153-0a48-42d9-af01-94ac9e4757de\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kw885" Jul 14 11:39:41.541538 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.541490 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/63e25b04-9c3d-4e02-93ef-0323a6430f1a-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-wnm9k\" (UID: \"63e25b04-9c3d-4e02-93ef-0323a6430f1a\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wnm9k" Jul 14 11:39:41.541538 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.541516 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4df7bd22-061c-44c2-bb65-63e702106cd9-node-exporter-wtmp\") pod \"node-exporter-dcw2c\" (UID: \"4df7bd22-061c-44c2-bb65-63e702106cd9\") " pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:41.541833 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.541544 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97pdk\" (UniqueName: \"kubernetes.io/projected/63e25b04-9c3d-4e02-93ef-0323a6430f1a-kube-api-access-97pdk\") pod \"kube-state-metrics-785778ff74-wnm9k\" (UID: \"63e25b04-9c3d-4e02-93ef-0323a6430f1a\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wnm9k" Jul 14 11:39:41.541833 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.541572 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63e25b04-9c3d-4e02-93ef-0323a6430f1a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-wnm9k\" (UID: \"63e25b04-9c3d-4e02-93ef-0323a6430f1a\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wnm9k" Jul 14 11:39:41.541833 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.541599 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/63e25b04-9c3d-4e02-93ef-0323a6430f1a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-wnm9k\" (UID: \"63e25b04-9c3d-4e02-93ef-0323a6430f1a\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wnm9k" Jul 14 11:39:41.541833 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.541626 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4df7bd22-061c-44c2-bb65-63e702106cd9-sys\") pod \"node-exporter-dcw2c\" (UID: \"4df7bd22-061c-44c2-bb65-63e702106cd9\") " pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:41.541833 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.541651 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpgpn\" (UniqueName: \"kubernetes.io/projected/4df7bd22-061c-44c2-bb65-63e702106cd9-kube-api-access-jpgpn\") pod \"node-exporter-dcw2c\" (UID: \"4df7bd22-061c-44c2-bb65-63e702106cd9\") " pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:41.642897 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.642860 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4df7bd22-061c-44c2-bb65-63e702106cd9-sys\") pod \"node-exporter-dcw2c\" (UID: \"4df7bd22-061c-44c2-bb65-63e702106cd9\") " pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:41.643088 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.642914 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpgpn\" (UniqueName: \"kubernetes.io/projected/4df7bd22-061c-44c2-bb65-63e702106cd9-kube-api-access-jpgpn\") pod \"node-exporter-dcw2c\" (UID: \"4df7bd22-061c-44c2-bb65-63e702106cd9\") " pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:41.643088 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.642946 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd9c4153-0a48-42d9-af01-94ac9e4757de-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-kw885\" (UID: \"cd9c4153-0a48-42d9-af01-94ac9e4757de\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kw885" Jul 14 11:39:41.643088 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.642950 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4df7bd22-061c-44c2-bb65-63e702106cd9-sys\") pod \"node-exporter-dcw2c\" (UID: \"4df7bd22-061c-44c2-bb65-63e702106cd9\") " pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:41.643088 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.642977 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4df7bd22-061c-44c2-bb65-63e702106cd9-node-exporter-accelerators-collector-config\") pod \"node-exporter-dcw2c\" (UID: \"4df7bd22-061c-44c2-bb65-63e702106cd9\") " pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:41.643088 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.643020 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4df7bd22-061c-44c2-bb65-63e702106cd9-metrics-client-ca\") pod \"node-exporter-dcw2c\" (UID: \"4df7bd22-061c-44c2-bb65-63e702106cd9\") " pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:41.643088 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.643052 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbf48\" (UniqueName: \"kubernetes.io/projected/cd9c4153-0a48-42d9-af01-94ac9e4757de-kube-api-access-kbf48\") pod \"openshift-state-metrics-84bd68b896-kw885\" (UID: \"cd9c4153-0a48-42d9-af01-94ac9e4757de\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kw885" Jul 14 11:39:41.643088 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.643078 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4df7bd22-061c-44c2-bb65-63e702106cd9-node-exporter-tls\") pod \"node-exporter-dcw2c\" (UID: \"4df7bd22-061c-44c2-bb65-63e702106cd9\") " pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:41.643945 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.643128 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/63e25b04-9c3d-4e02-93ef-0323a6430f1a-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-wnm9k\" (UID: \"63e25b04-9c3d-4e02-93ef-0323a6430f1a\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wnm9k" Jul 14 11:39:41.643945 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.643162 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4df7bd22-061c-44c2-bb65-63e702106cd9-root\") pod \"node-exporter-dcw2c\" (UID: \"4df7bd22-061c-44c2-bb65-63e702106cd9\") " pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:41.643945 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.643184 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4df7bd22-061c-44c2-bb65-63e702106cd9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dcw2c\" (UID: \"4df7bd22-061c-44c2-bb65-63e702106cd9\") " pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:41.643945 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.643215 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4df7bd22-061c-44c2-bb65-63e702106cd9-node-exporter-textfile\") pod \"node-exporter-dcw2c\" (UID: \"4df7bd22-061c-44c2-bb65-63e702106cd9\") " pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:41.643945 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.643265 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd9c4153-0a48-42d9-af01-94ac9e4757de-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-kw885\" (UID: \"cd9c4153-0a48-42d9-af01-94ac9e4757de\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kw885" Jul 14 11:39:41.643945 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.643298 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63e25b04-9c3d-4e02-93ef-0323a6430f1a-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-wnm9k\" (UID: \"63e25b04-9c3d-4e02-93ef-0323a6430f1a\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wnm9k" Jul 14 11:39:41.643945 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.643322 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd9c4153-0a48-42d9-af01-94ac9e4757de-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-kw885\" (UID: \"cd9c4153-0a48-42d9-af01-94ac9e4757de\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kw885" Jul 14 11:39:41.643945 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.643348 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/63e25b04-9c3d-4e02-93ef-0323a6430f1a-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-wnm9k\" (UID: \"63e25b04-9c3d-4e02-93ef-0323a6430f1a\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wnm9k" Jul 14 11:39:41.643945 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.643372 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4df7bd22-061c-44c2-bb65-63e702106cd9-node-exporter-wtmp\") pod \"node-exporter-dcw2c\" (UID: \"4df7bd22-061c-44c2-bb65-63e702106cd9\") " pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:41.643945 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:39:41.643398 2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 14 11:39:41.643945 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.643398 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97pdk\" (UniqueName: \"kubernetes.io/projected/63e25b04-9c3d-4e02-93ef-0323a6430f1a-kube-api-access-97pdk\") pod \"kube-state-metrics-785778ff74-wnm9k\" (UID: \"63e25b04-9c3d-4e02-93ef-0323a6430f1a\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wnm9k" Jul 14 11:39:41.643945 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:39:41.643458 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4df7bd22-061c-44c2-bb65-63e702106cd9-node-exporter-tls podName:4df7bd22-061c-44c2-bb65-63e702106cd9 nodeName:}" failed. No retries permitted until 2026-07-14 11:39:42.143439421 +0000 UTC m=+112.506090718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4df7bd22-061c-44c2-bb65-63e702106cd9-node-exporter-tls") pod "node-exporter-dcw2c" (UID: "4df7bd22-061c-44c2-bb65-63e702106cd9") : secret "node-exporter-tls" not found Jul 14 11:39:41.643945 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.643490 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63e25b04-9c3d-4e02-93ef-0323a6430f1a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-wnm9k\" (UID: \"63e25b04-9c3d-4e02-93ef-0323a6430f1a\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wnm9k" Jul 14 11:39:41.643945 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.643679 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4df7bd22-061c-44c2-bb65-63e702106cd9-metrics-client-ca\") pod \"node-exporter-dcw2c\" (UID: \"4df7bd22-061c-44c2-bb65-63e702106cd9\") " pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:41.643945 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.643754 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/63e25b04-9c3d-4e02-93ef-0323a6430f1a-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-wnm9k\" (UID: \"63e25b04-9c3d-4e02-93ef-0323a6430f1a\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wnm9k" Jul 14 11:39:41.644660 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.644036 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4df7bd22-061c-44c2-bb65-63e702106cd9-node-exporter-textfile\") pod \"node-exporter-dcw2c\" (UID: \"4df7bd22-061c-44c2-bb65-63e702106cd9\") " pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:41.644660 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.644160 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4df7bd22-061c-44c2-bb65-63e702106cd9-node-exporter-accelerators-collector-config\") pod \"node-exporter-dcw2c\" (UID: \"4df7bd22-061c-44c2-bb65-63e702106cd9\") " pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:41.644660 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.643324 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4df7bd22-061c-44c2-bb65-63e702106cd9-root\") pod \"node-exporter-dcw2c\" (UID: \"4df7bd22-061c-44c2-bb65-63e702106cd9\") " pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:41.644660 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.644210 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63e25b04-9c3d-4e02-93ef-0323a6430f1a-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-wnm9k\" (UID: \"63e25b04-9c3d-4e02-93ef-0323a6430f1a\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wnm9k" Jul 14 11:39:41.644660 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.644268 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/63e25b04-9c3d-4e02-93ef-0323a6430f1a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-wnm9k\" (UID: \"63e25b04-9c3d-4e02-93ef-0323a6430f1a\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wnm9k" Jul 14 11:39:41.644660 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.644334 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd9c4153-0a48-42d9-af01-94ac9e4757de-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-kw885\" (UID: \"cd9c4153-0a48-42d9-af01-94ac9e4757de\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kw885" Jul 14 11:39:41.644660 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.644512 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4df7bd22-061c-44c2-bb65-63e702106cd9-node-exporter-wtmp\") pod \"node-exporter-dcw2c\" (UID: \"4df7bd22-061c-44c2-bb65-63e702106cd9\") " pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:41.645158 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.644899 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/63e25b04-9c3d-4e02-93ef-0323a6430f1a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-wnm9k\" (UID: \"63e25b04-9c3d-4e02-93ef-0323a6430f1a\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wnm9k" Jul 14 11:39:41.646616 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.646586 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4df7bd22-061c-44c2-bb65-63e702106cd9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dcw2c\" (UID: \"4df7bd22-061c-44c2-bb65-63e702106cd9\") " pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:41.646719 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.646701 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd9c4153-0a48-42d9-af01-94ac9e4757de-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-kw885\" (UID: \"cd9c4153-0a48-42d9-af01-94ac9e4757de\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kw885" Jul 14 11:39:41.646879 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.646859 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd9c4153-0a48-42d9-af01-94ac9e4757de-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-kw885\" (UID: \"cd9c4153-0a48-42d9-af01-94ac9e4757de\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kw885" Jul 14 11:39:41.646970 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.646953 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63e25b04-9c3d-4e02-93ef-0323a6430f1a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-wnm9k\" (UID: \"63e25b04-9c3d-4e02-93ef-0323a6430f1a\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wnm9k" Jul 14 11:39:41.647776 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.647756 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/63e25b04-9c3d-4e02-93ef-0323a6430f1a-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-wnm9k\" (UID: \"63e25b04-9c3d-4e02-93ef-0323a6430f1a\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wnm9k" Jul 14 11:39:41.653871 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.653847 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbf48\" (UniqueName: \"kubernetes.io/projected/cd9c4153-0a48-42d9-af01-94ac9e4757de-kube-api-access-kbf48\") pod \"openshift-state-metrics-84bd68b896-kw885\" (UID: \"cd9c4153-0a48-42d9-af01-94ac9e4757de\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kw885" Jul 14 11:39:41.653871 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.653864 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpgpn\" (UniqueName: \"kubernetes.io/projected/4df7bd22-061c-44c2-bb65-63e702106cd9-kube-api-access-jpgpn\") pod \"node-exporter-dcw2c\" (UID: \"4df7bd22-061c-44c2-bb65-63e702106cd9\") " pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:41.654026 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.653880 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97pdk\" (UniqueName: \"kubernetes.io/projected/63e25b04-9c3d-4e02-93ef-0323a6430f1a-kube-api-access-97pdk\") pod \"kube-state-metrics-785778ff74-wnm9k\" (UID: \"63e25b04-9c3d-4e02-93ef-0323a6430f1a\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wnm9k" Jul 14 11:39:41.786035 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.785938 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kw885" Jul 14 11:39:41.806831 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.806793 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-wnm9k" Jul 14 11:39:41.949815 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.949782 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-kw885"] Jul 14 11:39:41.953551 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:39:41.953517 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd9c4153_0a48_42d9_af01_94ac9e4757de.slice/crio-f82eec378d2b7f4a86065aace7ef73baf1eed04a7934c75dfee7d18e9d2c1881 WatchSource:0}: Error finding container f82eec378d2b7f4a86065aace7ef73baf1eed04a7934c75dfee7d18e9d2c1881: Status 404 returned error can't find the container with id f82eec378d2b7f4a86065aace7ef73baf1eed04a7934c75dfee7d18e9d2c1881 Jul 14 11:39:41.968586 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:41.968555 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-wnm9k"] Jul 14 11:39:41.972522 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:39:41.972494 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63e25b04_9c3d_4e02_93ef_0323a6430f1a.slice/crio-857c9f556a4413be89e92add6a3034a4e8aa2acc36b598ebfd99b84699467eda WatchSource:0}: Error finding container 857c9f556a4413be89e92add6a3034a4e8aa2acc36b598ebfd99b84699467eda: Status 404 returned error can't find the container with id 857c9f556a4413be89e92add6a3034a4e8aa2acc36b598ebfd99b84699467eda Jul 14 11:39:42.148833 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:42.148792 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4df7bd22-061c-44c2-bb65-63e702106cd9-node-exporter-tls\") pod \"node-exporter-dcw2c\" (UID: \"4df7bd22-061c-44c2-bb65-63e702106cd9\") " pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:42.151516 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:42.151473 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4df7bd22-061c-44c2-bb65-63e702106cd9-node-exporter-tls\") pod \"node-exporter-dcw2c\" (UID: \"4df7bd22-061c-44c2-bb65-63e702106cd9\") " pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:42.422602 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:42.422518 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dcw2c" Jul 14 11:39:42.433894 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:39:42.433861 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4df7bd22_061c_44c2_bb65_63e702106cd9.slice/crio-9c2d9bf4cc156a55b6a527f0fd7b49ea1fa86317bd429a8ca92f5ab3ee49fc91 WatchSource:0}: Error finding container 9c2d9bf4cc156a55b6a527f0fd7b49ea1fa86317bd429a8ca92f5ab3ee49fc91: Status 404 returned error can't find the container with id 9c2d9bf4cc156a55b6a527f0fd7b49ea1fa86317bd429a8ca92f5ab3ee49fc91 Jul 14 11:39:42.777911 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:42.777858 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dcw2c" event={"ID":"4df7bd22-061c-44c2-bb65-63e702106cd9","Type":"ContainerStarted","Data":"9c2d9bf4cc156a55b6a527f0fd7b49ea1fa86317bd429a8ca92f5ab3ee49fc91"} Jul 14 11:39:42.779572 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:42.779454 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-wnm9k" event={"ID":"63e25b04-9c3d-4e02-93ef-0323a6430f1a","Type":"ContainerStarted","Data":"857c9f556a4413be89e92add6a3034a4e8aa2acc36b598ebfd99b84699467eda"} Jul 14 11:39:42.782364 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:42.782336 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kw885" event={"ID":"cd9c4153-0a48-42d9-af01-94ac9e4757de","Type":"ContainerStarted","Data":"33f4ed6953de902a488fd89599029f2c999aaee14943c250c4bf620aca206837"} Jul 14 11:39:42.782508 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:42.782399 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kw885" event={"ID":"cd9c4153-0a48-42d9-af01-94ac9e4757de","Type":"ContainerStarted","Data":"5908a57afa7e863eb9fb5733a039b472e51c117bb48867f6e1b7bdd2801057e6"} Jul 14 11:39:42.782508 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:42.782429 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kw885" event={"ID":"cd9c4153-0a48-42d9-af01-94ac9e4757de","Type":"ContainerStarted","Data":"f82eec378d2b7f4a86065aace7ef73baf1eed04a7934c75dfee7d18e9d2c1881"} Jul 14 11:39:44.419918 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.419879 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6d64689769-x9qwz"] Jul 14 11:39:44.423012 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.422983 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" Jul 14 11:39:44.426523 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.426492 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 14 11:39:44.426666 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.426492 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 14 11:39:44.426666 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.426600 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8mi445hu860jr\"" Jul 14 11:39:44.426837 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.426817 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 14 11:39:44.427976 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.427814 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-kzwmg\"" Jul 14 11:39:44.427976 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.427846 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 14 11:39:44.428158 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.428005 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 14 11:39:44.437199 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.437127 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d64689769-x9qwz"] Jul 14 11:39:44.471409 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.471370 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a82bc27a-4025-4bfa-b653-526605543465-secret-grpc-tls\") pod \"thanos-querier-6d64689769-x9qwz\" (UID: \"a82bc27a-4025-4bfa-b653-526605543465\") " pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" Jul 14 11:39:44.471575 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.471454 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a82bc27a-4025-4bfa-b653-526605543465-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d64689769-x9qwz\" (UID: \"a82bc27a-4025-4bfa-b653-526605543465\") " pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" Jul 14 11:39:44.471575 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.471546 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a82bc27a-4025-4bfa-b653-526605543465-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d64689769-x9qwz\" (UID: \"a82bc27a-4025-4bfa-b653-526605543465\") " pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" Jul 14 11:39:44.471693 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.471598 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a82bc27a-4025-4bfa-b653-526605543465-secret-thanos-querier-tls\") pod \"thanos-querier-6d64689769-x9qwz\" (UID: \"a82bc27a-4025-4bfa-b653-526605543465\") " pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" Jul 14 11:39:44.471693 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.471655 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a82bc27a-4025-4bfa-b653-526605543465-metrics-client-ca\") pod \"thanos-querier-6d64689769-x9qwz\" (UID: \"a82bc27a-4025-4bfa-b653-526605543465\") " pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" Jul 14 11:39:44.471771 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.471699 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a82bc27a-4025-4bfa-b653-526605543465-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d64689769-x9qwz\" (UID: \"a82bc27a-4025-4bfa-b653-526605543465\") " pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" Jul 14 11:39:44.471771 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.471726 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcwxk\" (UniqueName: \"kubernetes.io/projected/a82bc27a-4025-4bfa-b653-526605543465-kube-api-access-qcwxk\") pod \"thanos-querier-6d64689769-x9qwz\" (UID: \"a82bc27a-4025-4bfa-b653-526605543465\") " pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" Jul 14 11:39:44.471854 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.471783 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a82bc27a-4025-4bfa-b653-526605543465-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d64689769-x9qwz\" (UID: \"a82bc27a-4025-4bfa-b653-526605543465\") " pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" Jul 14 11:39:44.573080 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.573041 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a82bc27a-4025-4bfa-b653-526605543465-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d64689769-x9qwz\" (UID: \"a82bc27a-4025-4bfa-b653-526605543465\") " pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" Jul 14 11:39:44.573080 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.573087 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a82bc27a-4025-4bfa-b653-526605543465-secret-grpc-tls\") pod \"thanos-querier-6d64689769-x9qwz\" (UID: \"a82bc27a-4025-4bfa-b653-526605543465\") " pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" Jul 14 11:39:44.573348 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.573152 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a82bc27a-4025-4bfa-b653-526605543465-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d64689769-x9qwz\" (UID: \"a82bc27a-4025-4bfa-b653-526605543465\") " pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" Jul 14 11:39:44.573348 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.573193 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a82bc27a-4025-4bfa-b653-526605543465-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d64689769-x9qwz\" (UID: \"a82bc27a-4025-4bfa-b653-526605543465\") " pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" Jul 14 11:39:44.573348 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.573230 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a82bc27a-4025-4bfa-b653-526605543465-secret-thanos-querier-tls\") pod \"thanos-querier-6d64689769-x9qwz\" (UID: \"a82bc27a-4025-4bfa-b653-526605543465\") " pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" Jul 14 11:39:44.573348 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.573260 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a82bc27a-4025-4bfa-b653-526605543465-metrics-client-ca\") pod \"thanos-querier-6d64689769-x9qwz\" (UID: \"a82bc27a-4025-4bfa-b653-526605543465\") " pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" Jul 14 11:39:44.573348 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.573296 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a82bc27a-4025-4bfa-b653-526605543465-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d64689769-x9qwz\" (UID: \"a82bc27a-4025-4bfa-b653-526605543465\") " pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" Jul 14 11:39:44.573348 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.573325 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcwxk\" (UniqueName: \"kubernetes.io/projected/a82bc27a-4025-4bfa-b653-526605543465-kube-api-access-qcwxk\") pod \"thanos-querier-6d64689769-x9qwz\" (UID: \"a82bc27a-4025-4bfa-b653-526605543465\") " pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" Jul 14 11:39:44.574196 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.574138 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a82bc27a-4025-4bfa-b653-526605543465-metrics-client-ca\") pod \"thanos-querier-6d64689769-x9qwz\" (UID: \"a82bc27a-4025-4bfa-b653-526605543465\") " pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" Jul 14 11:39:44.576471 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.576443 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a82bc27a-4025-4bfa-b653-526605543465-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d64689769-x9qwz\" (UID: \"a82bc27a-4025-4bfa-b653-526605543465\") " pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" Jul 14 11:39:44.576594 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.576467 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a82bc27a-4025-4bfa-b653-526605543465-secret-grpc-tls\") pod \"thanos-querier-6d64689769-x9qwz\" (UID: \"a82bc27a-4025-4bfa-b653-526605543465\") " pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" Jul 14 11:39:44.576594 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.576555 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a82bc27a-4025-4bfa-b653-526605543465-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d64689769-x9qwz\" (UID: \"a82bc27a-4025-4bfa-b653-526605543465\") " pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" Jul 14 11:39:44.576714 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.576620 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a82bc27a-4025-4bfa-b653-526605543465-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d64689769-x9qwz\" (UID: \"a82bc27a-4025-4bfa-b653-526605543465\") " pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" Jul 14 11:39:44.576857 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.576826 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a82bc27a-4025-4bfa-b653-526605543465-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d64689769-x9qwz\" (UID: \"a82bc27a-4025-4bfa-b653-526605543465\") " pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" Jul 14 11:39:44.577013 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.576986 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a82bc27a-4025-4bfa-b653-526605543465-secret-thanos-querier-tls\") pod \"thanos-querier-6d64689769-x9qwz\" (UID: \"a82bc27a-4025-4bfa-b653-526605543465\") " pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" Jul 14 11:39:44.582877 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.582853 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcwxk\" (UniqueName: \"kubernetes.io/projected/a82bc27a-4025-4bfa-b653-526605543465-kube-api-access-qcwxk\") pod \"thanos-querier-6d64689769-x9qwz\" (UID: \"a82bc27a-4025-4bfa-b653-526605543465\") " pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" Jul 14 11:39:44.734582 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.734498 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" Jul 14 11:39:44.739871 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.739841 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hmwlj" Jul 14 11:39:44.793963 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.793927 2582 generic.go:356] "Generic (PLEG): container finished" podID="4df7bd22-061c-44c2-bb65-63e702106cd9" containerID="aa89470fb1545e4a54c31947984a2383b6935addf5ee197e608be2459257feb1" exitCode=0 Jul 14 11:39:44.794158 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.794024 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dcw2c" event={"ID":"4df7bd22-061c-44c2-bb65-63e702106cd9","Type":"ContainerDied","Data":"aa89470fb1545e4a54c31947984a2383b6935addf5ee197e608be2459257feb1"} Jul 14 11:39:44.797731 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.797693 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-wnm9k" event={"ID":"63e25b04-9c3d-4e02-93ef-0323a6430f1a","Type":"ContainerStarted","Data":"7f8506d4cb3ba4082b65d0bd90b7a9ee4c154e3cf7f465126d66140306238708"} Jul 14 11:39:44.797854 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.797769 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-wnm9k" event={"ID":"63e25b04-9c3d-4e02-93ef-0323a6430f1a","Type":"ContainerStarted","Data":"c11431907e69a9e432ceddcae198c350c9566c5541a698f89807244b8b4046ea"} Jul 14 11:39:44.797854 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.797803 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-wnm9k" event={"ID":"63e25b04-9c3d-4e02-93ef-0323a6430f1a","Type":"ContainerStarted","Data":"01aa48dd5e442f58bbeac29a1e116128e0d289bc575c778cedbbada90c88b1a8"} Jul 14 11:39:44.800450 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.800423 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kw885" event={"ID":"cd9c4153-0a48-42d9-af01-94ac9e4757de","Type":"ContainerStarted","Data":"558196f5b57ff4aaace2690b9f77621ba098be9824528761f9b02194d8627f0c"} Jul 14 11:39:44.838669 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.838612 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kw885" podStartSLOduration=2.004758501 podStartE2EDuration="3.838593299s" totalImagesPullingTime="1.833834798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:39:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:39:44.837784937 +0000 UTC m=+115.200436239" watchObservedRunningTime="2026-07-14 11:39:44.838593299 +0000 UTC m=+115.201244602" Jul 14 11:39:44.858781 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:44.858728 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-wnm9k" podStartSLOduration=1.9224194749999999 podStartE2EDuration="3.858708512s" totalImagesPullingTime="1.936289037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:39:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:39:44.857702401 +0000 UTC m=+115.220353728" watchObservedRunningTime="2026-07-14 11:39:44.858708512 +0000 UTC m=+115.221359816" Jul 14 11:39:45.767189 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.767149 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6fd85b8888-kwb5f"] Jul 14 11:39:45.769879 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.769851 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" Jul 14 11:39:45.773973 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.773925 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-smmg2\"" Jul 14 11:39:45.773973 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.773926 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 14 11:39:45.774208 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.773980 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 14 11:39:45.774208 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.773924 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 14 11:39:45.774208 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.773925 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-acmi8kr20oqg6\"" Jul 14 11:39:45.774208 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.774017 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 14 11:39:45.781543 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.781474 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6fd85b8888-kwb5f"] Jul 14 11:39:45.885980 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.885942 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6418eecb-846e-448e-9d2c-a41f67b09ce4-secret-metrics-server-client-certs\") pod \"metrics-server-6fd85b8888-kwb5f\" (UID: \"6418eecb-846e-448e-9d2c-a41f67b09ce4\") " pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" Jul 14 11:39:45.886205 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.885993 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6418eecb-846e-448e-9d2c-a41f67b09ce4-metrics-server-audit-profiles\") pod \"metrics-server-6fd85b8888-kwb5f\" (UID: \"6418eecb-846e-448e-9d2c-a41f67b09ce4\") " pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" Jul 14 11:39:45.886205 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.886022 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6418eecb-846e-448e-9d2c-a41f67b09ce4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fd85b8888-kwb5f\" (UID: \"6418eecb-846e-448e-9d2c-a41f67b09ce4\") " pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" Jul 14 11:39:45.886205 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.886180 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6418eecb-846e-448e-9d2c-a41f67b09ce4-audit-log\") pod \"metrics-server-6fd85b8888-kwb5f\" (UID: \"6418eecb-846e-448e-9d2c-a41f67b09ce4\") " pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" Jul 14 11:39:45.886379 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.886292 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6418eecb-846e-448e-9d2c-a41f67b09ce4-client-ca-bundle\") pod \"metrics-server-6fd85b8888-kwb5f\" (UID: \"6418eecb-846e-448e-9d2c-a41f67b09ce4\") " pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" Jul 14 11:39:45.886379 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.886352 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz7q9\" (UniqueName: \"kubernetes.io/projected/6418eecb-846e-448e-9d2c-a41f67b09ce4-kube-api-access-jz7q9\") pod \"metrics-server-6fd85b8888-kwb5f\" (UID: \"6418eecb-846e-448e-9d2c-a41f67b09ce4\") " pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" Jul 14 11:39:45.886970 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.886941 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6418eecb-846e-448e-9d2c-a41f67b09ce4-secret-metrics-server-tls\") pod \"metrics-server-6fd85b8888-kwb5f\" (UID: \"6418eecb-846e-448e-9d2c-a41f67b09ce4\") " pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" Jul 14 11:39:45.988372 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.988332 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6418eecb-846e-448e-9d2c-a41f67b09ce4-secret-metrics-server-client-certs\") pod \"metrics-server-6fd85b8888-kwb5f\" (UID: \"6418eecb-846e-448e-9d2c-a41f67b09ce4\") " pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" Jul 14 11:39:45.988372 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.988375 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6418eecb-846e-448e-9d2c-a41f67b09ce4-metrics-server-audit-profiles\") pod \"metrics-server-6fd85b8888-kwb5f\" (UID: \"6418eecb-846e-448e-9d2c-a41f67b09ce4\") " pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" Jul 14 11:39:45.988614 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.988407 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6418eecb-846e-448e-9d2c-a41f67b09ce4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fd85b8888-kwb5f\" (UID: \"6418eecb-846e-448e-9d2c-a41f67b09ce4\") " pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" Jul 14 11:39:45.988614 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.988486 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6418eecb-846e-448e-9d2c-a41f67b09ce4-audit-log\") pod \"metrics-server-6fd85b8888-kwb5f\" (UID: \"6418eecb-846e-448e-9d2c-a41f67b09ce4\") " pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" Jul 14 11:39:45.988614 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.988525 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6418eecb-846e-448e-9d2c-a41f67b09ce4-client-ca-bundle\") pod \"metrics-server-6fd85b8888-kwb5f\" (UID: \"6418eecb-846e-448e-9d2c-a41f67b09ce4\") " pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" Jul 14 11:39:45.988614 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.988558 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz7q9\" (UniqueName: \"kubernetes.io/projected/6418eecb-846e-448e-9d2c-a41f67b09ce4-kube-api-access-jz7q9\") pod \"metrics-server-6fd85b8888-kwb5f\" (UID: \"6418eecb-846e-448e-9d2c-a41f67b09ce4\") " pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" Jul 14 11:39:45.988614 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.988588 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6418eecb-846e-448e-9d2c-a41f67b09ce4-secret-metrics-server-tls\") pod \"metrics-server-6fd85b8888-kwb5f\" (UID: \"6418eecb-846e-448e-9d2c-a41f67b09ce4\") " pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" Jul 14 11:39:45.989578 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.989018 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6418eecb-846e-448e-9d2c-a41f67b09ce4-audit-log\") pod \"metrics-server-6fd85b8888-kwb5f\" (UID: \"6418eecb-846e-448e-9d2c-a41f67b09ce4\") " pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" Jul 14 11:39:45.989578 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.989522 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6418eecb-846e-448e-9d2c-a41f67b09ce4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fd85b8888-kwb5f\" (UID: \"6418eecb-846e-448e-9d2c-a41f67b09ce4\") " pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" Jul 14 11:39:45.989774 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.989573 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6418eecb-846e-448e-9d2c-a41f67b09ce4-metrics-server-audit-profiles\") pod \"metrics-server-6fd85b8888-kwb5f\" (UID: \"6418eecb-846e-448e-9d2c-a41f67b09ce4\") " pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" Jul 14 11:39:45.991601 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.991576 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6418eecb-846e-448e-9d2c-a41f67b09ce4-secret-metrics-server-tls\") pod \"metrics-server-6fd85b8888-kwb5f\" (UID: \"6418eecb-846e-448e-9d2c-a41f67b09ce4\") " pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" Jul 14 11:39:45.991706 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.991573 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6418eecb-846e-448e-9d2c-a41f67b09ce4-client-ca-bundle\") pod \"metrics-server-6fd85b8888-kwb5f\" (UID: \"6418eecb-846e-448e-9d2c-a41f67b09ce4\") " pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" Jul 14 11:39:45.992082 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.992060 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6418eecb-846e-448e-9d2c-a41f67b09ce4-secret-metrics-server-client-certs\") pod \"metrics-server-6fd85b8888-kwb5f\" (UID: \"6418eecb-846e-448e-9d2c-a41f67b09ce4\") " pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" Jul 14 11:39:45.998548 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:45.998521 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz7q9\" (UniqueName: \"kubernetes.io/projected/6418eecb-846e-448e-9d2c-a41f67b09ce4-kube-api-access-jz7q9\") pod \"metrics-server-6fd85b8888-kwb5f\" (UID: \"6418eecb-846e-448e-9d2c-a41f67b09ce4\") " pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" Jul 14 11:39:46.081908 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.081821 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" Jul 14 11:39:46.185600 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.185557 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-c9wxm"] Jul 14 11:39:46.188170 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.188139 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b7954cd4c-mtjwn"] Jul 14 11:39:46.188346 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.188266 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c9wxm" Jul 14 11:39:46.191154 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.190828 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b7954cd4c-mtjwn" Jul 14 11:39:46.191364 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.191325 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-9zf5n\"" Jul 14 11:39:46.191548 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.191531 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 14 11:39:46.193744 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.193720 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 14 11:39:46.193873 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.193807 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ggxrg\"" Jul 14 11:39:46.194222 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.194204 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 14 11:39:46.194318 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.194209 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 14 11:39:46.194318 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.194284 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 14 11:39:46.195124 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.195086 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 14 11:39:46.200054 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.200028 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 14 11:39:46.200776 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.200756 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-c9wxm"] Jul 14 11:39:46.202589 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.202566 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b7954cd4c-mtjwn"] Jul 14 11:39:46.291410 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.291378 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb841bef-5d01-4a1c-bb2b-737826834bd5-service-ca\") pod \"console-7b7954cd4c-mtjwn\" (UID: \"eb841bef-5d01-4a1c-bb2b-737826834bd5\") " pod="openshift-console/console-7b7954cd4c-mtjwn" Jul 14 11:39:46.291410 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.291414 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb841bef-5d01-4a1c-bb2b-737826834bd5-console-oauth-config\") pod \"console-7b7954cd4c-mtjwn\" (UID: \"eb841bef-5d01-4a1c-bb2b-737826834bd5\") " pod="openshift-console/console-7b7954cd4c-mtjwn" Jul 14 11:39:46.291640 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.291457 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb841bef-5d01-4a1c-bb2b-737826834bd5-trusted-ca-bundle\") pod \"console-7b7954cd4c-mtjwn\" (UID: \"eb841bef-5d01-4a1c-bb2b-737826834bd5\") " pod="openshift-console/console-7b7954cd4c-mtjwn" Jul 14 11:39:46.291640 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.291580 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs7sw\" (UniqueName: \"kubernetes.io/projected/8c7fa955-8964-484d-a0eb-37ac08a12fe1-kube-api-access-zs7sw\") pod \"monitoring-plugin-5f68df7f58-c9wxm\" (UID: \"8c7fa955-8964-484d-a0eb-37ac08a12fe1\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c9wxm" Jul 14 11:39:46.291640 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.291613 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb841bef-5d01-4a1c-bb2b-737826834bd5-console-config\") pod \"console-7b7954cd4c-mtjwn\" (UID: \"eb841bef-5d01-4a1c-bb2b-737826834bd5\") " pod="openshift-console/console-7b7954cd4c-mtjwn" Jul 14 11:39:46.291786 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.291646 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb841bef-5d01-4a1c-bb2b-737826834bd5-console-serving-cert\") pod \"console-7b7954cd4c-mtjwn\" (UID: \"eb841bef-5d01-4a1c-bb2b-737826834bd5\") " pod="openshift-console/console-7b7954cd4c-mtjwn" Jul 14 11:39:46.291786 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.291678 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb841bef-5d01-4a1c-bb2b-737826834bd5-oauth-serving-cert\") pod \"console-7b7954cd4c-mtjwn\" (UID: \"eb841bef-5d01-4a1c-bb2b-737826834bd5\") " pod="openshift-console/console-7b7954cd4c-mtjwn" Jul 14 11:39:46.291786 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.291701 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpz4x\" (UniqueName: \"kubernetes.io/projected/eb841bef-5d01-4a1c-bb2b-737826834bd5-kube-api-access-hpz4x\") pod \"console-7b7954cd4c-mtjwn\" (UID: \"eb841bef-5d01-4a1c-bb2b-737826834bd5\") " pod="openshift-console/console-7b7954cd4c-mtjwn" Jul 14 11:39:46.291786 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.291753 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8c7fa955-8964-484d-a0eb-37ac08a12fe1-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-c9wxm\" (UID: \"8c7fa955-8964-484d-a0eb-37ac08a12fe1\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c9wxm" Jul 14 11:39:46.392252 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.392167 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs7sw\" (UniqueName: \"kubernetes.io/projected/8c7fa955-8964-484d-a0eb-37ac08a12fe1-kube-api-access-zs7sw\") pod \"monitoring-plugin-5f68df7f58-c9wxm\" (UID: \"8c7fa955-8964-484d-a0eb-37ac08a12fe1\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c9wxm" Jul 14 11:39:46.392252 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.392213 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb841bef-5d01-4a1c-bb2b-737826834bd5-console-config\") pod \"console-7b7954cd4c-mtjwn\" (UID: \"eb841bef-5d01-4a1c-bb2b-737826834bd5\") " pod="openshift-console/console-7b7954cd4c-mtjwn" Jul 14 11:39:46.392470 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.392314 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb841bef-5d01-4a1c-bb2b-737826834bd5-console-serving-cert\") pod \"console-7b7954cd4c-mtjwn\" (UID: \"eb841bef-5d01-4a1c-bb2b-737826834bd5\") " pod="openshift-console/console-7b7954cd4c-mtjwn" Jul 14 11:39:46.392470 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.392353 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb841bef-5d01-4a1c-bb2b-737826834bd5-oauth-serving-cert\") pod \"console-7b7954cd4c-mtjwn\" (UID: \"eb841bef-5d01-4a1c-bb2b-737826834bd5\") " pod="openshift-console/console-7b7954cd4c-mtjwn" Jul 14 11:39:46.392470 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.392376 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpz4x\" (UniqueName: \"kubernetes.io/projected/eb841bef-5d01-4a1c-bb2b-737826834bd5-kube-api-access-hpz4x\") pod \"console-7b7954cd4c-mtjwn\" (UID: \"eb841bef-5d01-4a1c-bb2b-737826834bd5\") " pod="openshift-console/console-7b7954cd4c-mtjwn" Jul 14 11:39:46.392470 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.392408 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8c7fa955-8964-484d-a0eb-37ac08a12fe1-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-c9wxm\" (UID: \"8c7fa955-8964-484d-a0eb-37ac08a12fe1\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c9wxm" Jul 14 11:39:46.392470 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.392469 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb841bef-5d01-4a1c-bb2b-737826834bd5-service-ca\") pod \"console-7b7954cd4c-mtjwn\" (UID: \"eb841bef-5d01-4a1c-bb2b-737826834bd5\") " pod="openshift-console/console-7b7954cd4c-mtjwn" Jul 14 11:39:46.392699 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.392496 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb841bef-5d01-4a1c-bb2b-737826834bd5-console-oauth-config\") pod \"console-7b7954cd4c-mtjwn\" (UID: \"eb841bef-5d01-4a1c-bb2b-737826834bd5\") " pod="openshift-console/console-7b7954cd4c-mtjwn" Jul 14 11:39:46.392699 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.392592 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb841bef-5d01-4a1c-bb2b-737826834bd5-trusted-ca-bundle\") pod \"console-7b7954cd4c-mtjwn\" (UID: \"eb841bef-5d01-4a1c-bb2b-737826834bd5\") " pod="openshift-console/console-7b7954cd4c-mtjwn" Jul 14 11:39:46.392699 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:39:46.392610 2582 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 14 11:39:46.392699 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:39:46.392675 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c7fa955-8964-484d-a0eb-37ac08a12fe1-monitoring-plugin-cert podName:8c7fa955-8964-484d-a0eb-37ac08a12fe1 nodeName:}" failed. No retries permitted until 2026-07-14 11:39:46.892655772 +0000 UTC m=+117.255307068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/8c7fa955-8964-484d-a0eb-37ac08a12fe1-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-c9wxm" (UID: "8c7fa955-8964-484d-a0eb-37ac08a12fe1") : secret "monitoring-plugin-cert" not found Jul 14 11:39:46.393048 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.393008 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb841bef-5d01-4a1c-bb2b-737826834bd5-console-config\") pod \"console-7b7954cd4c-mtjwn\" (UID: \"eb841bef-5d01-4a1c-bb2b-737826834bd5\") " pod="openshift-console/console-7b7954cd4c-mtjwn" Jul 14 11:39:46.393048 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.393033 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb841bef-5d01-4a1c-bb2b-737826834bd5-oauth-serving-cert\") pod \"console-7b7954cd4c-mtjwn\" (UID: \"eb841bef-5d01-4a1c-bb2b-737826834bd5\") " pod="openshift-console/console-7b7954cd4c-mtjwn" Jul 14 11:39:46.393556 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.393518 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb841bef-5d01-4a1c-bb2b-737826834bd5-service-ca\") pod \"console-7b7954cd4c-mtjwn\" (UID: \"eb841bef-5d01-4a1c-bb2b-737826834bd5\") " pod="openshift-console/console-7b7954cd4c-mtjwn" Jul 14 11:39:46.393672 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.393570 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb841bef-5d01-4a1c-bb2b-737826834bd5-trusted-ca-bundle\") pod \"console-7b7954cd4c-mtjwn\" (UID: \"eb841bef-5d01-4a1c-bb2b-737826834bd5\") " pod="openshift-console/console-7b7954cd4c-mtjwn" Jul 14 11:39:46.395275 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.395243 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb841bef-5d01-4a1c-bb2b-737826834bd5-console-serving-cert\") pod \"console-7b7954cd4c-mtjwn\" (UID: \"eb841bef-5d01-4a1c-bb2b-737826834bd5\") " pod="openshift-console/console-7b7954cd4c-mtjwn" Jul 14 11:39:46.395612 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.395585 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb841bef-5d01-4a1c-bb2b-737826834bd5-console-oauth-config\") pod \"console-7b7954cd4c-mtjwn\" (UID: \"eb841bef-5d01-4a1c-bb2b-737826834bd5\") " pod="openshift-console/console-7b7954cd4c-mtjwn" Jul 14 11:39:46.403002 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.402980 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpz4x\" (UniqueName: \"kubernetes.io/projected/eb841bef-5d01-4a1c-bb2b-737826834bd5-kube-api-access-hpz4x\") pod \"console-7b7954cd4c-mtjwn\" (UID: \"eb841bef-5d01-4a1c-bb2b-737826834bd5\") " pod="openshift-console/console-7b7954cd4c-mtjwn" Jul 14 11:39:46.404194 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.404168 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs7sw\" (UniqueName: \"kubernetes.io/projected/8c7fa955-8964-484d-a0eb-37ac08a12fe1-kube-api-access-zs7sw\") pod \"monitoring-plugin-5f68df7f58-c9wxm\" (UID: \"8c7fa955-8964-484d-a0eb-37ac08a12fe1\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c9wxm" Jul 14 11:39:46.510494 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.510458 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b7954cd4c-mtjwn" Jul 14 11:39:46.706820 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.706784 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-57c9957ccc-ph9gs"] Jul 14 11:39:46.709384 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.709360 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" Jul 14 11:39:46.712226 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.712197 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 14 11:39:46.712358 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.712198 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 14 11:39:46.712358 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.712299 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 14 11:39:46.712467 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.712375 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-khg65\"" Jul 14 11:39:46.712520 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.712484 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 14 11:39:46.712749 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.712729 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 14 11:39:46.717127 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.717086 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 14 11:39:46.724211 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.724185 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-57c9957ccc-ph9gs"] Jul 14 11:39:46.796037 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.795997 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3aeb72b6-36bf-4532-9420-1dc39f65246c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-57c9957ccc-ph9gs\" (UID: \"3aeb72b6-36bf-4532-9420-1dc39f65246c\") " pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" Jul 14 11:39:46.796477 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.796063 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7f8f\" (UniqueName: \"kubernetes.io/projected/3aeb72b6-36bf-4532-9420-1dc39f65246c-kube-api-access-c7f8f\") pod \"telemeter-client-57c9957ccc-ph9gs\" (UID: \"3aeb72b6-36bf-4532-9420-1dc39f65246c\") " pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" Jul 14 11:39:46.796477 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.796145 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3aeb72b6-36bf-4532-9420-1dc39f65246c-serving-certs-ca-bundle\") pod \"telemeter-client-57c9957ccc-ph9gs\" (UID: \"3aeb72b6-36bf-4532-9420-1dc39f65246c\") " pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" Jul 14 11:39:46.796477 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.796207 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3aeb72b6-36bf-4532-9420-1dc39f65246c-federate-client-tls\") pod \"telemeter-client-57c9957ccc-ph9gs\" (UID: \"3aeb72b6-36bf-4532-9420-1dc39f65246c\") " pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" Jul 14 11:39:46.796477 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.796254 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3aeb72b6-36bf-4532-9420-1dc39f65246c-telemeter-client-tls\") pod \"telemeter-client-57c9957ccc-ph9gs\" (UID: \"3aeb72b6-36bf-4532-9420-1dc39f65246c\") " pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" Jul 14 11:39:46.796477 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.796308 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3aeb72b6-36bf-4532-9420-1dc39f65246c-secret-telemeter-client\") pod \"telemeter-client-57c9957ccc-ph9gs\" (UID: \"3aeb72b6-36bf-4532-9420-1dc39f65246c\") " pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" Jul 14 11:39:46.796477 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.796356 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3aeb72b6-36bf-4532-9420-1dc39f65246c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-57c9957ccc-ph9gs\" (UID: \"3aeb72b6-36bf-4532-9420-1dc39f65246c\") " pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" Jul 14 11:39:46.796477 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.796433 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3aeb72b6-36bf-4532-9420-1dc39f65246c-metrics-client-ca\") pod \"telemeter-client-57c9957ccc-ph9gs\" (UID: \"3aeb72b6-36bf-4532-9420-1dc39f65246c\") " pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" Jul 14 11:39:46.897625 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.897587 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3aeb72b6-36bf-4532-9420-1dc39f65246c-serving-certs-ca-bundle\") pod \"telemeter-client-57c9957ccc-ph9gs\" (UID: \"3aeb72b6-36bf-4532-9420-1dc39f65246c\") " pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" Jul 14 11:39:46.897625 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.897631 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3aeb72b6-36bf-4532-9420-1dc39f65246c-federate-client-tls\") pod \"telemeter-client-57c9957ccc-ph9gs\" (UID: \"3aeb72b6-36bf-4532-9420-1dc39f65246c\") " pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" Jul 14 11:39:46.897883 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.897653 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3aeb72b6-36bf-4532-9420-1dc39f65246c-telemeter-client-tls\") pod \"telemeter-client-57c9957ccc-ph9gs\" (UID: \"3aeb72b6-36bf-4532-9420-1dc39f65246c\") " pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" Jul 14 11:39:46.897883 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.897703 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3aeb72b6-36bf-4532-9420-1dc39f65246c-secret-telemeter-client\") pod \"telemeter-client-57c9957ccc-ph9gs\" (UID: \"3aeb72b6-36bf-4532-9420-1dc39f65246c\") " pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" Jul 14 11:39:46.897883 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.897728 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3aeb72b6-36bf-4532-9420-1dc39f65246c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-57c9957ccc-ph9gs\" (UID: \"3aeb72b6-36bf-4532-9420-1dc39f65246c\") " pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" Jul 14 11:39:46.897883 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.897778 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8c7fa955-8964-484d-a0eb-37ac08a12fe1-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-c9wxm\" (UID: \"8c7fa955-8964-484d-a0eb-37ac08a12fe1\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c9wxm" Jul 14 11:39:46.897883 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.897806 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3aeb72b6-36bf-4532-9420-1dc39f65246c-metrics-client-ca\") pod \"telemeter-client-57c9957ccc-ph9gs\" (UID: \"3aeb72b6-36bf-4532-9420-1dc39f65246c\") " pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" Jul 14 11:39:46.897883 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.897858 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3aeb72b6-36bf-4532-9420-1dc39f65246c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-57c9957ccc-ph9gs\" (UID: \"3aeb72b6-36bf-4532-9420-1dc39f65246c\") " pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" Jul 14 11:39:46.898202 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.897890 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7f8f\" (UniqueName: \"kubernetes.io/projected/3aeb72b6-36bf-4532-9420-1dc39f65246c-kube-api-access-c7f8f\") pod \"telemeter-client-57c9957ccc-ph9gs\" (UID: \"3aeb72b6-36bf-4532-9420-1dc39f65246c\") " pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" Jul 14 11:39:46.898991 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.898637 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3aeb72b6-36bf-4532-9420-1dc39f65246c-serving-certs-ca-bundle\") pod \"telemeter-client-57c9957ccc-ph9gs\" (UID: \"3aeb72b6-36bf-4532-9420-1dc39f65246c\") " pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" Jul 14 11:39:46.898991 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.898955 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3aeb72b6-36bf-4532-9420-1dc39f65246c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-57c9957ccc-ph9gs\" (UID: \"3aeb72b6-36bf-4532-9420-1dc39f65246c\") " pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" Jul 14 11:39:46.898991 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.898973 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3aeb72b6-36bf-4532-9420-1dc39f65246c-metrics-client-ca\") pod \"telemeter-client-57c9957ccc-ph9gs\" (UID: \"3aeb72b6-36bf-4532-9420-1dc39f65246c\") " pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" Jul 14 11:39:46.900865 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.900825 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3aeb72b6-36bf-4532-9420-1dc39f65246c-telemeter-client-tls\") pod \"telemeter-client-57c9957ccc-ph9gs\" (UID: \"3aeb72b6-36bf-4532-9420-1dc39f65246c\") " pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" Jul 14 11:39:46.900985 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.900935 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3aeb72b6-36bf-4532-9420-1dc39f65246c-federate-client-tls\") pod \"telemeter-client-57c9957ccc-ph9gs\" (UID: \"3aeb72b6-36bf-4532-9420-1dc39f65246c\") " pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" Jul 14 11:39:46.900985 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.900935 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3aeb72b6-36bf-4532-9420-1dc39f65246c-secret-telemeter-client\") pod \"telemeter-client-57c9957ccc-ph9gs\" (UID: \"3aeb72b6-36bf-4532-9420-1dc39f65246c\") " pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" Jul 14 11:39:46.901117 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.901079 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8c7fa955-8964-484d-a0eb-37ac08a12fe1-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-c9wxm\" (UID: \"8c7fa955-8964-484d-a0eb-37ac08a12fe1\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c9wxm" Jul 14 11:39:46.901668 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.901649 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3aeb72b6-36bf-4532-9420-1dc39f65246c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-57c9957ccc-ph9gs\" (UID: \"3aeb72b6-36bf-4532-9420-1dc39f65246c\") " pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" Jul 14 11:39:46.908442 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:46.908408 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7f8f\" (UniqueName: \"kubernetes.io/projected/3aeb72b6-36bf-4532-9420-1dc39f65246c-kube-api-access-c7f8f\") pod \"telemeter-client-57c9957ccc-ph9gs\" (UID: \"3aeb72b6-36bf-4532-9420-1dc39f65246c\") " pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" Jul 14 11:39:47.021548 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.021457 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" Jul 14 11:39:47.102420 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.102250 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c9wxm" Jul 14 11:39:47.769953 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.769908 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 11:39:47.774035 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.773994 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.777717 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.777686 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 14 11:39:47.778010 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.777978 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 14 11:39:47.778134 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.778057 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 14 11:39:47.778134 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.778062 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 14 11:39:47.778302 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.778240 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vsglw\"" Jul 14 11:39:47.778376 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.778364 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 14 11:39:47.778427 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.778400 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 14 11:39:47.778608 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.778588 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 14 11:39:47.779250 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.779229 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 14 11:39:47.779584 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.779450 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 14 11:39:47.779584 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.779558 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 14 11:39:47.780041 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.779815 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2n90m99u6ile3\"" Jul 14 11:39:47.780041 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.779826 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 14 11:39:47.780041 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.779876 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 14 11:39:47.797029 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.795609 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 14 11:39:47.798802 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.798648 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 14 11:39:47.798980 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.798954 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 11:39:47.807595 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.807563 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.807742 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.807607 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.807742 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.807644 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.807742 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.807718 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.807884 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.807746 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.807884 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.807767 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.807884 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.807797 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.807884 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.807869 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.808027 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.807985 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd4bea28-931c-4047-a97a-c5d82a935fa4-config-out\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.808076 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.808042 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-web-config\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.808164 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.808142 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.808216 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.808177 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wng7j\" (UniqueName: \"kubernetes.io/projected/dd4bea28-931c-4047-a97a-c5d82a935fa4-kube-api-access-wng7j\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.808267 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.808210 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.808321 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.808291 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.808376 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.808337 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-config\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.808376 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.808362 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.808463 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.808388 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.808463 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.808420 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.808463 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.808444 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.808585 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.808507 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd4bea28-931c-4047-a97a-c5d82a935fa4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.909848 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.909807 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd4bea28-931c-4047-a97a-c5d82a935fa4-config-out\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.910018 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.909868 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-web-config\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.910018 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.909910 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.910018 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.909933 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wng7j\" (UniqueName: \"kubernetes.io/projected/dd4bea28-931c-4047-a97a-c5d82a935fa4-kube-api-access-wng7j\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.910222 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.910044 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.910222 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.910120 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.910222 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.910156 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-config\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.910222 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.910182 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.910222 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.910214 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.910486 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.910245 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.910486 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.910270 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.910486 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.910298 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd4bea28-931c-4047-a97a-c5d82a935fa4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.910486 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.910336 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.910486 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.910367 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.910486 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.910374 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.910486 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.910397 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.910486 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.910471 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.910847 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.910505 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.910847 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.910534 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.910847 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.910580 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.910847 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.910606 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.911035 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.910842 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.911586 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.911231 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.912070 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.912040 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.913432 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.913402 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.914664 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.914637 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.916691 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.916658 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.917877 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.917001 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.917877 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.917067 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-web-config\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.917877 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.917147 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.917877 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.917424 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.917877 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.917445 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-config\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.917877 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.917455 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd4bea28-931c-4047-a97a-c5d82a935fa4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.917877 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.917535 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.917877 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.917797 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.917877 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.917825 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.917877 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.917852 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.919000 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.918956 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.919299 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.919276 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd4bea28-931c-4047-a97a-c5d82a935fa4-config-out\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:47.921001 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:47.920981 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wng7j\" (UniqueName: \"kubernetes.io/projected/dd4bea28-931c-4047-a97a-c5d82a935fa4-kube-api-access-wng7j\") pod \"prometheus-k8s-0\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:48.102799 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:48.102678 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:39:51.637624 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:51.637542 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-57c9957ccc-ph9gs"] Jul 14 11:39:51.645266 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:39:51.640366 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aeb72b6_36bf_4532_9420_1dc39f65246c.slice/crio-eed15b3084c923f6641179d68a039c3fd7ab60863e1191f55f7a3766e65f162e WatchSource:0}: Error finding container eed15b3084c923f6641179d68a039c3fd7ab60863e1191f55f7a3766e65f162e: Status 404 returned error can't find the container with id eed15b3084c923f6641179d68a039c3fd7ab60863e1191f55f7a3766e65f162e Jul 14 11:39:51.645266 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:51.642904 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-c9wxm"] Jul 14 11:39:51.651277 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:39:51.651232 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c7fa955_8964_484d_a0eb_37ac08a12fe1.slice/crio-d7a2baa96a0900e729590332d95aaaa5f98f1f0a32d786762c7ff6455038627c WatchSource:0}: Error finding container d7a2baa96a0900e729590332d95aaaa5f98f1f0a32d786762c7ff6455038627c: Status 404 returned error can't find the container with id d7a2baa96a0900e729590332d95aaaa5f98f1f0a32d786762c7ff6455038627c Jul 14 11:39:51.673696 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:51.673677 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d64689769-x9qwz"] Jul 14 11:39:51.683622 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:39:51.683595 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda82bc27a_4025_4bfa_b653_526605543465.slice/crio-62ec357bc9901f7c12a060385ffaf7c53eed6f77c613f69084b3efc7a29ae8c3 WatchSource:0}: Error finding container 62ec357bc9901f7c12a060385ffaf7c53eed6f77c613f69084b3efc7a29ae8c3: Status 404 returned error can't find the container with id 62ec357bc9901f7c12a060385ffaf7c53eed6f77c613f69084b3efc7a29ae8c3 Jul 14 11:39:51.832292 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:51.832253 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c9wxm" event={"ID":"8c7fa955-8964-484d-a0eb-37ac08a12fe1","Type":"ContainerStarted","Data":"d7a2baa96a0900e729590332d95aaaa5f98f1f0a32d786762c7ff6455038627c"} Jul 14 11:39:51.834410 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:51.834379 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dcw2c" event={"ID":"4df7bd22-061c-44c2-bb65-63e702106cd9","Type":"ContainerStarted","Data":"a6bc5060b711eabb95830c7c66bff70b0edcadce203f52d65d395895237c5a17"} Jul 14 11:39:51.834537 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:51.834435 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dcw2c" event={"ID":"4df7bd22-061c-44c2-bb65-63e702106cd9","Type":"ContainerStarted","Data":"3206f1870d311bd3469ef2544861fd0964cc911d6bd11538dc2ccb4a4d4d5041"} Jul 14 11:39:51.835854 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:51.835828 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-rz5tl" event={"ID":"a3187fd3-a613-4c7d-8ded-8945d186d2ac","Type":"ContainerStarted","Data":"0dbcf40e12e5b42952efae5ff590715ff0379dda8e1889d32c39fd5db9856d47"} Jul 14 11:39:51.835985 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:51.835880 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-rz5tl" Jul 14 11:39:51.837051 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:51.837018 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" event={"ID":"a82bc27a-4025-4bfa-b653-526605543465","Type":"ContainerStarted","Data":"62ec357bc9901f7c12a060385ffaf7c53eed6f77c613f69084b3efc7a29ae8c3"} Jul 14 11:39:51.837487 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:51.837465 2582 patch_prober.go:28] interesting pod/downloads-68c9cbb497-rz5tl container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.14:8080/\": dial tcp 10.134.0.14:8080: connect: connection refused" start-of-body= Jul 14 11:39:51.837576 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:51.837517 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-68c9cbb497-rz5tl" podUID="a3187fd3-a613-4c7d-8ded-8945d186d2ac" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.14:8080/\": dial tcp 10.134.0.14:8080: connect: connection refused" Jul 14 11:39:51.838119 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:51.838081 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" event={"ID":"3aeb72b6-36bf-4532-9420-1dc39f65246c","Type":"ContainerStarted","Data":"eed15b3084c923f6641179d68a039c3fd7ab60863e1191f55f7a3766e65f162e"} Jul 14 11:39:51.856029 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:51.855980 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dcw2c" podStartSLOduration=9.266198699 podStartE2EDuration="10.855965225s" totalImagesPullingTime="1.477710439s" totalInitContainerRuntime="112.056087ms" isStatefulPod=true podCreationTimestamp="2026-07-14 11:39:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:39:51.854778015 +0000 UTC m=+122.217429333" watchObservedRunningTime="2026-07-14 11:39:51.855965225 +0000 UTC m=+122.218616529" Jul 14 11:39:51.873658 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:51.873605 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-rz5tl" podStartSLOduration=2.8881187 podStartE2EDuration="20.873586973s" totalImagesPullingTime="17.985468273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:39:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:39:51.872698974 +0000 UTC m=+122.235350280" watchObservedRunningTime="2026-07-14 11:39:51.873586973 +0000 UTC m=+122.236238312" Jul 14 11:39:51.898157 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:51.898131 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b7954cd4c-mtjwn"] Jul 14 11:39:51.900897 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:39:51.900850 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb841bef_5d01_4a1c_bb2b_737826834bd5.slice/crio-024679b11d2df8a0da67be7bc1e879253958b42ac9b882700309154ca33cc7fc WatchSource:0}: Error finding container 024679b11d2df8a0da67be7bc1e879253958b42ac9b882700309154ca33cc7fc: Status 404 returned error can't find the container with id 024679b11d2df8a0da67be7bc1e879253958b42ac9b882700309154ca33cc7fc Jul 14 11:39:51.901534 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:51.901437 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6fd85b8888-kwb5f"] Jul 14 11:39:51.904068 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:39:51.904043 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6418eecb_846e_448e_9d2c_a41f67b09ce4.slice/crio-7aa17b062015150129b93172084caa607e61e3d3069f91d51214c4107f7b8e75 WatchSource:0}: Error finding container 7aa17b062015150129b93172084caa607e61e3d3069f91d51214c4107f7b8e75: Status 404 returned error can't find the container with id 7aa17b062015150129b93172084caa607e61e3d3069f91d51214c4107f7b8e75 Jul 14 11:39:51.912493 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:51.912474 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 11:39:51.913876 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:39:51.913855 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd4bea28_931c_4047_a97a_c5d82a935fa4.slice/crio-e12f95d99d5e00e30684caf8d3f20091292e174dfb5070231baf32cd1215a3ec WatchSource:0}: Error finding container e12f95d99d5e00e30684caf8d3f20091292e174dfb5070231baf32cd1215a3ec: Status 404 returned error can't find the container with id e12f95d99d5e00e30684caf8d3f20091292e174dfb5070231baf32cd1215a3ec Jul 14 11:39:52.043893 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:52.043853 2582 patch_prober.go:28] interesting pod/downloads-68c9cbb497-rz5tl container/download-server namespace/openshift-console: Liveness probe status=failure output="Get \"http://10.134.0.14:8080/\": dial tcp 10.134.0.14:8080: connect: connection refused" start-of-body= Jul 14 11:39:52.044063 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:52.043928 2582 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-console/downloads-68c9cbb497-rz5tl" podUID="a3187fd3-a613-4c7d-8ded-8945d186d2ac" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.14:8080/\": dial tcp 10.134.0.14:8080: connect: connection refused" Jul 14 11:39:52.850475 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:52.850340 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b7954cd4c-mtjwn" event={"ID":"eb841bef-5d01-4a1c-bb2b-737826834bd5","Type":"ContainerStarted","Data":"024679b11d2df8a0da67be7bc1e879253958b42ac9b882700309154ca33cc7fc"} Jul 14 11:39:52.858835 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:52.858789 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" event={"ID":"6418eecb-846e-448e-9d2c-a41f67b09ce4","Type":"ContainerStarted","Data":"7aa17b062015150129b93172084caa607e61e3d3069f91d51214c4107f7b8e75"} Jul 14 11:39:52.863857 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:52.861737 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd4bea28-931c-4047-a97a-c5d82a935fa4","Type":"ContainerStarted","Data":"e12f95d99d5e00e30684caf8d3f20091292e174dfb5070231baf32cd1215a3ec"} Jul 14 11:39:52.870697 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:52.870521 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-rz5tl" Jul 14 11:39:59.906000 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:59.905932 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b7954cd4c-mtjwn" event={"ID":"eb841bef-5d01-4a1c-bb2b-737826834bd5","Type":"ContainerStarted","Data":"d45ea6fe5b47a145b89c14aa19b9261b405b7828f6b13ad4302a38b3a872b653"} Jul 14 11:39:59.909014 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:59.908519 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" event={"ID":"6418eecb-846e-448e-9d2c-a41f67b09ce4","Type":"ContainerStarted","Data":"a50a2e70d83a4a995b79bbacc57d488414ae460f326de485f459494e99872084"} Jul 14 11:39:59.911720 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:59.911692 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" event={"ID":"a82bc27a-4025-4bfa-b653-526605543465","Type":"ContainerStarted","Data":"5bb2383796b8428aacb69004192c111b44ba622c7a361f9768b1213bda48f55d"} Jul 14 11:39:59.911939 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:59.911921 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" event={"ID":"a82bc27a-4025-4bfa-b653-526605543465","Type":"ContainerStarted","Data":"9eb0ac5a1984d6fb03da129013917a767dca0160bc356424edeada1fbbef07c1"} Jul 14 11:39:59.913503 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:59.913391 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" event={"ID":"3aeb72b6-36bf-4532-9420-1dc39f65246c","Type":"ContainerStarted","Data":"fb3d951737a84237117bf79039006a6b16464966d36499d415d7ae172dca41c5"} Jul 14 11:39:59.915198 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:59.915177 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c9wxm" event={"ID":"8c7fa955-8964-484d-a0eb-37ac08a12fe1","Type":"ContainerStarted","Data":"ca893631490d02339d44cac4bad62780989ae2159d2594961d72fa33482c4c34"} Jul 14 11:39:59.915815 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:59.915774 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c9wxm" Jul 14 11:39:59.918599 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:59.918452 2582 generic.go:356] "Generic (PLEG): container finished" podID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerID="07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8" exitCode=0 Jul 14 11:39:59.918599 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:59.918532 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd4bea28-931c-4047-a97a-c5d82a935fa4","Type":"ContainerDied","Data":"07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8"} Jul 14 11:39:59.923075 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:59.923016 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c9wxm" Jul 14 11:39:59.937312 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:39:59.935702 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b7954cd4c-mtjwn" podStartSLOduration=6.301061389 podStartE2EDuration="13.935680364s" totalImagesPullingTime="7.634618975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:39:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:39:59.934396847 +0000 UTC m=+130.297048163" watchObservedRunningTime="2026-07-14 11:39:59.935680364 +0000 UTC m=+130.298331669" Jul 14 11:40:00.000507 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:00.000454 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c9wxm" podStartSLOduration=6.3714750030000005 podStartE2EDuration="14.000432696s" totalImagesPullingTime="7.628957693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:39:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:39:59.99827693 +0000 UTC m=+130.360928235" watchObservedRunningTime="2026-07-14 11:40:00.000432696 +0000 UTC m=+130.363084002" Jul 14 11:40:00.001169 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:00.001136 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" podStartSLOduration=7.373689215 podStartE2EDuration="15.001125615s" totalImagesPullingTime="7.6274364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:39:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:39:59.974342456 +0000 UTC m=+130.336993761" watchObservedRunningTime="2026-07-14 11:40:00.001125615 +0000 UTC m=+130.363776943" Jul 14 11:40:00.064569 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:00.060369 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d1625cf-fd45-4ff6-9571-9220ac046239-metrics-certs\") pod \"network-metrics-daemon-gphmx\" (UID: \"2d1625cf-fd45-4ff6-9571-9220ac046239\") " pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:40:00.065567 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:00.065534 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d1625cf-fd45-4ff6-9571-9220ac046239-metrics-certs\") pod \"network-metrics-daemon-gphmx\" (UID: \"2d1625cf-fd45-4ff6-9571-9220ac046239\") " pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:40:00.112747 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:00.112707 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-26j7k\"" Jul 14 11:40:00.120366 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:00.120329 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gphmx" Jul 14 11:40:00.328420 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:00.328341 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gphmx"] Jul 14 11:40:00.332538 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:40:00.332500 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d1625cf_fd45_4ff6_9571_9220ac046239.slice/crio-49a4177afce398b561d2ca3bf47fe1e23630c9333aebc8ba7fda6c18a3e6d0c8 WatchSource:0}: Error finding container 49a4177afce398b561d2ca3bf47fe1e23630c9333aebc8ba7fda6c18a3e6d0c8: Status 404 returned error can't find the container with id 49a4177afce398b561d2ca3bf47fe1e23630c9333aebc8ba7fda6c18a3e6d0c8 Jul 14 11:40:00.926475 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:00.926334 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gphmx" event={"ID":"2d1625cf-fd45-4ff6-9571-9220ac046239","Type":"ContainerStarted","Data":"49a4177afce398b561d2ca3bf47fe1e23630c9333aebc8ba7fda6c18a3e6d0c8"} Jul 14 11:40:00.930237 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:00.930132 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" event={"ID":"a82bc27a-4025-4bfa-b653-526605543465","Type":"ContainerStarted","Data":"a539503676f967db2771a139bce2da81c8417753a5f8cecdb65dd54138ae3417"} Jul 14 11:40:00.935307 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:00.935208 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" event={"ID":"3aeb72b6-36bf-4532-9420-1dc39f65246c","Type":"ContainerStarted","Data":"d5c6870a46d6b699e6cb20956fc548376d242a0b1689c53dfc6775b41b83b421"} Jul 14 11:40:00.935307 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:00.935265 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" event={"ID":"3aeb72b6-36bf-4532-9420-1dc39f65246c","Type":"ContainerStarted","Data":"f98401066a059301eef1e74860ffe6bcfb9d3860f0415be91a255606769ece48"} Jul 14 11:40:01.942045 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:01.942004 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" event={"ID":"a82bc27a-4025-4bfa-b653-526605543465","Type":"ContainerStarted","Data":"d89cc509a44d72968f0eda4ae706da7f31b7418317785021092d1ca617d13dbb"} Jul 14 11:40:02.010078 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:02.009961 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-57c9957ccc-ph9gs" podStartSLOduration=8.126231798 podStartE2EDuration="16.009936088s" totalImagesPullingTime="7.88370429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:39:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:40:00.970337489 +0000 UTC m=+131.332988797" watchObservedRunningTime="2026-07-14 11:40:02.009936088 +0000 UTC m=+132.372587396" Jul 14 11:40:02.010444 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:02.010424 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b7954cd4c-mtjwn"] Jul 14 11:40:03.953203 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:03.953168 2582 generic.go:356] "Generic (PLEG): container finished" podID="9e885a07-b134-4b34-a639-b2f8fdcd7547" containerID="0725c68678c8cfa721839f67a8043bbccf22cdf32c30d5994df33d7587d3092f" exitCode=0 Jul 14 11:40:03.953668 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:03.953237 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vlcxr" event={"ID":"9e885a07-b134-4b34-a639-b2f8fdcd7547","Type":"ContainerDied","Data":"0725c68678c8cfa721839f67a8043bbccf22cdf32c30d5994df33d7587d3092f"} Jul 14 11:40:03.953744 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:03.953714 2582 scope.go:117] "RemoveContainer" containerID="0725c68678c8cfa721839f67a8043bbccf22cdf32c30d5994df33d7587d3092f" Jul 14 11:40:03.957551 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:03.957520 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" event={"ID":"a82bc27a-4025-4bfa-b653-526605543465","Type":"ContainerStarted","Data":"8c8e51b02300d4cc64e05308735b6eb1010e685d4b8d0250fbb36cf5d0fc3894"} Jul 14 11:40:03.957674 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:03.957581 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" event={"ID":"a82bc27a-4025-4bfa-b653-526605543465","Type":"ContainerStarted","Data":"b959a127cb83b49617751b2264017d34f3a149f295844cbb021c620e7bd6dd9b"} Jul 14 11:40:03.957930 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:03.957783 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" Jul 14 11:40:03.964583 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:03.964556 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gphmx" event={"ID":"2d1625cf-fd45-4ff6-9571-9220ac046239","Type":"ContainerStarted","Data":"e2ffc9286d732c531437aaf22defdbc75156fdaf806974b13bf54ae99f1716cb"} Jul 14 11:40:03.964674 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:03.964610 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gphmx" event={"ID":"2d1625cf-fd45-4ff6-9571-9220ac046239","Type":"ContainerStarted","Data":"b1bbd7a95895ed8be3e2414cdb88c80fe34d0d97e3e6ce263525b7e416309bc9"} Jul 14 11:40:03.968642 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:03.968603 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd4bea28-931c-4047-a97a-c5d82a935fa4","Type":"ContainerStarted","Data":"8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2"} Jul 14 11:40:03.968781 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:03.968686 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd4bea28-931c-4047-a97a-c5d82a935fa4","Type":"ContainerStarted","Data":"b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b"} Jul 14 11:40:04.000707 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:04.000622 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gphmx" podStartSLOduration=131.062934542 podStartE2EDuration="2m14.000601538s" totalImagesPullingTime="2.937666996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:37:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:40:03.999085106 +0000 UTC m=+134.361736411" watchObservedRunningTime="2026-07-14 11:40:04.000601538 +0000 UTC m=+134.363252863" Jul 14 11:40:04.028572 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:04.028510 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" podStartSLOduration=10.443506258 podStartE2EDuration="20.028485065s" totalImagesPullingTime="9.584978807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:39:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:40:04.026389485 +0000 UTC m=+134.389040817" watchObservedRunningTime="2026-07-14 11:40:04.028485065 +0000 UTC m=+134.391136370" Jul 14 11:40:04.976865 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:04.976824 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd4bea28-931c-4047-a97a-c5d82a935fa4","Type":"ContainerStarted","Data":"72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd"} Jul 14 11:40:04.977441 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:04.976923 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd4bea28-931c-4047-a97a-c5d82a935fa4","Type":"ContainerStarted","Data":"2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd"} Jul 14 11:40:04.977441 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:04.976975 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd4bea28-931c-4047-a97a-c5d82a935fa4","Type":"ContainerStarted","Data":"e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6"} Jul 14 11:40:04.977441 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:04.977019 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd4bea28-931c-4047-a97a-c5d82a935fa4","Type":"ContainerStarted","Data":"a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080"} Jul 14 11:40:04.978677 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:04.978651 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vlcxr" event={"ID":"9e885a07-b134-4b34-a639-b2f8fdcd7547","Type":"ContainerStarted","Data":"dc839645789a62f9e6a09ea2d1f2c8400711d37646e4ac053f6add27cf5fe5c4"} Jul 14 11:40:04.985814 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:04.985790 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6d64689769-x9qwz" Jul 14 11:40:05.017122 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:05.017050 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.666504782 podStartE2EDuration="18.017026223s" totalImagesPullingTime="11.331745958s" totalInitContainerRuntime="18.775483ms" isStatefulPod=false podCreationTimestamp="2026-07-14 11:39:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:40:05.015437645 +0000 UTC m=+135.378088950" watchObservedRunningTime="2026-07-14 11:40:05.017026223 +0000 UTC m=+135.379677526" Jul 14 11:40:06.082578 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:06.082533 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" Jul 14 11:40:06.082966 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:06.082642 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" Jul 14 11:40:06.511064 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:06.511028 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b7954cd4c-mtjwn" Jul 14 11:40:08.103091 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:08.103059 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:40:25.069616 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:25.069580 2582 generic.go:356] "Generic (PLEG): container finished" podID="865b8f11-fdb0-430a-93c5-aa4901f6cf08" containerID="d18e39a9f2bd6b88749b145cc392b62ddf69362a9a7fc5b5950668846baf4b27" exitCode=0 Jul 14 11:40:25.070013 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:25.069634 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-9hz66" event={"ID":"865b8f11-fdb0-430a-93c5-aa4901f6cf08","Type":"ContainerDied","Data":"d18e39a9f2bd6b88749b145cc392b62ddf69362a9a7fc5b5950668846baf4b27"} Jul 14 11:40:25.070052 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:25.070025 2582 scope.go:117] "RemoveContainer" containerID="d18e39a9f2bd6b88749b145cc392b62ddf69362a9a7fc5b5950668846baf4b27" Jul 14 11:40:26.076587 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:26.076553 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-9hz66" event={"ID":"865b8f11-fdb0-430a-93c5-aa4901f6cf08","Type":"ContainerStarted","Data":"e8dab9fddeb6e743904159ddc789a1c217b8baf65712abc7b725b198879086cd"} Jul 14 11:40:26.087923 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:26.087889 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" Jul 14 11:40:26.092138 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:26.092112 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6fd85b8888-kwb5f" Jul 14 11:40:27.037878 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:27.037828 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b7954cd4c-mtjwn" podUID="eb841bef-5d01-4a1c-bb2b-737826834bd5" containerName="console" containerID="cri-o://d45ea6fe5b47a145b89c14aa19b9261b405b7828f6b13ad4302a38b3a872b653" gracePeriod=15 Jul 14 11:40:27.325185 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:27.325150 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b7954cd4c-mtjwn" Jul 14 11:40:27.414776 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:27.414736 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb841bef-5d01-4a1c-bb2b-737826834bd5-console-config\") pod \"eb841bef-5d01-4a1c-bb2b-737826834bd5\" (UID: \"eb841bef-5d01-4a1c-bb2b-737826834bd5\") " Jul 14 11:40:27.414959 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:27.414793 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb841bef-5d01-4a1c-bb2b-737826834bd5-service-ca\") pod \"eb841bef-5d01-4a1c-bb2b-737826834bd5\" (UID: \"eb841bef-5d01-4a1c-bb2b-737826834bd5\") " Jul 14 11:40:27.414959 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:27.414825 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb841bef-5d01-4a1c-bb2b-737826834bd5-trusted-ca-bundle\") pod \"eb841bef-5d01-4a1c-bb2b-737826834bd5\" (UID: \"eb841bef-5d01-4a1c-bb2b-737826834bd5\") " Jul 14 11:40:27.414959 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:27.414874 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb841bef-5d01-4a1c-bb2b-737826834bd5-console-oauth-config\") pod \"eb841bef-5d01-4a1c-bb2b-737826834bd5\" (UID: \"eb841bef-5d01-4a1c-bb2b-737826834bd5\") " Jul 14 11:40:27.414959 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:27.414914 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb841bef-5d01-4a1c-bb2b-737826834bd5-console-serving-cert\") pod \"eb841bef-5d01-4a1c-bb2b-737826834bd5\" (UID: \"eb841bef-5d01-4a1c-bb2b-737826834bd5\") " Jul 14 11:40:27.415199 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:27.415122 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpz4x\" (UniqueName: \"kubernetes.io/projected/eb841bef-5d01-4a1c-bb2b-737826834bd5-kube-api-access-hpz4x\") pod \"eb841bef-5d01-4a1c-bb2b-737826834bd5\" (UID: \"eb841bef-5d01-4a1c-bb2b-737826834bd5\") " Jul 14 11:40:27.415199 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:27.415162 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb841bef-5d01-4a1c-bb2b-737826834bd5-oauth-serving-cert\") pod \"eb841bef-5d01-4a1c-bb2b-737826834bd5\" (UID: \"eb841bef-5d01-4a1c-bb2b-737826834bd5\") " Jul 14 11:40:27.415296 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:27.415197 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb841bef-5d01-4a1c-bb2b-737826834bd5-console-config" (OuterVolumeSpecName: "console-config") pod "eb841bef-5d01-4a1c-bb2b-737826834bd5" (UID: "eb841bef-5d01-4a1c-bb2b-737826834bd5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:40:27.415352 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:27.415309 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb841bef-5d01-4a1c-bb2b-737826834bd5-service-ca" (OuterVolumeSpecName: "service-ca") pod "eb841bef-5d01-4a1c-bb2b-737826834bd5" (UID: "eb841bef-5d01-4a1c-bb2b-737826834bd5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:40:27.415541 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:27.415503 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb841bef-5d01-4a1c-bb2b-737826834bd5-console-config\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:40:27.415541 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:27.415540 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb841bef-5d01-4a1c-bb2b-737826834bd5-service-ca\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:40:27.415719 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:27.415606 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb841bef-5d01-4a1c-bb2b-737826834bd5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "eb841bef-5d01-4a1c-bb2b-737826834bd5" (UID: "eb841bef-5d01-4a1c-bb2b-737826834bd5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:40:27.415719 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:27.415632 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb841bef-5d01-4a1c-bb2b-737826834bd5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "eb841bef-5d01-4a1c-bb2b-737826834bd5" (UID: "eb841bef-5d01-4a1c-bb2b-737826834bd5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:40:27.417375 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:27.417344 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb841bef-5d01-4a1c-bb2b-737826834bd5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "eb841bef-5d01-4a1c-bb2b-737826834bd5" (UID: "eb841bef-5d01-4a1c-bb2b-737826834bd5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:40:27.417466 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:27.417440 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb841bef-5d01-4a1c-bb2b-737826834bd5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "eb841bef-5d01-4a1c-bb2b-737826834bd5" (UID: "eb841bef-5d01-4a1c-bb2b-737826834bd5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:40:27.417519 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:27.417444 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb841bef-5d01-4a1c-bb2b-737826834bd5-kube-api-access-hpz4x" (OuterVolumeSpecName: "kube-api-access-hpz4x") pod "eb841bef-5d01-4a1c-bb2b-737826834bd5" (UID: "eb841bef-5d01-4a1c-bb2b-737826834bd5"). InnerVolumeSpecName "kube-api-access-hpz4x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:40:27.516819 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:27.516782 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb841bef-5d01-4a1c-bb2b-737826834bd5-trusted-ca-bundle\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:40:27.516819 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:27.516812 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb841bef-5d01-4a1c-bb2b-737826834bd5-console-oauth-config\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:40:27.516819 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:27.516822 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb841bef-5d01-4a1c-bb2b-737826834bd5-console-serving-cert\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:40:27.517044 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:27.516831 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpz4x\" (UniqueName: \"kubernetes.io/projected/eb841bef-5d01-4a1c-bb2b-737826834bd5-kube-api-access-hpz4x\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:40:27.517044 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:27.516843 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb841bef-5d01-4a1c-bb2b-737826834bd5-oauth-serving-cert\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:40:28.086901 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:28.086863 2582 generic.go:356] "Generic (PLEG): container finished" podID="eb841bef-5d01-4a1c-bb2b-737826834bd5" containerID="d45ea6fe5b47a145b89c14aa19b9261b405b7828f6b13ad4302a38b3a872b653" exitCode=0 Jul 14 11:40:28.087155 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:28.086914 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b7954cd4c-mtjwn" Jul 14 11:40:28.087155 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:28.086946 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b7954cd4c-mtjwn" event={"ID":"eb841bef-5d01-4a1c-bb2b-737826834bd5","Type":"ContainerDied","Data":"d45ea6fe5b47a145b89c14aa19b9261b405b7828f6b13ad4302a38b3a872b653"} Jul 14 11:40:28.087155 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:28.087000 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b7954cd4c-mtjwn" event={"ID":"eb841bef-5d01-4a1c-bb2b-737826834bd5","Type":"ContainerDied","Data":"024679b11d2df8a0da67be7bc1e879253958b42ac9b882700309154ca33cc7fc"} Jul 14 11:40:28.087155 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:28.087034 2582 scope.go:117] "RemoveContainer" containerID="d45ea6fe5b47a145b89c14aa19b9261b405b7828f6b13ad4302a38b3a872b653" Jul 14 11:40:28.096246 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:28.096228 2582 scope.go:117] "RemoveContainer" containerID="d45ea6fe5b47a145b89c14aa19b9261b405b7828f6b13ad4302a38b3a872b653" Jul 14 11:40:28.096504 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:40:28.096483 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d45ea6fe5b47a145b89c14aa19b9261b405b7828f6b13ad4302a38b3a872b653\": container with ID starting with d45ea6fe5b47a145b89c14aa19b9261b405b7828f6b13ad4302a38b3a872b653 not found: ID does not exist" containerID="d45ea6fe5b47a145b89c14aa19b9261b405b7828f6b13ad4302a38b3a872b653" Jul 14 11:40:28.096565 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:28.096512 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d45ea6fe5b47a145b89c14aa19b9261b405b7828f6b13ad4302a38b3a872b653"} err="failed to get container status \"d45ea6fe5b47a145b89c14aa19b9261b405b7828f6b13ad4302a38b3a872b653\": rpc error: code = NotFound desc = could not find container \"d45ea6fe5b47a145b89c14aa19b9261b405b7828f6b13ad4302a38b3a872b653\": container with ID starting with d45ea6fe5b47a145b89c14aa19b9261b405b7828f6b13ad4302a38b3a872b653 not found: ID does not exist" Jul 14 11:40:28.111434 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:28.111406 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b7954cd4c-mtjwn"] Jul 14 11:40:28.116732 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:28.116707 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b7954cd4c-mtjwn"] Jul 14 11:40:28.292729 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:28.292682 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb841bef-5d01-4a1c-bb2b-737826834bd5" path="/var/lib/kubelet/pods/eb841bef-5d01-4a1c-bb2b-737826834bd5/volumes" Jul 14 11:40:48.103230 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:48.103138 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:40:48.123329 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:48.123299 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:40:48.190961 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:40:48.190936 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:06.139740 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.139697 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 11:41:06.140814 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.140780 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerName="prometheus" containerID="cri-o://b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b" gracePeriod=600 Jul 14 11:41:06.141012 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.140786 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerName="kube-rbac-proxy" containerID="cri-o://2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd" gracePeriod=600 Jul 14 11:41:06.141132 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.140821 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerName="config-reloader" containerID="cri-o://8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2" gracePeriod=600 Jul 14 11:41:06.141263 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.140852 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerName="kube-rbac-proxy-web" containerID="cri-o://e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6" gracePeriod=600 Jul 14 11:41:06.141324 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.140873 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerName="kube-rbac-proxy-thanos" containerID="cri-o://72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd" gracePeriod=600 Jul 14 11:41:06.141778 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.140881 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerName="thanos-sidecar" containerID="cri-o://a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080" gracePeriod=600 Jul 14 11:41:06.391412 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.391350 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:06.459974 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.459941 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-k8s-rulefiles-1\") pod \"dd4bea28-931c-4047-a97a-c5d82a935fa4\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " Jul 14 11:41:06.459974 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.459978 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-kube-rbac-proxy\") pod \"dd4bea28-931c-4047-a97a-c5d82a935fa4\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " Jul 14 11:41:06.460262 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.459998 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-thanos-prometheus-http-client-file\") pod \"dd4bea28-931c-4047-a97a-c5d82a935fa4\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " Jul 14 11:41:06.460262 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.460028 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-metrics-client-certs\") pod \"dd4bea28-931c-4047-a97a-c5d82a935fa4\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " Jul 14 11:41:06.460262 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.460050 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-configmap-metrics-client-ca\") pod \"dd4bea28-931c-4047-a97a-c5d82a935fa4\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " Jul 14 11:41:06.460262 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.460082 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-trusted-ca-bundle\") pod \"dd4bea28-931c-4047-a97a-c5d82a935fa4\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " Jul 14 11:41:06.460262 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.460133 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-config\") pod \"dd4bea28-931c-4047-a97a-c5d82a935fa4\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " Jul 14 11:41:06.460262 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.460160 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd4bea28-931c-4047-a97a-c5d82a935fa4-tls-assets\") pod \"dd4bea28-931c-4047-a97a-c5d82a935fa4\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " Jul 14 11:41:06.460262 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.460188 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"dd4bea28-931c-4047-a97a-c5d82a935fa4\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " Jul 14 11:41:06.460262 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.460228 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-configmap-kubelet-serving-ca-bundle\") pod \"dd4bea28-931c-4047-a97a-c5d82a935fa4\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " Jul 14 11:41:06.460262 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.460255 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-k8s-rulefiles-0\") pod \"dd4bea28-931c-4047-a97a-c5d82a935fa4\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " Jul 14 11:41:06.460711 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.460289 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-k8s-rulefiles-2\") pod \"dd4bea28-931c-4047-a97a-c5d82a935fa4\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " Jul 14 11:41:06.460711 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.460328 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"dd4bea28-931c-4047-a97a-c5d82a935fa4\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " Jul 14 11:41:06.460711 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.460366 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-grpc-tls\") pod \"dd4bea28-931c-4047-a97a-c5d82a935fa4\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " Jul 14 11:41:06.460711 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.460396 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd4bea28-931c-4047-a97a-c5d82a935fa4-config-out\") pod \"dd4bea28-931c-4047-a97a-c5d82a935fa4\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " Jul 14 11:41:06.460711 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.460431 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-configmap-serving-certs-ca-bundle\") pod \"dd4bea28-931c-4047-a97a-c5d82a935fa4\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " Jul 14 11:41:06.460711 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.460436 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "dd4bea28-931c-4047-a97a-c5d82a935fa4" (UID: "dd4bea28-931c-4047-a97a-c5d82a935fa4"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:41:06.460711 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.460476 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-web-config\") pod \"dd4bea28-931c-4047-a97a-c5d82a935fa4\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " Jul 14 11:41:06.460711 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.460505 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-prometheus-k8s-tls\") pod \"dd4bea28-931c-4047-a97a-c5d82a935fa4\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " Jul 14 11:41:06.460711 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.460532 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-k8s-db\") pod \"dd4bea28-931c-4047-a97a-c5d82a935fa4\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " Jul 14 11:41:06.460711 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.460568 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wng7j\" (UniqueName: \"kubernetes.io/projected/dd4bea28-931c-4047-a97a-c5d82a935fa4-kube-api-access-wng7j\") pod \"dd4bea28-931c-4047-a97a-c5d82a935fa4\" (UID: \"dd4bea28-931c-4047-a97a-c5d82a935fa4\") " Jul 14 11:41:06.461218 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.460893 2582 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-configmap-metrics-client-ca\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:41:06.461277 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.461230 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "dd4bea28-931c-4047-a97a-c5d82a935fa4" (UID: "dd4bea28-931c-4047-a97a-c5d82a935fa4"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:41:06.462198 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.462166 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "dd4bea28-931c-4047-a97a-c5d82a935fa4" (UID: "dd4bea28-931c-4047-a97a-c5d82a935fa4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:41:06.462359 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.462336 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "dd4bea28-931c-4047-a97a-c5d82a935fa4" (UID: "dd4bea28-931c-4047-a97a-c5d82a935fa4"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:41:06.462839 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.462811 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "dd4bea28-931c-4047-a97a-c5d82a935fa4" (UID: "dd4bea28-931c-4047-a97a-c5d82a935fa4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:41:06.462975 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.462946 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "dd4bea28-931c-4047-a97a-c5d82a935fa4" (UID: "dd4bea28-931c-4047-a97a-c5d82a935fa4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:41:06.464273 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.463566 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "dd4bea28-931c-4047-a97a-c5d82a935fa4" (UID: "dd4bea28-931c-4047-a97a-c5d82a935fa4"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:41:06.464273 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.463942 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "dd4bea28-931c-4047-a97a-c5d82a935fa4" (UID: "dd4bea28-931c-4047-a97a-c5d82a935fa4"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:41:06.464273 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.463937 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "dd4bea28-931c-4047-a97a-c5d82a935fa4" (UID: "dd4bea28-931c-4047-a97a-c5d82a935fa4"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:41:06.464273 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.464008 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd4bea28-931c-4047-a97a-c5d82a935fa4-kube-api-access-wng7j" (OuterVolumeSpecName: "kube-api-access-wng7j") pod "dd4bea28-931c-4047-a97a-c5d82a935fa4" (UID: "dd4bea28-931c-4047-a97a-c5d82a935fa4"). InnerVolumeSpecName "kube-api-access-wng7j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:41:06.464797 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.464766 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "dd4bea28-931c-4047-a97a-c5d82a935fa4" (UID: "dd4bea28-931c-4047-a97a-c5d82a935fa4"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:41:06.465195 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.465160 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "dd4bea28-931c-4047-a97a-c5d82a935fa4" (UID: "dd4bea28-931c-4047-a97a-c5d82a935fa4"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:41:06.465722 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.465696 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd4bea28-931c-4047-a97a-c5d82a935fa4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "dd4bea28-931c-4047-a97a-c5d82a935fa4" (UID: "dd4bea28-931c-4047-a97a-c5d82a935fa4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:41:06.465908 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.465889 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "dd4bea28-931c-4047-a97a-c5d82a935fa4" (UID: "dd4bea28-931c-4047-a97a-c5d82a935fa4"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:41:06.466378 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.466342 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-config" (OuterVolumeSpecName: "config") pod "dd4bea28-931c-4047-a97a-c5d82a935fa4" (UID: "dd4bea28-931c-4047-a97a-c5d82a935fa4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:41:06.466466 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.466443 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "dd4bea28-931c-4047-a97a-c5d82a935fa4" (UID: "dd4bea28-931c-4047-a97a-c5d82a935fa4"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:41:06.468975 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.468367 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd4bea28-931c-4047-a97a-c5d82a935fa4-config-out" (OuterVolumeSpecName: "config-out") pod "dd4bea28-931c-4047-a97a-c5d82a935fa4" (UID: "dd4bea28-931c-4047-a97a-c5d82a935fa4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:41:06.468975 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.468372 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "dd4bea28-931c-4047-a97a-c5d82a935fa4" (UID: "dd4bea28-931c-4047-a97a-c5d82a935fa4"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:41:06.468975 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.468392 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "dd4bea28-931c-4047-a97a-c5d82a935fa4" (UID: "dd4bea28-931c-4047-a97a-c5d82a935fa4"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:41:06.479835 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.479798 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-web-config" (OuterVolumeSpecName: "web-config") pod "dd4bea28-931c-4047-a97a-c5d82a935fa4" (UID: "dd4bea28-931c-4047-a97a-c5d82a935fa4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:41:06.561984 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.561945 2582 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:41:06.561984 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.561977 2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-web-config\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:41:06.561984 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.561992 2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:41:06.562284 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.562005 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-k8s-db\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:41:06.562284 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.562016 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wng7j\" (UniqueName: \"kubernetes.io/projected/dd4bea28-931c-4047-a97a-c5d82a935fa4-kube-api-access-wng7j\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:41:06.562284 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.562027 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:41:06.562284 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.562038 2582 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-kube-rbac-proxy\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:41:06.562284 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.562050 2582 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:41:06.562284 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.562063 2582 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-metrics-client-certs\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:41:06.562284 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.562075 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:41:06.562284 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.562087 2582 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-config\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:41:06.562284 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.562127 2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd4bea28-931c-4047-a97a-c5d82a935fa4-tls-assets\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:41:06.562284 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.562140 2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:41:06.562284 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.562152 2582 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:41:06.562284 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.562165 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:41:06.562284 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.562177 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dd4bea28-931c-4047-a97a-c5d82a935fa4-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:41:06.562284 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.562189 2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:41:06.562284 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.562203 2582 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dd4bea28-931c-4047-a97a-c5d82a935fa4-secret-grpc-tls\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:41:06.562284 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:06.562217 2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd4bea28-931c-4047-a97a-c5d82a935fa4-config-out\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:41:07.253285 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.253253 2582 generic.go:356] "Generic (PLEG): container finished" podID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerID="72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd" exitCode=0 Jul 14 11:41:07.253285 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.253279 2582 generic.go:356] "Generic (PLEG): container finished" podID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerID="2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd" exitCode=0 Jul 14 11:41:07.253285 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.253286 2582 generic.go:356] "Generic (PLEG): container finished" podID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerID="e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6" exitCode=0 Jul 14 11:41:07.253285 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.253292 2582 generic.go:356] "Generic (PLEG): container finished" podID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerID="a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080" exitCode=0 Jul 14 11:41:07.253285 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.253297 2582 generic.go:356] "Generic (PLEG): container finished" podID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerID="8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2" exitCode=0 Jul 14 11:41:07.253834 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.253304 2582 generic.go:356] "Generic (PLEG): container finished" podID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerID="b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b" exitCode=0 Jul 14 11:41:07.253834 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.253331 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.253834 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.253339 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd4bea28-931c-4047-a97a-c5d82a935fa4","Type":"ContainerDied","Data":"72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd"} Jul 14 11:41:07.253834 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.253411 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd4bea28-931c-4047-a97a-c5d82a935fa4","Type":"ContainerDied","Data":"2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd"} Jul 14 11:41:07.253834 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.253438 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd4bea28-931c-4047-a97a-c5d82a935fa4","Type":"ContainerDied","Data":"e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6"} Jul 14 11:41:07.253834 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.253465 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd4bea28-931c-4047-a97a-c5d82a935fa4","Type":"ContainerDied","Data":"a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080"} Jul 14 11:41:07.253834 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.253478 2582 scope.go:117] "RemoveContainer" containerID="72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd" Jul 14 11:41:07.253834 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.253489 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd4bea28-931c-4047-a97a-c5d82a935fa4","Type":"ContainerDied","Data":"8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2"} Jul 14 11:41:07.253834 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.253512 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd4bea28-931c-4047-a97a-c5d82a935fa4","Type":"ContainerDied","Data":"b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b"} Jul 14 11:41:07.253834 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.253536 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd4bea28-931c-4047-a97a-c5d82a935fa4","Type":"ContainerDied","Data":"e12f95d99d5e00e30684caf8d3f20091292e174dfb5070231baf32cd1215a3ec"} Jul 14 11:41:07.262656 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.262632 2582 scope.go:117] "RemoveContainer" containerID="2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd" Jul 14 11:41:07.270206 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.270184 2582 scope.go:117] "RemoveContainer" containerID="e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6" Jul 14 11:41:07.277712 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.277686 2582 scope.go:117] "RemoveContainer" containerID="a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080" Jul 14 11:41:07.281750 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.281703 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 11:41:07.286737 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.286715 2582 scope.go:117] "RemoveContainer" containerID="8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2" Jul 14 11:41:07.288537 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.288511 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 11:41:07.294079 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.294060 2582 scope.go:117] "RemoveContainer" containerID="b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b" Jul 14 11:41:07.302029 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.302005 2582 scope.go:117] "RemoveContainer" containerID="07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8" Jul 14 11:41:07.309309 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.309291 2582 scope.go:117] "RemoveContainer" containerID="72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd" Jul 14 11:41:07.309574 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:41:07.309552 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd\": container with ID starting with 72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd not found: ID does not exist" containerID="72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd" Jul 14 11:41:07.309624 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.309583 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd"} err="failed to get container status \"72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd\": rpc error: code = NotFound desc = could not find container \"72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd\": container with ID starting with 72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd not found: ID does not exist" Jul 14 11:41:07.309624 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.309605 2582 scope.go:117] "RemoveContainer" containerID="2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd" Jul 14 11:41:07.309853 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:41:07.309829 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd\": container with ID starting with 2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd not found: ID does not exist" containerID="2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd" Jul 14 11:41:07.309916 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.309862 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd"} err="failed to get container status \"2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd\": rpc error: code = NotFound desc = could not find container \"2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd\": container with ID starting with 2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd not found: ID does not exist" Jul 14 11:41:07.309916 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.309886 2582 scope.go:117] "RemoveContainer" containerID="e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6" Jul 14 11:41:07.310156 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:41:07.310134 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6\": container with ID starting with e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6 not found: ID does not exist" containerID="e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6" Jul 14 11:41:07.310261 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.310160 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6"} err="failed to get container status \"e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6\": rpc error: code = NotFound desc = could not find container \"e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6\": container with ID starting with e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6 not found: ID does not exist" Jul 14 11:41:07.310261 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.310175 2582 scope.go:117] "RemoveContainer" containerID="a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080" Jul 14 11:41:07.310418 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:41:07.310401 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080\": container with ID starting with a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080 not found: ID does not exist" containerID="a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080" Jul 14 11:41:07.310456 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.310422 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080"} err="failed to get container status \"a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080\": rpc error: code = NotFound desc = could not find container \"a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080\": container with ID starting with a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080 not found: ID does not exist" Jul 14 11:41:07.310456 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.310436 2582 scope.go:117] "RemoveContainer" containerID="8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2" Jul 14 11:41:07.310655 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:41:07.310640 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2\": container with ID starting with 8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2 not found: ID does not exist" containerID="8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2" Jul 14 11:41:07.310694 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.310658 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2"} err="failed to get container status \"8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2\": rpc error: code = NotFound desc = could not find container \"8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2\": container with ID starting with 8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2 not found: ID does not exist" Jul 14 11:41:07.310694 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.310672 2582 scope.go:117] "RemoveContainer" containerID="b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b" Jul 14 11:41:07.310878 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:41:07.310860 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b\": container with ID starting with b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b not found: ID does not exist" containerID="b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b" Jul 14 11:41:07.310921 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.310883 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b"} err="failed to get container status \"b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b\": rpc error: code = NotFound desc = could not find container \"b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b\": container with ID starting with b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b not found: ID does not exist" Jul 14 11:41:07.310921 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.310899 2582 scope.go:117] "RemoveContainer" containerID="07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8" Jul 14 11:41:07.311080 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:41:07.311065 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8\": container with ID starting with 07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8 not found: ID does not exist" containerID="07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8" Jul 14 11:41:07.311158 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.311083 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8"} err="failed to get container status \"07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8\": rpc error: code = NotFound desc = could not find container \"07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8\": container with ID starting with 07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8 not found: ID does not exist" Jul 14 11:41:07.311158 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.311111 2582 scope.go:117] "RemoveContainer" containerID="72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd" Jul 14 11:41:07.311366 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.311349 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd"} err="failed to get container status \"72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd\": rpc error: code = NotFound desc = could not find container \"72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd\": container with ID starting with 72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd not found: ID does not exist" Jul 14 11:41:07.311415 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.311366 2582 scope.go:117] "RemoveContainer" containerID="2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd" Jul 14 11:41:07.311570 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.311554 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd"} err="failed to get container status \"2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd\": rpc error: code = NotFound desc = could not find container \"2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd\": container with ID starting with 2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd not found: ID does not exist" Jul 14 11:41:07.311613 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.311571 2582 scope.go:117] "RemoveContainer" containerID="e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6" Jul 14 11:41:07.311794 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.311768 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6"} err="failed to get container status \"e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6\": rpc error: code = NotFound desc = could not find container \"e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6\": container with ID starting with e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6 not found: ID does not exist" Jul 14 11:41:07.311794 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.311789 2582 scope.go:117] "RemoveContainer" containerID="a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080" Jul 14 11:41:07.311975 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.311955 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080"} err="failed to get container status \"a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080\": rpc error: code = NotFound desc = could not find container \"a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080\": container with ID starting with a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080 not found: ID does not exist" Jul 14 11:41:07.312013 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.311979 2582 scope.go:117] "RemoveContainer" containerID="8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2" Jul 14 11:41:07.312237 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.312218 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2"} err="failed to get container status \"8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2\": rpc error: code = NotFound desc = could not find container \"8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2\": container with ID starting with 8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2 not found: ID does not exist" Jul 14 11:41:07.312291 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.312237 2582 scope.go:117] "RemoveContainer" containerID="b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b" Jul 14 11:41:07.312465 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.312445 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b"} err="failed to get container status \"b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b\": rpc error: code = NotFound desc = could not find container \"b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b\": container with ID starting with b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b not found: ID does not exist" Jul 14 11:41:07.312505 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.312466 2582 scope.go:117] "RemoveContainer" containerID="07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8" Jul 14 11:41:07.312701 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.312680 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8"} err="failed to get container status \"07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8\": rpc error: code = NotFound desc = could not find container \"07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8\": container with ID starting with 07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8 not found: ID does not exist" Jul 14 11:41:07.312740 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.312703 2582 scope.go:117] "RemoveContainer" containerID="72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd" Jul 14 11:41:07.312954 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.312931 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd"} err="failed to get container status \"72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd\": rpc error: code = NotFound desc = could not find container \"72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd\": container with ID starting with 72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd not found: ID does not exist" Jul 14 11:41:07.312954 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.312957 2582 scope.go:117] "RemoveContainer" containerID="2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd" Jul 14 11:41:07.313201 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.313184 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd"} err="failed to get container status \"2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd\": rpc error: code = NotFound desc = could not find container \"2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd\": container with ID starting with 2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd not found: ID does not exist" Jul 14 11:41:07.313252 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.313202 2582 scope.go:117] "RemoveContainer" containerID="e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6" Jul 14 11:41:07.313408 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.313393 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6"} err="failed to get container status \"e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6\": rpc error: code = NotFound desc = could not find container \"e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6\": container with ID starting with e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6 not found: ID does not exist" Jul 14 11:41:07.313448 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.313409 2582 scope.go:117] "RemoveContainer" containerID="a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080" Jul 14 11:41:07.313617 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.313597 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080"} err="failed to get container status \"a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080\": rpc error: code = NotFound desc = could not find container \"a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080\": container with ID starting with a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080 not found: ID does not exist" Jul 14 11:41:07.313659 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.313619 2582 scope.go:117] "RemoveContainer" containerID="8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2" Jul 14 11:41:07.313814 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.313799 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2"} err="failed to get container status \"8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2\": rpc error: code = NotFound desc = could not find container \"8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2\": container with ID starting with 8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2 not found: ID does not exist" Jul 14 11:41:07.313856 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.313814 2582 scope.go:117] "RemoveContainer" containerID="b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b" Jul 14 11:41:07.314038 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.314022 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b"} err="failed to get container status \"b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b\": rpc error: code = NotFound desc = could not find container \"b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b\": container with ID starting with b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b not found: ID does not exist" Jul 14 11:41:07.314081 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.314039 2582 scope.go:117] "RemoveContainer" containerID="07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8" Jul 14 11:41:07.314257 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.314235 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8"} err="failed to get container status \"07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8\": rpc error: code = NotFound desc = could not find container \"07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8\": container with ID starting with 07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8 not found: ID does not exist" Jul 14 11:41:07.314257 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.314252 2582 scope.go:117] "RemoveContainer" containerID="72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd" Jul 14 11:41:07.314525 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.314442 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd"} err="failed to get container status \"72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd\": rpc error: code = NotFound desc = could not find container \"72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd\": container with ID starting with 72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd not found: ID does not exist" Jul 14 11:41:07.314525 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.314470 2582 scope.go:117] "RemoveContainer" containerID="2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd" Jul 14 11:41:07.314749 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.314722 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd"} err="failed to get container status \"2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd\": rpc error: code = NotFound desc = could not find container \"2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd\": container with ID starting with 2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd not found: ID does not exist" Jul 14 11:41:07.314749 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.314746 2582 scope.go:117] "RemoveContainer" containerID="e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6" Jul 14 11:41:07.315041 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.315018 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6"} err="failed to get container status \"e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6\": rpc error: code = NotFound desc = could not find container \"e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6\": container with ID starting with e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6 not found: ID does not exist" Jul 14 11:41:07.315140 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.315041 2582 scope.go:117] "RemoveContainer" containerID="a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080" Jul 14 11:41:07.315369 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.315346 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080"} err="failed to get container status \"a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080\": rpc error: code = NotFound desc = could not find container \"a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080\": container with ID starting with a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080 not found: ID does not exist" Jul 14 11:41:07.315369 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.315370 2582 scope.go:117] "RemoveContainer" containerID="8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2" Jul 14 11:41:07.315812 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.315605 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2"} err="failed to get container status \"8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2\": rpc error: code = NotFound desc = could not find container \"8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2\": container with ID starting with 8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2 not found: ID does not exist" Jul 14 11:41:07.315812 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.315630 2582 scope.go:117] "RemoveContainer" containerID="b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b" Jul 14 11:41:07.315951 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.315865 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b"} err="failed to get container status \"b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b\": rpc error: code = NotFound desc = could not find container \"b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b\": container with ID starting with b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b not found: ID does not exist" Jul 14 11:41:07.315951 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.315883 2582 scope.go:117] "RemoveContainer" containerID="07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8" Jul 14 11:41:07.316143 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.316124 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8"} err="failed to get container status \"07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8\": rpc error: code = NotFound desc = could not find container \"07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8\": container with ID starting with 07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8 not found: ID does not exist" Jul 14 11:41:07.316143 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.316143 2582 scope.go:117] "RemoveContainer" containerID="72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd" Jul 14 11:41:07.316340 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.316323 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd"} err="failed to get container status \"72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd\": rpc error: code = NotFound desc = could not find container \"72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd\": container with ID starting with 72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd not found: ID does not exist" Jul 14 11:41:07.316378 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.316342 2582 scope.go:117] "RemoveContainer" containerID="2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd" Jul 14 11:41:07.316516 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.316502 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd"} err="failed to get container status \"2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd\": rpc error: code = NotFound desc = could not find container \"2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd\": container with ID starting with 2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd not found: ID does not exist" Jul 14 11:41:07.316560 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.316516 2582 scope.go:117] "RemoveContainer" containerID="e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6" Jul 14 11:41:07.316753 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.316736 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6"} err="failed to get container status \"e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6\": rpc error: code = NotFound desc = could not find container \"e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6\": container with ID starting with e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6 not found: ID does not exist" Jul 14 11:41:07.316791 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.316753 2582 scope.go:117] "RemoveContainer" containerID="a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080" Jul 14 11:41:07.316911 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.316896 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 11:41:07.316992 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.316977 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080"} err="failed to get container status \"a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080\": rpc error: code = NotFound desc = could not find container \"a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080\": container with ID starting with a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080 not found: ID does not exist" Jul 14 11:41:07.317027 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.316993 2582 scope.go:117] "RemoveContainer" containerID="8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2" Jul 14 11:41:07.317221 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317205 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2"} err="failed to get container status \"8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2\": rpc error: code = NotFound desc = could not find container \"8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2\": container with ID starting with 8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2 not found: ID does not exist" Jul 14 11:41:07.317275 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317222 2582 scope.go:117] "RemoveContainer" containerID="b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b" Jul 14 11:41:07.317275 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317259 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerName="prometheus" Jul 14 11:41:07.317367 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317274 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerName="prometheus" Jul 14 11:41:07.317367 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317287 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerName="config-reloader" Jul 14 11:41:07.317367 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317293 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerName="config-reloader" Jul 14 11:41:07.317367 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317300 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerName="thanos-sidecar" Jul 14 11:41:07.317367 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317305 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerName="thanos-sidecar" Jul 14 11:41:07.317367 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317322 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerName="kube-rbac-proxy-web" Jul 14 11:41:07.317367 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317331 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerName="kube-rbac-proxy-web" Jul 14 11:41:07.317367 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317344 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerName="kube-rbac-proxy" Jul 14 11:41:07.317367 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317352 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerName="kube-rbac-proxy" Jul 14 11:41:07.317367 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317361 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerName="init-config-reloader" Jul 14 11:41:07.317367 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317367 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerName="init-config-reloader" Jul 14 11:41:07.317710 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317385 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerName="kube-rbac-proxy-thanos" Jul 14 11:41:07.317710 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317394 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerName="kube-rbac-proxy-thanos" Jul 14 11:41:07.317710 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317404 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb841bef-5d01-4a1c-bb2b-737826834bd5" containerName="console" Jul 14 11:41:07.317710 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317403 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b"} err="failed to get container status \"b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b\": rpc error: code = NotFound desc = could not find container \"b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b\": container with ID starting with b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b not found: ID does not exist" Jul 14 11:41:07.317710 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317422 2582 scope.go:117] "RemoveContainer" containerID="07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8" Jul 14 11:41:07.317710 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317409 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb841bef-5d01-4a1c-bb2b-737826834bd5" containerName="console" Jul 14 11:41:07.317710 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317583 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerName="thanos-sidecar" Jul 14 11:41:07.317710 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317596 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerName="kube-rbac-proxy-thanos" Jul 14 11:41:07.317710 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317605 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerName="config-reloader" Jul 14 11:41:07.317710 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317616 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerName="prometheus" Jul 14 11:41:07.317710 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317625 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerName="kube-rbac-proxy-web" Jul 14 11:41:07.317710 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317632 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb841bef-5d01-4a1c-bb2b-737826834bd5" containerName="console" Jul 14 11:41:07.317710 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317639 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd4bea28-931c-4047-a97a-c5d82a935fa4" containerName="kube-rbac-proxy" Jul 14 11:41:07.317710 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317657 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8"} err="failed to get container status \"07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8\": rpc error: code = NotFound desc = could not find container \"07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8\": container with ID starting with 07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8 not found: ID does not exist" Jul 14 11:41:07.317710 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317673 2582 scope.go:117] "RemoveContainer" containerID="72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd" Jul 14 11:41:07.318300 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317856 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd"} err="failed to get container status \"72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd\": rpc error: code = NotFound desc = could not find container \"72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd\": container with ID starting with 72972dd36b8524346f8e8c2189871a6533985088592496cae4d4177e2d3c73bd not found: ID does not exist" Jul 14 11:41:07.318300 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.317869 2582 scope.go:117] "RemoveContainer" containerID="2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd" Jul 14 11:41:07.318300 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.318063 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd"} err="failed to get container status \"2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd\": rpc error: code = NotFound desc = could not find container \"2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd\": container with ID starting with 2b752d378ce1b7b23f1f5485445801b526a18896572e5e5567ca4f1fbc3616bd not found: ID does not exist" Jul 14 11:41:07.318300 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.318082 2582 scope.go:117] "RemoveContainer" containerID="e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6" Jul 14 11:41:07.318448 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.318332 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6"} err="failed to get container status \"e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6\": rpc error: code = NotFound desc = could not find container \"e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6\": container with ID starting with e12bd708c4cac83a0338dff8b53d0a186c2e81818b2c93d84a24e0629001b7a6 not found: ID does not exist" Jul 14 11:41:07.318448 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.318348 2582 scope.go:117] "RemoveContainer" containerID="a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080" Jul 14 11:41:07.318561 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.318536 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080"} err="failed to get container status \"a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080\": rpc error: code = NotFound desc = could not find container \"a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080\": container with ID starting with a2bdb2594fb09e8ab3c367b997d403d1e0f738d5b155764a8ff54c70d9280080 not found: ID does not exist" Jul 14 11:41:07.318603 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.318562 2582 scope.go:117] "RemoveContainer" containerID="8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2" Jul 14 11:41:07.318779 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.318757 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2"} err="failed to get container status \"8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2\": rpc error: code = NotFound desc = could not find container \"8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2\": container with ID starting with 8f7fe02e264747d1661b635a40ce8bf743e3ba5a1223ccab5524ea8b2f85e7a2 not found: ID does not exist" Jul 14 11:41:07.318822 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.318781 2582 scope.go:117] "RemoveContainer" containerID="b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b" Jul 14 11:41:07.319003 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.318984 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b"} err="failed to get container status \"b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b\": rpc error: code = NotFound desc = could not find container \"b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b\": container with ID starting with b4affc0a60b609ae09270fa362ecadd1b1971d7978c2f1daeedb387bee27079b not found: ID does not exist" Jul 14 11:41:07.319041 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.319004 2582 scope.go:117] "RemoveContainer" containerID="07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8" Jul 14 11:41:07.319211 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.319195 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8"} err="failed to get container status \"07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8\": rpc error: code = NotFound desc = could not find container \"07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8\": container with ID starting with 07f16cdc59e07438d67f34433fef8d5503904a50e0d6bedc3d1cf70823f98cc8 not found: ID does not exist" Jul 14 11:41:07.322633 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.322607 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.325576 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.325554 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 14 11:41:07.325705 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.325640 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vsglw\"" Jul 14 11:41:07.325871 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.325857 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 14 11:41:07.326068 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.326049 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 14 11:41:07.326168 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.326086 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2n90m99u6ile3\"" Jul 14 11:41:07.326168 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.326143 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 14 11:41:07.326168 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.326159 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 14 11:41:07.326316 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.326160 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 14 11:41:07.326637 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.326397 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 14 11:41:07.326637 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.326414 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 14 11:41:07.326637 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.326492 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 14 11:41:07.326637 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.326500 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 14 11:41:07.326637 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.326539 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 14 11:41:07.327698 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.327505 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 14 11:41:07.330392 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.330305 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 14 11:41:07.331634 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.331617 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 14 11:41:07.339019 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.338995 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 11:41:07.369231 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.369198 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/867ee989-74d0-41f4-9434-d26da67f950f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.369231 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.369230 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/867ee989-74d0-41f4-9434-d26da67f950f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.369426 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.369260 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/867ee989-74d0-41f4-9434-d26da67f950f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.369426 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.369296 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/867ee989-74d0-41f4-9434-d26da67f950f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.369426 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.369325 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/867ee989-74d0-41f4-9434-d26da67f950f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.369426 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.369346 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/867ee989-74d0-41f4-9434-d26da67f950f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.369426 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.369378 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/867ee989-74d0-41f4-9434-d26da67f950f-web-config\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.369426 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.369413 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/867ee989-74d0-41f4-9434-d26da67f950f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.369608 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.369429 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/867ee989-74d0-41f4-9434-d26da67f950f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.369608 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.369492 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/867ee989-74d0-41f4-9434-d26da67f950f-config\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.369608 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.369518 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/867ee989-74d0-41f4-9434-d26da67f950f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.369608 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.369540 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/867ee989-74d0-41f4-9434-d26da67f950f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.369608 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.369572 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/867ee989-74d0-41f4-9434-d26da67f950f-config-out\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.369608 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.369599 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/867ee989-74d0-41f4-9434-d26da67f950f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.369791 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.369629 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/867ee989-74d0-41f4-9434-d26da67f950f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.369791 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.369692 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtvg6\" (UniqueName: \"kubernetes.io/projected/867ee989-74d0-41f4-9434-d26da67f950f-kube-api-access-vtvg6\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.369791 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.369719 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/867ee989-74d0-41f4-9434-d26da67f950f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.369791 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.369737 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/867ee989-74d0-41f4-9434-d26da67f950f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.369791 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.369754 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/867ee989-74d0-41f4-9434-d26da67f950f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.369791 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.369773 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/867ee989-74d0-41f4-9434-d26da67f950f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.470830 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.470805 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/867ee989-74d0-41f4-9434-d26da67f950f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.471026 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.470836 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/867ee989-74d0-41f4-9434-d26da67f950f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.471026 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.470854 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/867ee989-74d0-41f4-9434-d26da67f950f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.471026 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.470873 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/867ee989-74d0-41f4-9434-d26da67f950f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.471026 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.470889 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/867ee989-74d0-41f4-9434-d26da67f950f-web-config\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.471026 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.470908 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/867ee989-74d0-41f4-9434-d26da67f950f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.471026 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.470931 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/867ee989-74d0-41f4-9434-d26da67f950f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.471026 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.470967 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/867ee989-74d0-41f4-9434-d26da67f950f-config\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.471026 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.470990 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/867ee989-74d0-41f4-9434-d26da67f950f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.471026 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.471018 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/867ee989-74d0-41f4-9434-d26da67f950f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.471591 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.471042 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/867ee989-74d0-41f4-9434-d26da67f950f-config-out\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.471591 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.471080 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/867ee989-74d0-41f4-9434-d26da67f950f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.471591 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.471126 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/867ee989-74d0-41f4-9434-d26da67f950f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.471591 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.471165 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtvg6\" (UniqueName: \"kubernetes.io/projected/867ee989-74d0-41f4-9434-d26da67f950f-kube-api-access-vtvg6\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.471591 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.471189 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/867ee989-74d0-41f4-9434-d26da67f950f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.471591 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.471214 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/867ee989-74d0-41f4-9434-d26da67f950f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.471591 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.471239 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/867ee989-74d0-41f4-9434-d26da67f950f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.471591 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.471269 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/867ee989-74d0-41f4-9434-d26da67f950f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.471591 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.471352 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/867ee989-74d0-41f4-9434-d26da67f950f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.471591 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.471382 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/867ee989-74d0-41f4-9434-d26da67f950f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.474399 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.472573 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/867ee989-74d0-41f4-9434-d26da67f950f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.474399 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.472630 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/867ee989-74d0-41f4-9434-d26da67f950f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.474399 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.473504 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/867ee989-74d0-41f4-9434-d26da67f950f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.474399 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.473560 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/867ee989-74d0-41f4-9434-d26da67f950f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.474399 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.473720 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/867ee989-74d0-41f4-9434-d26da67f950f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.474399 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.473823 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/867ee989-74d0-41f4-9434-d26da67f950f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.474399 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.474051 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/867ee989-74d0-41f4-9434-d26da67f950f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.475625 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.475052 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/867ee989-74d0-41f4-9434-d26da67f950f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.475625 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.475138 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/867ee989-74d0-41f4-9434-d26da67f950f-web-config\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.475625 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.475588 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/867ee989-74d0-41f4-9434-d26da67f950f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.476066 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.476020 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/867ee989-74d0-41f4-9434-d26da67f950f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.476276 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.476252 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/867ee989-74d0-41f4-9434-d26da67f950f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.476662 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.476637 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/867ee989-74d0-41f4-9434-d26da67f950f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.476825 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.476809 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/867ee989-74d0-41f4-9434-d26da67f950f-config\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.476937 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.476916 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/867ee989-74d0-41f4-9434-d26da67f950f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.477310 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.477289 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/867ee989-74d0-41f4-9434-d26da67f950f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.477560 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.477538 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/867ee989-74d0-41f4-9434-d26da67f950f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.478475 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.478458 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/867ee989-74d0-41f4-9434-d26da67f950f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.478588 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.478569 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/867ee989-74d0-41f4-9434-d26da67f950f-config-out\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.483519 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.483494 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtvg6\" (UniqueName: \"kubernetes.io/projected/867ee989-74d0-41f4-9434-d26da67f950f-kube-api-access-vtvg6\") pod \"prometheus-k8s-0\" (UID: \"867ee989-74d0-41f4-9434-d26da67f950f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.633378 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.633342 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:41:07.777961 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:07.777771 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 11:41:07.780596 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:41:07.780566 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod867ee989_74d0_41f4_9434_d26da67f950f.slice/crio-ad8823f6dd800688d76c4a396b07a9bf8da1fcab4c2fd484b7f9199973373d2c WatchSource:0}: Error finding container ad8823f6dd800688d76c4a396b07a9bf8da1fcab4c2fd484b7f9199973373d2c: Status 404 returned error can't find the container with id ad8823f6dd800688d76c4a396b07a9bf8da1fcab4c2fd484b7f9199973373d2c Jul 14 11:41:08.264389 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:08.264353 2582 generic.go:356] "Generic (PLEG): container finished" podID="867ee989-74d0-41f4-9434-d26da67f950f" containerID="f12b6c818e4e703cd9815462bb649a3730390bf517dca2bab0bfd53777356c4f" exitCode=0 Jul 14 11:41:08.264821 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:08.264440 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"867ee989-74d0-41f4-9434-d26da67f950f","Type":"ContainerDied","Data":"f12b6c818e4e703cd9815462bb649a3730390bf517dca2bab0bfd53777356c4f"} Jul 14 11:41:08.264821 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:08.264547 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"867ee989-74d0-41f4-9434-d26da67f950f","Type":"ContainerStarted","Data":"ad8823f6dd800688d76c4a396b07a9bf8da1fcab4c2fd484b7f9199973373d2c"} Jul 14 11:41:08.291931 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:08.291901 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd4bea28-931c-4047-a97a-c5d82a935fa4" path="/var/lib/kubelet/pods/dd4bea28-931c-4047-a97a-c5d82a935fa4/volumes" Jul 14 11:41:09.274047 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:09.274003 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"867ee989-74d0-41f4-9434-d26da67f950f","Type":"ContainerStarted","Data":"0c9bfa7daabb4dae6f81fb106b7d8a32a8c3c4e956e5830ec6462225ab896cce"} Jul 14 11:41:09.274456 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:09.274090 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"867ee989-74d0-41f4-9434-d26da67f950f","Type":"ContainerStarted","Data":"0498e41c9a2c4955af9a70dd102bfe707851c1938761c6f06543fde6cc9a3c67"} Jul 14 11:41:09.274456 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:09.274155 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"867ee989-74d0-41f4-9434-d26da67f950f","Type":"ContainerStarted","Data":"f0733db0a1eeecc052e8efb5e15aa80b965b2a0055c618c3ae69703c7f91d988"} Jul 14 11:41:09.274456 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:09.274193 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"867ee989-74d0-41f4-9434-d26da67f950f","Type":"ContainerStarted","Data":"9dc4a883dae66082855ee256b014d0fef47af5146a74593a6a51cb54230f1ca4"} Jul 14 11:41:09.274456 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:09.274225 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"867ee989-74d0-41f4-9434-d26da67f950f","Type":"ContainerStarted","Data":"af8ce971b58df5d2cef37074dac9000c13f07d0d0b37e7099f691a742f7e3597"} Jul 14 11:41:09.274456 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:09.274262 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"867ee989-74d0-41f4-9434-d26da67f950f","Type":"ContainerStarted","Data":"b6a60b0b33426a5552f179b629d191eabb8701bfb016c82c88f74f5553e957e5"} Jul 14 11:41:09.310880 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:09.310822 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.290632229 podStartE2EDuration="2.310803022s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.170793ms" isStatefulPod=false podCreationTimestamp="2026-07-14 11:41:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:41:09.30793886 +0000 UTC m=+199.670590165" watchObservedRunningTime="2026-07-14 11:41:09.310803022 +0000 UTC m=+199.673454325" Jul 14 11:41:12.633786 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:41:12.633737 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:42:07.634485 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:42:07.634429 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:42:07.650121 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:42:07.650069 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:42:08.529798 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:42:08.529764 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:43:19.096962 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:19.096922 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6ff9db667-bvhbk"] Jul 14 11:43:19.100528 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:19.100501 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6ff9db667-bvhbk" Jul 14 11:43:19.104811 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:19.104787 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 14 11:43:19.111514 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:19.111489 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 14 11:43:19.111637 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:19.111516 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wscvk\"" Jul 14 11:43:19.111637 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:19.111489 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 14 11:43:19.111871 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:19.111853 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 14 11:43:19.129766 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:19.129734 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 14 11:43:19.131498 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:19.131470 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6ff9db667-bvhbk"] Jul 14 11:43:19.252371 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:19.252336 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/914865bf-c1a5-4fa1-903a-3ec7f4b60d74-metrics-cert\") pod \"lws-controller-manager-6ff9db667-bvhbk\" (UID: \"914865bf-c1a5-4fa1-903a-3ec7f4b60d74\") " pod="openshift-lws-operator/lws-controller-manager-6ff9db667-bvhbk" Jul 14 11:43:19.252548 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:19.252390 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/914865bf-c1a5-4fa1-903a-3ec7f4b60d74-manager-config\") pod \"lws-controller-manager-6ff9db667-bvhbk\" (UID: \"914865bf-c1a5-4fa1-903a-3ec7f4b60d74\") " pod="openshift-lws-operator/lws-controller-manager-6ff9db667-bvhbk" Jul 14 11:43:19.252548 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:19.252474 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/914865bf-c1a5-4fa1-903a-3ec7f4b60d74-cert\") pod \"lws-controller-manager-6ff9db667-bvhbk\" (UID: \"914865bf-c1a5-4fa1-903a-3ec7f4b60d74\") " pod="openshift-lws-operator/lws-controller-manager-6ff9db667-bvhbk" Jul 14 11:43:19.252548 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:19.252495 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sgnc\" (UniqueName: \"kubernetes.io/projected/914865bf-c1a5-4fa1-903a-3ec7f4b60d74-kube-api-access-8sgnc\") pod \"lws-controller-manager-6ff9db667-bvhbk\" (UID: \"914865bf-c1a5-4fa1-903a-3ec7f4b60d74\") " pod="openshift-lws-operator/lws-controller-manager-6ff9db667-bvhbk" Jul 14 11:43:19.353009 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:19.352891 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/914865bf-c1a5-4fa1-903a-3ec7f4b60d74-manager-config\") pod \"lws-controller-manager-6ff9db667-bvhbk\" (UID: \"914865bf-c1a5-4fa1-903a-3ec7f4b60d74\") " pod="openshift-lws-operator/lws-controller-manager-6ff9db667-bvhbk" Jul 14 11:43:19.353009 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:19.352959 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/914865bf-c1a5-4fa1-903a-3ec7f4b60d74-cert\") pod \"lws-controller-manager-6ff9db667-bvhbk\" (UID: \"914865bf-c1a5-4fa1-903a-3ec7f4b60d74\") " pod="openshift-lws-operator/lws-controller-manager-6ff9db667-bvhbk" Jul 14 11:43:19.353009 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:19.352984 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sgnc\" (UniqueName: \"kubernetes.io/projected/914865bf-c1a5-4fa1-903a-3ec7f4b60d74-kube-api-access-8sgnc\") pod \"lws-controller-manager-6ff9db667-bvhbk\" (UID: \"914865bf-c1a5-4fa1-903a-3ec7f4b60d74\") " pod="openshift-lws-operator/lws-controller-manager-6ff9db667-bvhbk" Jul 14 11:43:19.353322 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:19.353055 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/914865bf-c1a5-4fa1-903a-3ec7f4b60d74-metrics-cert\") pod \"lws-controller-manager-6ff9db667-bvhbk\" (UID: \"914865bf-c1a5-4fa1-903a-3ec7f4b60d74\") " pod="openshift-lws-operator/lws-controller-manager-6ff9db667-bvhbk" Jul 14 11:43:19.353724 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:19.353691 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/914865bf-c1a5-4fa1-903a-3ec7f4b60d74-manager-config\") pod \"lws-controller-manager-6ff9db667-bvhbk\" (UID: \"914865bf-c1a5-4fa1-903a-3ec7f4b60d74\") " pod="openshift-lws-operator/lws-controller-manager-6ff9db667-bvhbk" Jul 14 11:43:19.355591 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:19.355570 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/914865bf-c1a5-4fa1-903a-3ec7f4b60d74-metrics-cert\") pod \"lws-controller-manager-6ff9db667-bvhbk\" (UID: \"914865bf-c1a5-4fa1-903a-3ec7f4b60d74\") " pod="openshift-lws-operator/lws-controller-manager-6ff9db667-bvhbk" Jul 14 11:43:19.355718 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:19.355695 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/914865bf-c1a5-4fa1-903a-3ec7f4b60d74-cert\") pod \"lws-controller-manager-6ff9db667-bvhbk\" (UID: \"914865bf-c1a5-4fa1-903a-3ec7f4b60d74\") " pod="openshift-lws-operator/lws-controller-manager-6ff9db667-bvhbk" Jul 14 11:43:19.365493 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:19.365461 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sgnc\" (UniqueName: \"kubernetes.io/projected/914865bf-c1a5-4fa1-903a-3ec7f4b60d74-kube-api-access-8sgnc\") pod \"lws-controller-manager-6ff9db667-bvhbk\" (UID: \"914865bf-c1a5-4fa1-903a-3ec7f4b60d74\") " pod="openshift-lws-operator/lws-controller-manager-6ff9db667-bvhbk" Jul 14 11:43:19.411513 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:19.411474 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6ff9db667-bvhbk" Jul 14 11:43:19.557525 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:19.557498 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6ff9db667-bvhbk"] Jul 14 11:43:19.559395 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:43:19.559368 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod914865bf_c1a5_4fa1_903a_3ec7f4b60d74.slice/crio-24faaae64d994bff9a8eab2e3035e49f061f7f2f2b69d0e043c0cc31bb426ab7 WatchSource:0}: Error finding container 24faaae64d994bff9a8eab2e3035e49f061f7f2f2b69d0e043c0cc31bb426ab7: Status 404 returned error can't find the container with id 24faaae64d994bff9a8eab2e3035e49f061f7f2f2b69d0e043c0cc31bb426ab7 Jul 14 11:43:19.561215 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:19.561198 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 11:43:19.804884 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:19.804844 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6ff9db667-bvhbk" event={"ID":"914865bf-c1a5-4fa1-903a-3ec7f4b60d74","Type":"ContainerStarted","Data":"24faaae64d994bff9a8eab2e3035e49f061f7f2f2b69d0e043c0cc31bb426ab7"} Jul 14 11:43:21.944505 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:21.944423 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c944d8cbf-tbf24"] Jul 14 11:43:21.947402 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:21.947374 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c944d8cbf-tbf24" Jul 14 11:43:21.950751 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:21.950498 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 14 11:43:21.950751 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:21.950570 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 14 11:43:21.950943 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:21.950927 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 14 11:43:21.950996 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:21.950965 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rfn8t\"" Jul 14 11:43:21.951224 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:21.951202 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 14 11:43:21.965727 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:21.965691 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c944d8cbf-tbf24"] Jul 14 11:43:22.079387 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:22.079363 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/201355bf-d5b5-476c-9a28-432fc64a5545-tmp\") pod \"opendatahub-operator-controller-manager-6c944d8cbf-tbf24\" (UID: \"201355bf-d5b5-476c-9a28-432fc64a5545\") " pod="opendatahub/opendatahub-operator-controller-manager-6c944d8cbf-tbf24" Jul 14 11:43:22.079473 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:22.079395 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fht5r\" (UniqueName: \"kubernetes.io/projected/201355bf-d5b5-476c-9a28-432fc64a5545-kube-api-access-fht5r\") pod \"opendatahub-operator-controller-manager-6c944d8cbf-tbf24\" (UID: \"201355bf-d5b5-476c-9a28-432fc64a5545\") " pod="opendatahub/opendatahub-operator-controller-manager-6c944d8cbf-tbf24" Jul 14 11:43:22.079473 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:22.079433 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/201355bf-d5b5-476c-9a28-432fc64a5545-manifests\") pod \"opendatahub-operator-controller-manager-6c944d8cbf-tbf24\" (UID: \"201355bf-d5b5-476c-9a28-432fc64a5545\") " pod="opendatahub/opendatahub-operator-controller-manager-6c944d8cbf-tbf24" Jul 14 11:43:22.079560 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:22.079473 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/201355bf-d5b5-476c-9a28-432fc64a5545-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c944d8cbf-tbf24\" (UID: \"201355bf-d5b5-476c-9a28-432fc64a5545\") " pod="opendatahub/opendatahub-operator-controller-manager-6c944d8cbf-tbf24" Jul 14 11:43:22.079560 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:22.079492 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/201355bf-d5b5-476c-9a28-432fc64a5545-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c944d8cbf-tbf24\" (UID: \"201355bf-d5b5-476c-9a28-432fc64a5545\") " pod="opendatahub/opendatahub-operator-controller-manager-6c944d8cbf-tbf24" Jul 14 11:43:22.180681 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:22.180647 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/201355bf-d5b5-476c-9a28-432fc64a5545-manifests\") pod \"opendatahub-operator-controller-manager-6c944d8cbf-tbf24\" (UID: \"201355bf-d5b5-476c-9a28-432fc64a5545\") " pod="opendatahub/opendatahub-operator-controller-manager-6c944d8cbf-tbf24" Jul 14 11:43:22.180883 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:22.180687 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/201355bf-d5b5-476c-9a28-432fc64a5545-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c944d8cbf-tbf24\" (UID: \"201355bf-d5b5-476c-9a28-432fc64a5545\") " pod="opendatahub/opendatahub-operator-controller-manager-6c944d8cbf-tbf24" Jul 14 11:43:22.180883 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:22.180709 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/201355bf-d5b5-476c-9a28-432fc64a5545-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c944d8cbf-tbf24\" (UID: \"201355bf-d5b5-476c-9a28-432fc64a5545\") " pod="opendatahub/opendatahub-operator-controller-manager-6c944d8cbf-tbf24" Jul 14 11:43:22.180883 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:22.180800 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/201355bf-d5b5-476c-9a28-432fc64a5545-tmp\") pod \"opendatahub-operator-controller-manager-6c944d8cbf-tbf24\" (UID: \"201355bf-d5b5-476c-9a28-432fc64a5545\") " pod="opendatahub/opendatahub-operator-controller-manager-6c944d8cbf-tbf24" Jul 14 11:43:22.180883 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:22.180825 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fht5r\" (UniqueName: \"kubernetes.io/projected/201355bf-d5b5-476c-9a28-432fc64a5545-kube-api-access-fht5r\") pod \"opendatahub-operator-controller-manager-6c944d8cbf-tbf24\" (UID: \"201355bf-d5b5-476c-9a28-432fc64a5545\") " pod="opendatahub/opendatahub-operator-controller-manager-6c944d8cbf-tbf24" Jul 14 11:43:22.181163 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:22.181140 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/201355bf-d5b5-476c-9a28-432fc64a5545-manifests\") pod \"opendatahub-operator-controller-manager-6c944d8cbf-tbf24\" (UID: \"201355bf-d5b5-476c-9a28-432fc64a5545\") " pod="opendatahub/opendatahub-operator-controller-manager-6c944d8cbf-tbf24" Jul 14 11:43:22.183240 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:22.183213 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/201355bf-d5b5-476c-9a28-432fc64a5545-tmp\") pod \"opendatahub-operator-controller-manager-6c944d8cbf-tbf24\" (UID: \"201355bf-d5b5-476c-9a28-432fc64a5545\") " pod="opendatahub/opendatahub-operator-controller-manager-6c944d8cbf-tbf24" Jul 14 11:43:22.183348 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:22.183292 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/201355bf-d5b5-476c-9a28-432fc64a5545-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c944d8cbf-tbf24\" (UID: \"201355bf-d5b5-476c-9a28-432fc64a5545\") " pod="opendatahub/opendatahub-operator-controller-manager-6c944d8cbf-tbf24" Jul 14 11:43:22.183403 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:22.183389 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/201355bf-d5b5-476c-9a28-432fc64a5545-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c944d8cbf-tbf24\" (UID: \"201355bf-d5b5-476c-9a28-432fc64a5545\") " pod="opendatahub/opendatahub-operator-controller-manager-6c944d8cbf-tbf24" Jul 14 11:43:22.190483 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:22.190458 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fht5r\" (UniqueName: \"kubernetes.io/projected/201355bf-d5b5-476c-9a28-432fc64a5545-kube-api-access-fht5r\") pod \"opendatahub-operator-controller-manager-6c944d8cbf-tbf24\" (UID: \"201355bf-d5b5-476c-9a28-432fc64a5545\") " pod="opendatahub/opendatahub-operator-controller-manager-6c944d8cbf-tbf24" Jul 14 11:43:22.262329 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:22.262236 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c944d8cbf-tbf24" Jul 14 11:43:22.405150 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:22.405090 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c944d8cbf-tbf24"] Jul 14 11:43:22.408215 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:43:22.408189 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod201355bf_d5b5_476c_9a28_432fc64a5545.slice/crio-38bea4823a1c5af89a9f1a4649cd8a8fc748c2da74ee12103652fa3caa4b93a6 WatchSource:0}: Error finding container 38bea4823a1c5af89a9f1a4649cd8a8fc748c2da74ee12103652fa3caa4b93a6: Status 404 returned error can't find the container with id 38bea4823a1c5af89a9f1a4649cd8a8fc748c2da74ee12103652fa3caa4b93a6 Jul 14 11:43:22.827535 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:22.827492 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6ff9db667-bvhbk" event={"ID":"914865bf-c1a5-4fa1-903a-3ec7f4b60d74","Type":"ContainerStarted","Data":"814aa3f107c9202b7dc024081825dde60eab1859ccec473a7da2596fec06e0db"} Jul 14 11:43:22.827755 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:22.827659 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6ff9db667-bvhbk" Jul 14 11:43:22.828948 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:22.828922 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c944d8cbf-tbf24" event={"ID":"201355bf-d5b5-476c-9a28-432fc64a5545","Type":"ContainerStarted","Data":"38bea4823a1c5af89a9f1a4649cd8a8fc748c2da74ee12103652fa3caa4b93a6"} Jul 14 11:43:22.855054 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:22.854996 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6ff9db667-bvhbk" podStartSLOduration=1.402939809 podStartE2EDuration="3.854980754s" totalImagesPullingTime="2.452040945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:43:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:43:22.852245666 +0000 UTC m=+333.214896971" watchObservedRunningTime="2026-07-14 11:43:22.854980754 +0000 UTC m=+333.217632058" Jul 14 11:43:25.845643 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:25.845610 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c944d8cbf-tbf24" event={"ID":"201355bf-d5b5-476c-9a28-432fc64a5545","Type":"ContainerStarted","Data":"4b4962ac836392a1a37a83deefd0bef837394557006b9da76507f036403f7fca"} Jul 14 11:43:26.851650 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:26.851615 2582 generic.go:356] "Generic (PLEG): container finished" podID="201355bf-d5b5-476c-9a28-432fc64a5545" containerID="4b4962ac836392a1a37a83deefd0bef837394557006b9da76507f036403f7fca" exitCode=0 Jul 14 11:43:26.852031 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:26.851700 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c944d8cbf-tbf24" event={"ID":"201355bf-d5b5-476c-9a28-432fc64a5545","Type":"ContainerDied","Data":"4b4962ac836392a1a37a83deefd0bef837394557006b9da76507f036403f7fca"} Jul 14 11:43:27.858653 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:27.858609 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c944d8cbf-tbf24" event={"ID":"201355bf-d5b5-476c-9a28-432fc64a5545","Type":"ContainerStarted","Data":"8196cc46c4adccf89f3b545bfcb6be241a660d4401e52913d2397648659cf832"} Jul 14 11:43:27.859159 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:27.858744 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6c944d8cbf-tbf24" Jul 14 11:43:27.936069 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:27.936012 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6c944d8cbf-tbf24" podStartSLOduration=2.665425051 podStartE2EDuration="6.93599694s" totalImagesPullingTime="3.221439787s" totalInitContainerRuntime="1.049132102s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:43:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:43:27.933570958 +0000 UTC m=+338.296222287" watchObservedRunningTime="2026-07-14 11:43:27.93599694 +0000 UTC m=+338.298648241" Jul 14 11:43:33.837020 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:33.836989 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6ff9db667-bvhbk" Jul 14 11:43:38.865429 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:38.865398 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6c944d8cbf-tbf24" Jul 14 11:43:42.020956 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:42.020871 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7d55c74c4b-t7nxv"] Jul 14 11:43:42.031925 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:42.031896 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d55c74c4b-t7nxv" Jul 14 11:43:42.034983 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:42.034953 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-cdrws\"" Jul 14 11:43:42.036138 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:42.036113 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d55c74c4b-t7nxv"] Jul 14 11:43:42.039285 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:42.038884 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 14 11:43:42.039285 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:42.038899 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 14 11:43:42.039285 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:42.039165 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 14 11:43:42.039511 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:42.039376 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 14 11:43:42.065552 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:42.065515 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99fca359-3d03-41b7-a10d-b08e944a8394-tmp\") pod \"kube-auth-proxy-7d55c74c4b-t7nxv\" (UID: \"99fca359-3d03-41b7-a10d-b08e944a8394\") " pod="openshift-ingress/kube-auth-proxy-7d55c74c4b-t7nxv" Jul 14 11:43:42.065552 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:42.065557 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k79x\" (UniqueName: \"kubernetes.io/projected/99fca359-3d03-41b7-a10d-b08e944a8394-kube-api-access-4k79x\") pod \"kube-auth-proxy-7d55c74c4b-t7nxv\" (UID: \"99fca359-3d03-41b7-a10d-b08e944a8394\") " pod="openshift-ingress/kube-auth-proxy-7d55c74c4b-t7nxv" Jul 14 11:43:42.065806 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:42.065657 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99fca359-3d03-41b7-a10d-b08e944a8394-tls-certs\") pod \"kube-auth-proxy-7d55c74c4b-t7nxv\" (UID: \"99fca359-3d03-41b7-a10d-b08e944a8394\") " pod="openshift-ingress/kube-auth-proxy-7d55c74c4b-t7nxv" Jul 14 11:43:42.166553 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:42.166518 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99fca359-3d03-41b7-a10d-b08e944a8394-tls-certs\") pod \"kube-auth-proxy-7d55c74c4b-t7nxv\" (UID: \"99fca359-3d03-41b7-a10d-b08e944a8394\") " pod="openshift-ingress/kube-auth-proxy-7d55c74c4b-t7nxv" Jul 14 11:43:42.166710 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:42.166617 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99fca359-3d03-41b7-a10d-b08e944a8394-tmp\") pod \"kube-auth-proxy-7d55c74c4b-t7nxv\" (UID: \"99fca359-3d03-41b7-a10d-b08e944a8394\") " pod="openshift-ingress/kube-auth-proxy-7d55c74c4b-t7nxv" Jul 14 11:43:42.166710 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:42.166653 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k79x\" (UniqueName: \"kubernetes.io/projected/99fca359-3d03-41b7-a10d-b08e944a8394-kube-api-access-4k79x\") pod \"kube-auth-proxy-7d55c74c4b-t7nxv\" (UID: \"99fca359-3d03-41b7-a10d-b08e944a8394\") " pod="openshift-ingress/kube-auth-proxy-7d55c74c4b-t7nxv" Jul 14 11:43:42.168894 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:42.168869 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99fca359-3d03-41b7-a10d-b08e944a8394-tmp\") pod \"kube-auth-proxy-7d55c74c4b-t7nxv\" (UID: \"99fca359-3d03-41b7-a10d-b08e944a8394\") " pod="openshift-ingress/kube-auth-proxy-7d55c74c4b-t7nxv" Jul 14 11:43:42.169123 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:42.169085 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99fca359-3d03-41b7-a10d-b08e944a8394-tls-certs\") pod \"kube-auth-proxy-7d55c74c4b-t7nxv\" (UID: \"99fca359-3d03-41b7-a10d-b08e944a8394\") " pod="openshift-ingress/kube-auth-proxy-7d55c74c4b-t7nxv" Jul 14 11:43:42.179159 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:42.179133 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k79x\" (UniqueName: \"kubernetes.io/projected/99fca359-3d03-41b7-a10d-b08e944a8394-kube-api-access-4k79x\") pod \"kube-auth-proxy-7d55c74c4b-t7nxv\" (UID: \"99fca359-3d03-41b7-a10d-b08e944a8394\") " pod="openshift-ingress/kube-auth-proxy-7d55c74c4b-t7nxv" Jul 14 11:43:42.343451 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:42.343364 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d55c74c4b-t7nxv" Jul 14 11:43:42.499898 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:42.499869 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d55c74c4b-t7nxv"] Jul 14 11:43:42.502559 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:43:42.502531 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99fca359_3d03_41b7_a10d_b08e944a8394.slice/crio-a971565cfcba4c269e1c28d6edc7e59610533505e8692fe5a19b991d18b1e8d5 WatchSource:0}: Error finding container a971565cfcba4c269e1c28d6edc7e59610533505e8692fe5a19b991d18b1e8d5: Status 404 returned error can't find the container with id a971565cfcba4c269e1c28d6edc7e59610533505e8692fe5a19b991d18b1e8d5 Jul 14 11:43:42.933945 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:42.933906 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d55c74c4b-t7nxv" event={"ID":"99fca359-3d03-41b7-a10d-b08e944a8394","Type":"ContainerStarted","Data":"a971565cfcba4c269e1c28d6edc7e59610533505e8692fe5a19b991d18b1e8d5"} Jul 14 11:43:45.949735 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:45.949701 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d55c74c4b-t7nxv" event={"ID":"99fca359-3d03-41b7-a10d-b08e944a8394","Type":"ContainerStarted","Data":"b3eb4b0307205786103114b3ec2ec5a311322b6171b94cf9ae55a1a34f05ae2e"} Jul 14 11:43:45.970078 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:43:45.970023 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7d55c74c4b-t7nxv" podStartSLOduration=1.826452151 podStartE2EDuration="4.970005966s" totalImagesPullingTime="3.143553815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:43:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:43:45.968468885 +0000 UTC m=+356.331120216" watchObservedRunningTime="2026-07-14 11:43:45.970005966 +0000 UTC m=+356.332657269" Jul 14 11:45:08.081664 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.081627 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86cc8bb759-jmfw9"] Jul 14 11:45:08.085055 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.085029 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86cc8bb759-jmfw9" Jul 14 11:45:08.087978 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.087953 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 14 11:45:08.089411 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.089373 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 14 11:45:08.089567 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.089404 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 14 11:45:08.089567 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.089437 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 14 11:45:08.089712 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.089585 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ggxrg\"" Jul 14 11:45:08.089712 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.089455 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 14 11:45:08.094693 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.094671 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 14 11:45:08.098178 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.098155 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86cc8bb759-jmfw9"] Jul 14 11:45:08.153910 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.153863 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbbl4\" (UniqueName: \"kubernetes.io/projected/df98f0f4-0c08-4a1b-a94f-ff2086aafab8-kube-api-access-pbbl4\") pod \"console-86cc8bb759-jmfw9\" (UID: \"df98f0f4-0c08-4a1b-a94f-ff2086aafab8\") " pod="openshift-console/console-86cc8bb759-jmfw9" Jul 14 11:45:08.153910 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.153912 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df98f0f4-0c08-4a1b-a94f-ff2086aafab8-console-config\") pod \"console-86cc8bb759-jmfw9\" (UID: \"df98f0f4-0c08-4a1b-a94f-ff2086aafab8\") " pod="openshift-console/console-86cc8bb759-jmfw9" Jul 14 11:45:08.154175 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.153984 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df98f0f4-0c08-4a1b-a94f-ff2086aafab8-console-oauth-config\") pod \"console-86cc8bb759-jmfw9\" (UID: \"df98f0f4-0c08-4a1b-a94f-ff2086aafab8\") " pod="openshift-console/console-86cc8bb759-jmfw9" Jul 14 11:45:08.154175 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.154028 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df98f0f4-0c08-4a1b-a94f-ff2086aafab8-trusted-ca-bundle\") pod \"console-86cc8bb759-jmfw9\" (UID: \"df98f0f4-0c08-4a1b-a94f-ff2086aafab8\") " pod="openshift-console/console-86cc8bb759-jmfw9" Jul 14 11:45:08.154175 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.154048 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df98f0f4-0c08-4a1b-a94f-ff2086aafab8-oauth-serving-cert\") pod \"console-86cc8bb759-jmfw9\" (UID: \"df98f0f4-0c08-4a1b-a94f-ff2086aafab8\") " pod="openshift-console/console-86cc8bb759-jmfw9" Jul 14 11:45:08.154175 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.154136 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df98f0f4-0c08-4a1b-a94f-ff2086aafab8-console-serving-cert\") pod \"console-86cc8bb759-jmfw9\" (UID: \"df98f0f4-0c08-4a1b-a94f-ff2086aafab8\") " pod="openshift-console/console-86cc8bb759-jmfw9" Jul 14 11:45:08.154325 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.154197 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df98f0f4-0c08-4a1b-a94f-ff2086aafab8-service-ca\") pod \"console-86cc8bb759-jmfw9\" (UID: \"df98f0f4-0c08-4a1b-a94f-ff2086aafab8\") " pod="openshift-console/console-86cc8bb759-jmfw9" Jul 14 11:45:08.255403 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.255356 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbbl4\" (UniqueName: \"kubernetes.io/projected/df98f0f4-0c08-4a1b-a94f-ff2086aafab8-kube-api-access-pbbl4\") pod \"console-86cc8bb759-jmfw9\" (UID: \"df98f0f4-0c08-4a1b-a94f-ff2086aafab8\") " pod="openshift-console/console-86cc8bb759-jmfw9" Jul 14 11:45:08.255403 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.255402 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df98f0f4-0c08-4a1b-a94f-ff2086aafab8-console-config\") pod \"console-86cc8bb759-jmfw9\" (UID: \"df98f0f4-0c08-4a1b-a94f-ff2086aafab8\") " pod="openshift-console/console-86cc8bb759-jmfw9" Jul 14 11:45:08.255660 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.255436 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df98f0f4-0c08-4a1b-a94f-ff2086aafab8-console-oauth-config\") pod \"console-86cc8bb759-jmfw9\" (UID: \"df98f0f4-0c08-4a1b-a94f-ff2086aafab8\") " pod="openshift-console/console-86cc8bb759-jmfw9" Jul 14 11:45:08.255660 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.255467 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df98f0f4-0c08-4a1b-a94f-ff2086aafab8-trusted-ca-bundle\") pod \"console-86cc8bb759-jmfw9\" (UID: \"df98f0f4-0c08-4a1b-a94f-ff2086aafab8\") " pod="openshift-console/console-86cc8bb759-jmfw9" Jul 14 11:45:08.255660 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.255484 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df98f0f4-0c08-4a1b-a94f-ff2086aafab8-oauth-serving-cert\") pod \"console-86cc8bb759-jmfw9\" (UID: \"df98f0f4-0c08-4a1b-a94f-ff2086aafab8\") " pod="openshift-console/console-86cc8bb759-jmfw9" Jul 14 11:45:08.255660 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.255507 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df98f0f4-0c08-4a1b-a94f-ff2086aafab8-console-serving-cert\") pod \"console-86cc8bb759-jmfw9\" (UID: \"df98f0f4-0c08-4a1b-a94f-ff2086aafab8\") " pod="openshift-console/console-86cc8bb759-jmfw9" Jul 14 11:45:08.256358 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.256325 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df98f0f4-0c08-4a1b-a94f-ff2086aafab8-service-ca\") pod \"console-86cc8bb759-jmfw9\" (UID: \"df98f0f4-0c08-4a1b-a94f-ff2086aafab8\") " pod="openshift-console/console-86cc8bb759-jmfw9" Jul 14 11:45:08.256734 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.256706 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df98f0f4-0c08-4a1b-a94f-ff2086aafab8-oauth-serving-cert\") pod \"console-86cc8bb759-jmfw9\" (UID: \"df98f0f4-0c08-4a1b-a94f-ff2086aafab8\") " pod="openshift-console/console-86cc8bb759-jmfw9" Jul 14 11:45:08.262691 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.256894 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df98f0f4-0c08-4a1b-a94f-ff2086aafab8-console-config\") pod \"console-86cc8bb759-jmfw9\" (UID: \"df98f0f4-0c08-4a1b-a94f-ff2086aafab8\") " pod="openshift-console/console-86cc8bb759-jmfw9" Jul 14 11:45:08.262691 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.257138 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df98f0f4-0c08-4a1b-a94f-ff2086aafab8-trusted-ca-bundle\") pod \"console-86cc8bb759-jmfw9\" (UID: \"df98f0f4-0c08-4a1b-a94f-ff2086aafab8\") " pod="openshift-console/console-86cc8bb759-jmfw9" Jul 14 11:45:08.262691 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.257858 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df98f0f4-0c08-4a1b-a94f-ff2086aafab8-service-ca\") pod \"console-86cc8bb759-jmfw9\" (UID: \"df98f0f4-0c08-4a1b-a94f-ff2086aafab8\") " pod="openshift-console/console-86cc8bb759-jmfw9" Jul 14 11:45:08.262691 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.259037 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df98f0f4-0c08-4a1b-a94f-ff2086aafab8-console-serving-cert\") pod \"console-86cc8bb759-jmfw9\" (UID: \"df98f0f4-0c08-4a1b-a94f-ff2086aafab8\") " pod="openshift-console/console-86cc8bb759-jmfw9" Jul 14 11:45:08.262691 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.259385 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df98f0f4-0c08-4a1b-a94f-ff2086aafab8-console-oauth-config\") pod \"console-86cc8bb759-jmfw9\" (UID: \"df98f0f4-0c08-4a1b-a94f-ff2086aafab8\") " pod="openshift-console/console-86cc8bb759-jmfw9" Jul 14 11:45:08.265312 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.265284 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbbl4\" (UniqueName: \"kubernetes.io/projected/df98f0f4-0c08-4a1b-a94f-ff2086aafab8-kube-api-access-pbbl4\") pod \"console-86cc8bb759-jmfw9\" (UID: \"df98f0f4-0c08-4a1b-a94f-ff2086aafab8\") " pod="openshift-console/console-86cc8bb759-jmfw9" Jul 14 11:45:08.395478 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.395383 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86cc8bb759-jmfw9" Jul 14 11:45:08.545794 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:08.545768 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86cc8bb759-jmfw9"] Jul 14 11:45:08.548743 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:45:08.548712 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf98f0f4_0c08_4a1b_a94f_ff2086aafab8.slice/crio-65add23c7d9fa5fa2b66bbf9dd7b967bde6ae4633c517903825e952e58482d13 WatchSource:0}: Error finding container 65add23c7d9fa5fa2b66bbf9dd7b967bde6ae4633c517903825e952e58482d13: Status 404 returned error can't find the container with id 65add23c7d9fa5fa2b66bbf9dd7b967bde6ae4633c517903825e952e58482d13 Jul 14 11:45:09.324580 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:09.324544 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86cc8bb759-jmfw9" event={"ID":"df98f0f4-0c08-4a1b-a94f-ff2086aafab8","Type":"ContainerStarted","Data":"ebb042dce0d560e7c8e6fb30d579612589f96ab3608608ae593dd1e5b5250d4d"} Jul 14 11:45:09.324955 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:09.324593 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86cc8bb759-jmfw9" event={"ID":"df98f0f4-0c08-4a1b-a94f-ff2086aafab8","Type":"ContainerStarted","Data":"65add23c7d9fa5fa2b66bbf9dd7b967bde6ae4633c517903825e952e58482d13"} Jul 14 11:45:09.350951 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:09.350892 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86cc8bb759-jmfw9" podStartSLOduration=1.350875703 podStartE2EDuration="1.350875703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:45:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:45:09.348490965 +0000 UTC m=+439.711142270" watchObservedRunningTime="2026-07-14 11:45:09.350875703 +0000 UTC m=+439.713527007" Jul 14 11:45:18.396523 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:18.396426 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86cc8bb759-jmfw9" Jul 14 11:45:18.396523 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:18.396502 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86cc8bb759-jmfw9" Jul 14 11:45:18.401358 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:18.401334 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86cc8bb759-jmfw9" Jul 14 11:45:19.376260 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:19.376230 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86cc8bb759-jmfw9" Jul 14 11:45:26.189623 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:26.189588 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-phtnn"] Jul 14 11:45:26.193193 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:26.193171 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-phtnn" Jul 14 11:45:26.198411 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:26.198390 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 11:45:26.198549 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:26.198390 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 11:45:26.198549 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:26.198504 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-vtcnm\"" Jul 14 11:45:26.214271 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:26.214235 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-phtnn"] Jul 14 11:45:26.325373 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:26.325332 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rrsg\" (UniqueName: \"kubernetes.io/projected/66a01bea-7419-4352-b1cf-fcce4fe69dc2-kube-api-access-9rrsg\") pod \"authorino-operator-75cc8d5cb7-phtnn\" (UID: \"66a01bea-7419-4352-b1cf-fcce4fe69dc2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-phtnn" Jul 14 11:45:26.426215 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:26.426169 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rrsg\" (UniqueName: \"kubernetes.io/projected/66a01bea-7419-4352-b1cf-fcce4fe69dc2-kube-api-access-9rrsg\") pod \"authorino-operator-75cc8d5cb7-phtnn\" (UID: \"66a01bea-7419-4352-b1cf-fcce4fe69dc2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-phtnn" Jul 14 11:45:26.437184 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:26.437150 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rrsg\" (UniqueName: \"kubernetes.io/projected/66a01bea-7419-4352-b1cf-fcce4fe69dc2-kube-api-access-9rrsg\") pod \"authorino-operator-75cc8d5cb7-phtnn\" (UID: \"66a01bea-7419-4352-b1cf-fcce4fe69dc2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-phtnn" Jul 14 11:45:26.508181 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:26.508056 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-phtnn" Jul 14 11:45:26.645349 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:26.645317 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-phtnn"] Jul 14 11:45:26.649010 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:45:26.648987 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66a01bea_7419_4352_b1cf_fcce4fe69dc2.slice/crio-ca081591c31c67de41fec3b96b022b34743bd3a14d5454ac5539be2aa5f34c52 WatchSource:0}: Error finding container ca081591c31c67de41fec3b96b022b34743bd3a14d5454ac5539be2aa5f34c52: Status 404 returned error can't find the container with id ca081591c31c67de41fec3b96b022b34743bd3a14d5454ac5539be2aa5f34c52 Jul 14 11:45:27.412540 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:27.412495 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-phtnn" event={"ID":"66a01bea-7419-4352-b1cf-fcce4fe69dc2","Type":"ContainerStarted","Data":"ca081591c31c67de41fec3b96b022b34743bd3a14d5454ac5539be2aa5f34c52"} Jul 14 11:45:29.423628 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:29.423593 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-phtnn" event={"ID":"66a01bea-7419-4352-b1cf-fcce4fe69dc2","Type":"ContainerStarted","Data":"4f271b0d9af67aec4126a936ef112e254a6e8dee69e722f393cf92c8f9779aa6"} Jul 14 11:45:29.424016 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:29.423665 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-phtnn" Jul 14 11:45:29.480113 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:29.480055 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-phtnn" podStartSLOduration=1.321185807 podStartE2EDuration="3.48003675s" totalImagesPullingTime="2.158850943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:45:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:45:29.479914148 +0000 UTC m=+459.842565452" watchObservedRunningTime="2026-07-14 11:45:29.48003675 +0000 UTC m=+459.842688053" Jul 14 11:45:40.430517 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:45:40.430487 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-phtnn" Jul 14 11:46:29.501720 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:29.501680 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5kj6t"] Jul 14 11:46:29.506865 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:29.506798 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5kj6t" Jul 14 11:46:29.510476 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:29.510447 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dbmqg\"" Jul 14 11:46:29.510626 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:29.510447 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 14 11:46:29.514987 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:29.514957 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5kj6t"] Jul 14 11:46:29.593197 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:29.593160 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5kj6t"] Jul 14 11:46:29.615715 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:29.615680 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/20e971b5-b42e-4e18-8445-63c5e24547e6-config-file\") pod \"limitador-limitador-64c94fd64f-5kj6t\" (UID: \"20e971b5-b42e-4e18-8445-63c5e24547e6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5kj6t" Jul 14 11:46:29.615878 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:29.615797 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkrbx\" (UniqueName: \"kubernetes.io/projected/20e971b5-b42e-4e18-8445-63c5e24547e6-kube-api-access-zkrbx\") pod \"limitador-limitador-64c94fd64f-5kj6t\" (UID: \"20e971b5-b42e-4e18-8445-63c5e24547e6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5kj6t" Jul 14 11:46:29.716725 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:29.716690 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/20e971b5-b42e-4e18-8445-63c5e24547e6-config-file\") pod \"limitador-limitador-64c94fd64f-5kj6t\" (UID: \"20e971b5-b42e-4e18-8445-63c5e24547e6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5kj6t" Jul 14 11:46:29.716887 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:29.716760 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkrbx\" (UniqueName: \"kubernetes.io/projected/20e971b5-b42e-4e18-8445-63c5e24547e6-kube-api-access-zkrbx\") pod \"limitador-limitador-64c94fd64f-5kj6t\" (UID: \"20e971b5-b42e-4e18-8445-63c5e24547e6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5kj6t" Jul 14 11:46:29.717422 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:29.717401 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/20e971b5-b42e-4e18-8445-63c5e24547e6-config-file\") pod \"limitador-limitador-64c94fd64f-5kj6t\" (UID: \"20e971b5-b42e-4e18-8445-63c5e24547e6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5kj6t" Jul 14 11:46:29.734020 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:29.733982 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkrbx\" (UniqueName: \"kubernetes.io/projected/20e971b5-b42e-4e18-8445-63c5e24547e6-kube-api-access-zkrbx\") pod \"limitador-limitador-64c94fd64f-5kj6t\" (UID: \"20e971b5-b42e-4e18-8445-63c5e24547e6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5kj6t" Jul 14 11:46:29.821585 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:29.821483 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5kj6t" Jul 14 11:46:29.966339 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:29.966314 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5kj6t"] Jul 14 11:46:29.968599 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:46:29.968568 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20e971b5_b42e_4e18_8445_63c5e24547e6.slice/crio-62a5a2432ce0792883142b89cf296a3e697a5508a5d87ee6f782cda489ce703c WatchSource:0}: Error finding container 62a5a2432ce0792883142b89cf296a3e697a5508a5d87ee6f782cda489ce703c: Status 404 returned error can't find the container with id 62a5a2432ce0792883142b89cf296a3e697a5508a5d87ee6f782cda489ce703c Jul 14 11:46:30.375484 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:30.375445 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-kgb82"] Jul 14 11:46:30.380012 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:30.379993 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kgb82" Jul 14 11:46:30.382689 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:30.382664 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rnk6k\"" Jul 14 11:46:30.387809 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:30.387781 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-kgb82"] Jul 14 11:46:30.524479 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:30.524445 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwgt7\" (UniqueName: \"kubernetes.io/projected/753941be-47a0-40cb-8ba7-e86958cbe140-kube-api-access-rwgt7\") pod \"authorino-58cd955675-kgb82\" (UID: \"753941be-47a0-40cb-8ba7-e86958cbe140\") " pod="kuadrant-system/authorino-58cd955675-kgb82" Jul 14 11:46:30.625226 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:30.625189 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwgt7\" (UniqueName: \"kubernetes.io/projected/753941be-47a0-40cb-8ba7-e86958cbe140-kube-api-access-rwgt7\") pod \"authorino-58cd955675-kgb82\" (UID: \"753941be-47a0-40cb-8ba7-e86958cbe140\") " pod="kuadrant-system/authorino-58cd955675-kgb82" Jul 14 11:46:30.637617 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:30.637545 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwgt7\" (UniqueName: \"kubernetes.io/projected/753941be-47a0-40cb-8ba7-e86958cbe140-kube-api-access-rwgt7\") pod \"authorino-58cd955675-kgb82\" (UID: \"753941be-47a0-40cb-8ba7-e86958cbe140\") " pod="kuadrant-system/authorino-58cd955675-kgb82" Jul 14 11:46:30.706194 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:30.706163 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kgb82" Jul 14 11:46:30.706785 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:30.706753 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5kj6t" event={"ID":"20e971b5-b42e-4e18-8445-63c5e24547e6","Type":"ContainerStarted","Data":"62a5a2432ce0792883142b89cf296a3e697a5508a5d87ee6f782cda489ce703c"} Jul 14 11:46:30.890581 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:30.890491 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-kgb82"] Jul 14 11:46:30.896909 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:46:30.896868 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod753941be_47a0_40cb_8ba7_e86958cbe140.slice/crio-3a70205f94b238b3f7aec1427f75f0c190a87de1f8bccf8534d72db3dfe58201 WatchSource:0}: Error finding container 3a70205f94b238b3f7aec1427f75f0c190a87de1f8bccf8534d72db3dfe58201: Status 404 returned error can't find the container with id 3a70205f94b238b3f7aec1427f75f0c190a87de1f8bccf8534d72db3dfe58201 Jul 14 11:46:31.713262 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:31.713211 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kgb82" event={"ID":"753941be-47a0-40cb-8ba7-e86958cbe140","Type":"ContainerStarted","Data":"3a70205f94b238b3f7aec1427f75f0c190a87de1f8bccf8534d72db3dfe58201"} Jul 14 11:46:33.725217 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:33.725165 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5kj6t" event={"ID":"20e971b5-b42e-4e18-8445-63c5e24547e6","Type":"ContainerStarted","Data":"d446a642103cf8088a130abdf2400e5dfb9799ed3537ed7f02de2bc609dc5228"} Jul 14 11:46:33.725672 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:33.725259 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-5kj6t" Jul 14 11:46:33.747648 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:33.747588 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-5kj6t" podStartSLOduration=1.9674665679999999 podStartE2EDuration="4.747564559s" totalImagesPullingTime="2.780097991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:46:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:46:33.744693975 +0000 UTC m=+524.107345278" watchObservedRunningTime="2026-07-14 11:46:33.747564559 +0000 UTC m=+524.110215863" Jul 14 11:46:35.736622 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:35.736579 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kgb82" event={"ID":"753941be-47a0-40cb-8ba7-e86958cbe140","Type":"ContainerStarted","Data":"058c4831d4309516500a30ff90a3023b27b4b71bcafe8627be003d60a5a4377d"} Jul 14 11:46:35.754854 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:35.754794 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-kgb82" podStartSLOduration=1.249287893 podStartE2EDuration="5.75477817s" totalImagesPullingTime="4.505490277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:46:35.753466607 +0000 UTC m=+526.116117922" watchObservedRunningTime="2026-07-14 11:46:35.75477817 +0000 UTC m=+526.117429472" Jul 14 11:46:36.463226 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:36.463194 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-kgb82"] Jul 14 11:46:37.745575 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:37.745536 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-kgb82" podUID="753941be-47a0-40cb-8ba7-e86958cbe140" containerName="authorino" containerID="cri-o://058c4831d4309516500a30ff90a3023b27b4b71bcafe8627be003d60a5a4377d" gracePeriod=30 Jul 14 11:46:37.994056 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:37.994032 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kgb82" Jul 14 11:46:38.099579 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:38.099498 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwgt7\" (UniqueName: \"kubernetes.io/projected/753941be-47a0-40cb-8ba7-e86958cbe140-kube-api-access-rwgt7\") pod \"753941be-47a0-40cb-8ba7-e86958cbe140\" (UID: \"753941be-47a0-40cb-8ba7-e86958cbe140\") " Jul 14 11:46:38.101599 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:38.101575 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/753941be-47a0-40cb-8ba7-e86958cbe140-kube-api-access-rwgt7" (OuterVolumeSpecName: "kube-api-access-rwgt7") pod "753941be-47a0-40cb-8ba7-e86958cbe140" (UID: "753941be-47a0-40cb-8ba7-e86958cbe140"). InnerVolumeSpecName "kube-api-access-rwgt7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:46:38.200080 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:38.200044 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwgt7\" (UniqueName: \"kubernetes.io/projected/753941be-47a0-40cb-8ba7-e86958cbe140-kube-api-access-rwgt7\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:46:38.750885 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:38.750847 2582 generic.go:356] "Generic (PLEG): container finished" podID="753941be-47a0-40cb-8ba7-e86958cbe140" containerID="058c4831d4309516500a30ff90a3023b27b4b71bcafe8627be003d60a5a4377d" exitCode=0 Jul 14 11:46:38.750885 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:38.750886 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kgb82" Jul 14 11:46:38.751381 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:38.750891 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kgb82" event={"ID":"753941be-47a0-40cb-8ba7-e86958cbe140","Type":"ContainerDied","Data":"058c4831d4309516500a30ff90a3023b27b4b71bcafe8627be003d60a5a4377d"} Jul 14 11:46:38.751381 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:38.750931 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kgb82" event={"ID":"753941be-47a0-40cb-8ba7-e86958cbe140","Type":"ContainerDied","Data":"3a70205f94b238b3f7aec1427f75f0c190a87de1f8bccf8534d72db3dfe58201"} Jul 14 11:46:38.751381 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:38.750950 2582 scope.go:117] "RemoveContainer" containerID="058c4831d4309516500a30ff90a3023b27b4b71bcafe8627be003d60a5a4377d" Jul 14 11:46:38.759503 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:38.759474 2582 scope.go:117] "RemoveContainer" containerID="058c4831d4309516500a30ff90a3023b27b4b71bcafe8627be003d60a5a4377d" Jul 14 11:46:38.759742 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:46:38.759722 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"058c4831d4309516500a30ff90a3023b27b4b71bcafe8627be003d60a5a4377d\": container with ID starting with 058c4831d4309516500a30ff90a3023b27b4b71bcafe8627be003d60a5a4377d not found: ID does not exist" containerID="058c4831d4309516500a30ff90a3023b27b4b71bcafe8627be003d60a5a4377d" Jul 14 11:46:38.759808 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:38.759754 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"058c4831d4309516500a30ff90a3023b27b4b71bcafe8627be003d60a5a4377d"} err="failed to get container status \"058c4831d4309516500a30ff90a3023b27b4b71bcafe8627be003d60a5a4377d\": rpc error: code = NotFound desc = could not find container \"058c4831d4309516500a30ff90a3023b27b4b71bcafe8627be003d60a5a4377d\": container with ID starting with 058c4831d4309516500a30ff90a3023b27b4b71bcafe8627be003d60a5a4377d not found: ID does not exist" Jul 14 11:46:38.778361 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:38.778330 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-kgb82"] Jul 14 11:46:38.794263 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:38.794237 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-kgb82"] Jul 14 11:46:40.291625 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:40.291580 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="753941be-47a0-40cb-8ba7-e86958cbe140" path="/var/lib/kubelet/pods/753941be-47a0-40cb-8ba7-e86958cbe140/volumes" Jul 14 11:46:44.458464 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:44.458375 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5kj6t"] Jul 14 11:46:44.458894 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:44.458574 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-5kj6t" podUID="20e971b5-b42e-4e18-8445-63c5e24547e6" containerName="limitador" containerID="cri-o://d446a642103cf8088a130abdf2400e5dfb9799ed3537ed7f02de2bc609dc5228" gracePeriod=30 Jul 14 11:46:44.459301 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:44.459280 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-5kj6t" Jul 14 11:46:45.009234 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:45.009204 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5kj6t" Jul 14 11:46:45.063167 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:45.063068 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/20e971b5-b42e-4e18-8445-63c5e24547e6-config-file\") pod \"20e971b5-b42e-4e18-8445-63c5e24547e6\" (UID: \"20e971b5-b42e-4e18-8445-63c5e24547e6\") " Jul 14 11:46:45.063315 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:45.063186 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkrbx\" (UniqueName: \"kubernetes.io/projected/20e971b5-b42e-4e18-8445-63c5e24547e6-kube-api-access-zkrbx\") pod \"20e971b5-b42e-4e18-8445-63c5e24547e6\" (UID: \"20e971b5-b42e-4e18-8445-63c5e24547e6\") " Jul 14 11:46:45.063521 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:45.063501 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20e971b5-b42e-4e18-8445-63c5e24547e6-config-file" (OuterVolumeSpecName: "config-file") pod "20e971b5-b42e-4e18-8445-63c5e24547e6" (UID: "20e971b5-b42e-4e18-8445-63c5e24547e6"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:46:45.065297 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:45.065270 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20e971b5-b42e-4e18-8445-63c5e24547e6-kube-api-access-zkrbx" (OuterVolumeSpecName: "kube-api-access-zkrbx") pod "20e971b5-b42e-4e18-8445-63c5e24547e6" (UID: "20e971b5-b42e-4e18-8445-63c5e24547e6"). InnerVolumeSpecName "kube-api-access-zkrbx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:46:45.164753 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:45.164714 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkrbx\" (UniqueName: \"kubernetes.io/projected/20e971b5-b42e-4e18-8445-63c5e24547e6-kube-api-access-zkrbx\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:46:45.164753 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:45.164747 2582 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/20e971b5-b42e-4e18-8445-63c5e24547e6-config-file\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:46:45.785760 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:45.785725 2582 generic.go:356] "Generic (PLEG): container finished" podID="20e971b5-b42e-4e18-8445-63c5e24547e6" containerID="d446a642103cf8088a130abdf2400e5dfb9799ed3537ed7f02de2bc609dc5228" exitCode=0 Jul 14 11:46:45.786187 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:45.785772 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5kj6t" Jul 14 11:46:45.786187 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:45.785815 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5kj6t" event={"ID":"20e971b5-b42e-4e18-8445-63c5e24547e6","Type":"ContainerDied","Data":"d446a642103cf8088a130abdf2400e5dfb9799ed3537ed7f02de2bc609dc5228"} Jul 14 11:46:45.786187 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:45.785869 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5kj6t" event={"ID":"20e971b5-b42e-4e18-8445-63c5e24547e6","Type":"ContainerDied","Data":"62a5a2432ce0792883142b89cf296a3e697a5508a5d87ee6f782cda489ce703c"} Jul 14 11:46:45.786187 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:45.785891 2582 scope.go:117] "RemoveContainer" containerID="d446a642103cf8088a130abdf2400e5dfb9799ed3537ed7f02de2bc609dc5228" Jul 14 11:46:45.798536 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:45.798510 2582 scope.go:117] "RemoveContainer" containerID="d446a642103cf8088a130abdf2400e5dfb9799ed3537ed7f02de2bc609dc5228" Jul 14 11:46:45.798825 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:46:45.798806 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d446a642103cf8088a130abdf2400e5dfb9799ed3537ed7f02de2bc609dc5228\": container with ID starting with d446a642103cf8088a130abdf2400e5dfb9799ed3537ed7f02de2bc609dc5228 not found: ID does not exist" containerID="d446a642103cf8088a130abdf2400e5dfb9799ed3537ed7f02de2bc609dc5228" Jul 14 11:46:45.798873 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:45.798835 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d446a642103cf8088a130abdf2400e5dfb9799ed3537ed7f02de2bc609dc5228"} err="failed to get container status \"d446a642103cf8088a130abdf2400e5dfb9799ed3537ed7f02de2bc609dc5228\": rpc error: code = NotFound desc = could not find container \"d446a642103cf8088a130abdf2400e5dfb9799ed3537ed7f02de2bc609dc5228\": container with ID starting with d446a642103cf8088a130abdf2400e5dfb9799ed3537ed7f02de2bc609dc5228 not found: ID does not exist" Jul 14 11:46:45.818053 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:45.818027 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5kj6t"] Jul 14 11:46:45.824016 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:45.823991 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5kj6t"] Jul 14 11:46:46.033219 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:46.033187 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-gjqg6"] Jul 14 11:46:46.033831 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:46.033805 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20e971b5-b42e-4e18-8445-63c5e24547e6" containerName="limitador" Jul 14 11:46:46.033831 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:46.033828 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="20e971b5-b42e-4e18-8445-63c5e24547e6" containerName="limitador" Jul 14 11:46:46.034016 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:46.033842 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="753941be-47a0-40cb-8ba7-e86958cbe140" containerName="authorino" Jul 14 11:46:46.034016 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:46.033851 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="753941be-47a0-40cb-8ba7-e86958cbe140" containerName="authorino" Jul 14 11:46:46.034016 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:46.033943 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="20e971b5-b42e-4e18-8445-63c5e24547e6" containerName="limitador" Jul 14 11:46:46.034016 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:46.033958 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="753941be-47a0-40cb-8ba7-e86958cbe140" containerName="authorino" Jul 14 11:46:46.038064 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:46.038006 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gjqg6" Jul 14 11:46:46.040848 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:46.040824 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 14 11:46:46.040976 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:46.040857 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 14 11:46:46.040976 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:46.040884 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 14 11:46:46.040976 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:46.040887 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-xkgk7\"" Jul 14 11:46:46.048449 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:46.048424 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-gjqg6"] Jul 14 11:46:46.073780 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:46.073750 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pddwj\" (UniqueName: \"kubernetes.io/projected/03254699-08fc-4f84-b4e4-4aaeb2f522fc-kube-api-access-pddwj\") pod \"postgres-69fb4594cf-gjqg6\" (UID: \"03254699-08fc-4f84-b4e4-4aaeb2f522fc\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gjqg6" Jul 14 11:46:46.073961 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:46.073802 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/03254699-08fc-4f84-b4e4-4aaeb2f522fc-data\") pod \"postgres-69fb4594cf-gjqg6\" (UID: \"03254699-08fc-4f84-b4e4-4aaeb2f522fc\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gjqg6" Jul 14 11:46:46.175088 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:46.175051 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pddwj\" (UniqueName: \"kubernetes.io/projected/03254699-08fc-4f84-b4e4-4aaeb2f522fc-kube-api-access-pddwj\") pod \"postgres-69fb4594cf-gjqg6\" (UID: \"03254699-08fc-4f84-b4e4-4aaeb2f522fc\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gjqg6" Jul 14 11:46:46.175274 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:46.175138 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/03254699-08fc-4f84-b4e4-4aaeb2f522fc-data\") pod \"postgres-69fb4594cf-gjqg6\" (UID: \"03254699-08fc-4f84-b4e4-4aaeb2f522fc\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gjqg6" Jul 14 11:46:46.175563 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:46.175544 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/03254699-08fc-4f84-b4e4-4aaeb2f522fc-data\") pod \"postgres-69fb4594cf-gjqg6\" (UID: \"03254699-08fc-4f84-b4e4-4aaeb2f522fc\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gjqg6" Jul 14 11:46:46.184628 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:46.184590 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pddwj\" (UniqueName: \"kubernetes.io/projected/03254699-08fc-4f84-b4e4-4aaeb2f522fc-kube-api-access-pddwj\") pod \"postgres-69fb4594cf-gjqg6\" (UID: \"03254699-08fc-4f84-b4e4-4aaeb2f522fc\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gjqg6" Jul 14 11:46:46.291060 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:46.290980 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20e971b5-b42e-4e18-8445-63c5e24547e6" path="/var/lib/kubelet/pods/20e971b5-b42e-4e18-8445-63c5e24547e6/volumes" Jul 14 11:46:46.349252 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:46.349219 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gjqg6" Jul 14 11:46:46.481231 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:46.481082 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-gjqg6"] Jul 14 11:46:46.483624 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:46:46.483596 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03254699_08fc_4f84_b4e4_4aaeb2f522fc.slice/crio-83ab927a3eab69065141fca849032604aa72a25f4fb756c912e975701bfacd2d WatchSource:0}: Error finding container 83ab927a3eab69065141fca849032604aa72a25f4fb756c912e975701bfacd2d: Status 404 returned error can't find the container with id 83ab927a3eab69065141fca849032604aa72a25f4fb756c912e975701bfacd2d Jul 14 11:46:46.792302 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:46.792266 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gjqg6" event={"ID":"03254699-08fc-4f84-b4e4-4aaeb2f522fc","Type":"ContainerStarted","Data":"83ab927a3eab69065141fca849032604aa72a25f4fb756c912e975701bfacd2d"} Jul 14 11:46:51.219936 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:51.219906 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 14 11:46:51.823807 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:51.823769 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gjqg6" event={"ID":"03254699-08fc-4f84-b4e4-4aaeb2f522fc","Type":"ContainerStarted","Data":"e7fa33bad0ac956143717cf94ef3d10df782b75f3bd84f7be370be377063e0f3"} Jul 14 11:46:51.823976 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:51.823949 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gjqg6" Jul 14 11:46:51.844761 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:51.844699 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gjqg6" podStartSLOduration=1.112876767 podStartE2EDuration="5.844681116s" totalImagesPullingTime="4.731804349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:46:51.842805893 +0000 UTC m=+542.205457195" watchObservedRunningTime="2026-07-14 11:46:51.844681116 +0000 UTC m=+542.207332418" Jul 14 11:46:57.858924 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:57.858892 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gjqg6" Jul 14 11:46:58.453184 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:58.453147 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-j7m65"] Jul 14 11:46:58.458567 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:58.458547 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-j7m65" Jul 14 11:46:58.461521 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:58.461499 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rnk6k\"" Jul 14 11:46:58.470693 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:58.470656 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-j7m65"] Jul 14 11:46:58.590314 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:58.590278 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9p5x\" (UniqueName: \"kubernetes.io/projected/9e8456cc-2921-4140-a9d6-5f97e4dc950b-kube-api-access-m9p5x\") pod \"authorino-5d4b67c446-j7m65\" (UID: \"9e8456cc-2921-4140-a9d6-5f97e4dc950b\") " pod="kuadrant-system/authorino-5d4b67c446-j7m65" Jul 14 11:46:58.689578 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:58.689546 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-j7m65"] Jul 14 11:46:58.689842 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:46:58.689824 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-m9p5x], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-j7m65" podUID="9e8456cc-2921-4140-a9d6-5f97e4dc950b" Jul 14 11:46:58.690984 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:58.690955 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9p5x\" (UniqueName: \"kubernetes.io/projected/9e8456cc-2921-4140-a9d6-5f97e4dc950b-kube-api-access-m9p5x\") pod \"authorino-5d4b67c446-j7m65\" (UID: \"9e8456cc-2921-4140-a9d6-5f97e4dc950b\") " pod="kuadrant-system/authorino-5d4b67c446-j7m65" Jul 14 11:46:58.702186 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:58.702157 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9p5x\" (UniqueName: \"kubernetes.io/projected/9e8456cc-2921-4140-a9d6-5f97e4dc950b-kube-api-access-m9p5x\") pod \"authorino-5d4b67c446-j7m65\" (UID: \"9e8456cc-2921-4140-a9d6-5f97e4dc950b\") " pod="kuadrant-system/authorino-5d4b67c446-j7m65" Jul 14 11:46:58.721284 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:58.721205 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75f788d94-rbqnp"] Jul 14 11:46:58.724670 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:58.724653 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75f788d94-rbqnp" Jul 14 11:46:58.734278 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:58.734252 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75f788d94-rbqnp"] Jul 14 11:46:58.791987 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:58.791944 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqvv9\" (UniqueName: \"kubernetes.io/projected/358176d0-5a52-40aa-a2c6-04393ab14c78-kube-api-access-wqvv9\") pod \"authorino-75f788d94-rbqnp\" (UID: \"358176d0-5a52-40aa-a2c6-04393ab14c78\") " pod="kuadrant-system/authorino-75f788d94-rbqnp" Jul 14 11:46:58.859016 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:58.858982 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-j7m65" Jul 14 11:46:58.874297 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:58.874272 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-j7m65" Jul 14 11:46:58.893393 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:58.893353 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqvv9\" (UniqueName: \"kubernetes.io/projected/358176d0-5a52-40aa-a2c6-04393ab14c78-kube-api-access-wqvv9\") pod \"authorino-75f788d94-rbqnp\" (UID: \"358176d0-5a52-40aa-a2c6-04393ab14c78\") " pod="kuadrant-system/authorino-75f788d94-rbqnp" Jul 14 11:46:58.903910 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:58.903876 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqvv9\" (UniqueName: \"kubernetes.io/projected/358176d0-5a52-40aa-a2c6-04393ab14c78-kube-api-access-wqvv9\") pod \"authorino-75f788d94-rbqnp\" (UID: \"358176d0-5a52-40aa-a2c6-04393ab14c78\") " pod="kuadrant-system/authorino-75f788d94-rbqnp" Jul 14 11:46:58.907933 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:58.907900 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75f788d94-rbqnp"] Jul 14 11:46:58.908192 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:58.908179 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75f788d94-rbqnp" Jul 14 11:46:58.994520 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:58.994428 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9p5x\" (UniqueName: \"kubernetes.io/projected/9e8456cc-2921-4140-a9d6-5f97e4dc950b-kube-api-access-m9p5x\") pod \"9e8456cc-2921-4140-a9d6-5f97e4dc950b\" (UID: \"9e8456cc-2921-4140-a9d6-5f97e4dc950b\") " Jul 14 11:46:58.996716 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:58.996666 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e8456cc-2921-4140-a9d6-5f97e4dc950b-kube-api-access-m9p5x" (OuterVolumeSpecName: "kube-api-access-m9p5x") pod "9e8456cc-2921-4140-a9d6-5f97e4dc950b" (UID: "9e8456cc-2921-4140-a9d6-5f97e4dc950b"). InnerVolumeSpecName "kube-api-access-m9p5x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:46:59.052818 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:59.052724 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75f788d94-rbqnp"] Jul 14 11:46:59.055114 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:46:59.055075 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod358176d0_5a52_40aa_a2c6_04393ab14c78.slice/crio-e4916dbde3ac68270d30c4bcf5fff1351ba94c3c44c45e40c1991356fa126222 WatchSource:0}: Error finding container e4916dbde3ac68270d30c4bcf5fff1351ba94c3c44c45e40c1991356fa126222: Status 404 returned error can't find the container with id e4916dbde3ac68270d30c4bcf5fff1351ba94c3c44c45e40c1991356fa126222 Jul 14 11:46:59.095416 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:59.095371 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9p5x\" (UniqueName: \"kubernetes.io/projected/9e8456cc-2921-4140-a9d6-5f97e4dc950b-kube-api-access-m9p5x\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:46:59.865148 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:59.865084 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75f788d94-rbqnp" event={"ID":"358176d0-5a52-40aa-a2c6-04393ab14c78","Type":"ContainerStarted","Data":"05275d1cb996a6ce580de6e21553eae0f5514daabe2d67b73cad2efc1c360730"} Jul 14 11:46:59.865148 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:59.865133 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75f788d94-rbqnp" podUID="358176d0-5a52-40aa-a2c6-04393ab14c78" containerName="authorino" containerID="cri-o://05275d1cb996a6ce580de6e21553eae0f5514daabe2d67b73cad2efc1c360730" gracePeriod=30 Jul 14 11:46:59.865148 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:59.865153 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75f788d94-rbqnp" event={"ID":"358176d0-5a52-40aa-a2c6-04393ab14c78","Type":"ContainerStarted","Data":"e4916dbde3ac68270d30c4bcf5fff1351ba94c3c44c45e40c1991356fa126222"} Jul 14 11:46:59.865637 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:59.865137 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-j7m65" Jul 14 11:46:59.885961 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:59.885913 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75f788d94-rbqnp" podStartSLOduration=1.5226798609999999 podStartE2EDuration="1.885896989s" totalImagesPullingTime="363.217128ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:46:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:46:59.88552081 +0000 UTC m=+550.248172113" watchObservedRunningTime="2026-07-14 11:46:59.885896989 +0000 UTC m=+550.248548291" Jul 14 11:46:59.918877 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:59.918848 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-j7m65"] Jul 14 11:46:59.927253 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:46:59.927220 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-j7m65"] Jul 14 11:47:00.114395 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:00.114370 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75f788d94-rbqnp" Jul 14 11:47:00.206628 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:00.206587 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqvv9\" (UniqueName: \"kubernetes.io/projected/358176d0-5a52-40aa-a2c6-04393ab14c78-kube-api-access-wqvv9\") pod \"358176d0-5a52-40aa-a2c6-04393ab14c78\" (UID: \"358176d0-5a52-40aa-a2c6-04393ab14c78\") " Jul 14 11:47:00.208713 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:00.208681 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/358176d0-5a52-40aa-a2c6-04393ab14c78-kube-api-access-wqvv9" (OuterVolumeSpecName: "kube-api-access-wqvv9") pod "358176d0-5a52-40aa-a2c6-04393ab14c78" (UID: "358176d0-5a52-40aa-a2c6-04393ab14c78"). InnerVolumeSpecName "kube-api-access-wqvv9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:47:00.297809 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:00.297775 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e8456cc-2921-4140-a9d6-5f97e4dc950b" path="/var/lib/kubelet/pods/9e8456cc-2921-4140-a9d6-5f97e4dc950b/volumes" Jul 14 11:47:00.307752 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:00.307726 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqvv9\" (UniqueName: \"kubernetes.io/projected/358176d0-5a52-40aa-a2c6-04393ab14c78-kube-api-access-wqvv9\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:47:00.871195 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:00.871164 2582 generic.go:356] "Generic (PLEG): container finished" podID="358176d0-5a52-40aa-a2c6-04393ab14c78" containerID="05275d1cb996a6ce580de6e21553eae0f5514daabe2d67b73cad2efc1c360730" exitCode=0 Jul 14 11:47:00.871661 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:00.871220 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75f788d94-rbqnp" event={"ID":"358176d0-5a52-40aa-a2c6-04393ab14c78","Type":"ContainerDied","Data":"05275d1cb996a6ce580de6e21553eae0f5514daabe2d67b73cad2efc1c360730"} Jul 14 11:47:00.871661 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:00.871225 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75f788d94-rbqnp" Jul 14 11:47:00.871661 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:00.871248 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75f788d94-rbqnp" event={"ID":"358176d0-5a52-40aa-a2c6-04393ab14c78","Type":"ContainerDied","Data":"e4916dbde3ac68270d30c4bcf5fff1351ba94c3c44c45e40c1991356fa126222"} Jul 14 11:47:00.871661 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:00.871264 2582 scope.go:117] "RemoveContainer" containerID="05275d1cb996a6ce580de6e21553eae0f5514daabe2d67b73cad2efc1c360730" Jul 14 11:47:00.879921 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:00.879900 2582 scope.go:117] "RemoveContainer" containerID="05275d1cb996a6ce580de6e21553eae0f5514daabe2d67b73cad2efc1c360730" Jul 14 11:47:00.880188 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:47:00.880165 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05275d1cb996a6ce580de6e21553eae0f5514daabe2d67b73cad2efc1c360730\": container with ID starting with 05275d1cb996a6ce580de6e21553eae0f5514daabe2d67b73cad2efc1c360730 not found: ID does not exist" containerID="05275d1cb996a6ce580de6e21553eae0f5514daabe2d67b73cad2efc1c360730" Jul 14 11:47:00.880261 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:00.880196 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05275d1cb996a6ce580de6e21553eae0f5514daabe2d67b73cad2efc1c360730"} err="failed to get container status \"05275d1cb996a6ce580de6e21553eae0f5514daabe2d67b73cad2efc1c360730\": rpc error: code = NotFound desc = could not find container \"05275d1cb996a6ce580de6e21553eae0f5514daabe2d67b73cad2efc1c360730\": container with ID starting with 05275d1cb996a6ce580de6e21553eae0f5514daabe2d67b73cad2efc1c360730 not found: ID does not exist" Jul 14 11:47:00.892896 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:00.892873 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75f788d94-rbqnp"] Jul 14 11:47:00.895412 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:00.895392 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75f788d94-rbqnp"] Jul 14 11:47:02.291247 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:02.291216 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="358176d0-5a52-40aa-a2c6-04393ab14c78" path="/var/lib/kubelet/pods/358176d0-5a52-40aa-a2c6-04393ab14c78/volumes" Jul 14 11:47:08.062393 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.062360 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-644f64cffc-klcsf"] Jul 14 11:47:08.062830 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.062734 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="358176d0-5a52-40aa-a2c6-04393ab14c78" containerName="authorino" Jul 14 11:47:08.062830 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.062744 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="358176d0-5a52-40aa-a2c6-04393ab14c78" containerName="authorino" Jul 14 11:47:08.062830 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.062805 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="358176d0-5a52-40aa-a2c6-04393ab14c78" containerName="authorino" Jul 14 11:47:08.085526 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.085485 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-644f64cffc-klcsf"] Jul 14 11:47:08.085697 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.085613 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-644f64cffc-klcsf" Jul 14 11:47:08.090303 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.090278 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7ssq8\"" Jul 14 11:47:08.090452 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.090284 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 14 11:47:08.090452 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.090332 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 14 11:47:08.177378 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.177343 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2dbe732-c5be-4821-b917-5ba2d15eba7f-webhook-cert\") pod \"maas-controller-644f64cffc-klcsf\" (UID: \"b2dbe732-c5be-4821-b917-5ba2d15eba7f\") " pod="opendatahub/maas-controller-644f64cffc-klcsf" Jul 14 11:47:08.177561 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.177391 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfpm5\" (UniqueName: \"kubernetes.io/projected/b2dbe732-c5be-4821-b917-5ba2d15eba7f-kube-api-access-sfpm5\") pod \"maas-controller-644f64cffc-klcsf\" (UID: \"b2dbe732-c5be-4821-b917-5ba2d15eba7f\") " pod="opendatahub/maas-controller-644f64cffc-klcsf" Jul 14 11:47:08.182399 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.182363 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b78fdddb5-w66m7"] Jul 14 11:47:08.184875 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.184858 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b78fdddb5-w66m7" Jul 14 11:47:08.197151 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.197123 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b78fdddb5-w66m7"] Jul 14 11:47:08.278530 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.278483 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr8lb\" (UniqueName: \"kubernetes.io/projected/505b92c6-aa32-48b3-a694-086f070787a2-kube-api-access-nr8lb\") pod \"maas-controller-b78fdddb5-w66m7\" (UID: \"505b92c6-aa32-48b3-a694-086f070787a2\") " pod="opendatahub/maas-controller-b78fdddb5-w66m7" Jul 14 11:47:08.278722 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.278595 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2dbe732-c5be-4821-b917-5ba2d15eba7f-webhook-cert\") pod \"maas-controller-644f64cffc-klcsf\" (UID: \"b2dbe732-c5be-4821-b917-5ba2d15eba7f\") " pod="opendatahub/maas-controller-644f64cffc-klcsf" Jul 14 11:47:08.278722 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.278645 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfpm5\" (UniqueName: \"kubernetes.io/projected/b2dbe732-c5be-4821-b917-5ba2d15eba7f-kube-api-access-sfpm5\") pod \"maas-controller-644f64cffc-klcsf\" (UID: \"b2dbe732-c5be-4821-b917-5ba2d15eba7f\") " pod="opendatahub/maas-controller-644f64cffc-klcsf" Jul 14 11:47:08.278823 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.278726 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/505b92c6-aa32-48b3-a694-086f070787a2-webhook-cert\") pod \"maas-controller-b78fdddb5-w66m7\" (UID: \"505b92c6-aa32-48b3-a694-086f070787a2\") " pod="opendatahub/maas-controller-b78fdddb5-w66m7" Jul 14 11:47:08.281262 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.281238 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2dbe732-c5be-4821-b917-5ba2d15eba7f-webhook-cert\") pod \"maas-controller-644f64cffc-klcsf\" (UID: \"b2dbe732-c5be-4821-b917-5ba2d15eba7f\") " pod="opendatahub/maas-controller-644f64cffc-klcsf" Jul 14 11:47:08.289610 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.289580 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfpm5\" (UniqueName: \"kubernetes.io/projected/b2dbe732-c5be-4821-b917-5ba2d15eba7f-kube-api-access-sfpm5\") pod \"maas-controller-644f64cffc-klcsf\" (UID: \"b2dbe732-c5be-4821-b917-5ba2d15eba7f\") " pod="opendatahub/maas-controller-644f64cffc-klcsf" Jul 14 11:47:08.380271 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.380188 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/505b92c6-aa32-48b3-a694-086f070787a2-webhook-cert\") pod \"maas-controller-b78fdddb5-w66m7\" (UID: \"505b92c6-aa32-48b3-a694-086f070787a2\") " pod="opendatahub/maas-controller-b78fdddb5-w66m7" Jul 14 11:47:08.380271 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.380243 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr8lb\" (UniqueName: \"kubernetes.io/projected/505b92c6-aa32-48b3-a694-086f070787a2-kube-api-access-nr8lb\") pod \"maas-controller-b78fdddb5-w66m7\" (UID: \"505b92c6-aa32-48b3-a694-086f070787a2\") " pod="opendatahub/maas-controller-b78fdddb5-w66m7" Jul 14 11:47:08.382599 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.382569 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/505b92c6-aa32-48b3-a694-086f070787a2-webhook-cert\") pod \"maas-controller-b78fdddb5-w66m7\" (UID: \"505b92c6-aa32-48b3-a694-086f070787a2\") " pod="opendatahub/maas-controller-b78fdddb5-w66m7" Jul 14 11:47:08.391639 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.391613 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr8lb\" (UniqueName: \"kubernetes.io/projected/505b92c6-aa32-48b3-a694-086f070787a2-kube-api-access-nr8lb\") pod \"maas-controller-b78fdddb5-w66m7\" (UID: \"505b92c6-aa32-48b3-a694-086f070787a2\") " pod="opendatahub/maas-controller-b78fdddb5-w66m7" Jul 14 11:47:08.396443 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.396415 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-644f64cffc-klcsf" Jul 14 11:47:08.494226 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.494197 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b78fdddb5-w66m7" Jul 14 11:47:08.539046 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.539020 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-644f64cffc-klcsf"] Jul 14 11:47:08.540752 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:47:08.540678 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2dbe732_c5be_4821_b917_5ba2d15eba7f.slice/crio-b0c9c2cfaa9010034ec31c226a3c589bd15f0d58ee5d07dd225b542fae293c03 WatchSource:0}: Error finding container b0c9c2cfaa9010034ec31c226a3c589bd15f0d58ee5d07dd225b542fae293c03: Status 404 returned error can't find the container with id b0c9c2cfaa9010034ec31c226a3c589bd15f0d58ee5d07dd225b542fae293c03 Jul 14 11:47:08.642937 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.642910 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b78fdddb5-w66m7"] Jul 14 11:47:08.645061 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:47:08.645036 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod505b92c6_aa32_48b3_a694_086f070787a2.slice/crio-cd3b41f3a0e90b4eda271799477cee30e26b61bd9dd8a64a3dccee116c4bde9c WatchSource:0}: Error finding container cd3b41f3a0e90b4eda271799477cee30e26b61bd9dd8a64a3dccee116c4bde9c: Status 404 returned error can't find the container with id cd3b41f3a0e90b4eda271799477cee30e26b61bd9dd8a64a3dccee116c4bde9c Jul 14 11:47:08.912007 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.911907 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b78fdddb5-w66m7" event={"ID":"505b92c6-aa32-48b3-a694-086f070787a2","Type":"ContainerStarted","Data":"cd3b41f3a0e90b4eda271799477cee30e26b61bd9dd8a64a3dccee116c4bde9c"} Jul 14 11:47:08.913044 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:08.913019 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-644f64cffc-klcsf" event={"ID":"b2dbe732-c5be-4821-b917-5ba2d15eba7f","Type":"ContainerStarted","Data":"b0c9c2cfaa9010034ec31c226a3c589bd15f0d58ee5d07dd225b542fae293c03"} Jul 14 11:47:11.931900 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:11.931864 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b78fdddb5-w66m7" event={"ID":"505b92c6-aa32-48b3-a694-086f070787a2","Type":"ContainerStarted","Data":"16d66cc2876709311a7a11e4ae8c0f465c0f0f6f5789d8c22dc4d64fb7c7d8c7"} Jul 14 11:47:11.932384 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:11.931985 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b78fdddb5-w66m7" Jul 14 11:47:11.933523 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:11.933487 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-644f64cffc-klcsf" event={"ID":"b2dbe732-c5be-4821-b917-5ba2d15eba7f","Type":"ContainerStarted","Data":"e6005fe882371c6ec2f1c6439342a898f9723f0854abf625d1a45267806afce4"} Jul 14 11:47:11.933640 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:11.933541 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-644f64cffc-klcsf" Jul 14 11:47:11.953624 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:11.953566 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-b78fdddb5-w66m7" podStartSLOduration=1.372635533 podStartE2EDuration="3.953548661s" totalImagesPullingTime="2.580913128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:47:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:47:11.952287445 +0000 UTC m=+562.314938749" watchObservedRunningTime="2026-07-14 11:47:11.953548661 +0000 UTC m=+562.316200026" Jul 14 11:47:11.971576 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:11.971525 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-644f64cffc-klcsf" podStartSLOduration=1.2980747799999999 podStartE2EDuration="3.971506985s" totalImagesPullingTime="2.673432205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:47:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:47:11.970636665 +0000 UTC m=+562.333287969" watchObservedRunningTime="2026-07-14 11:47:11.971506985 +0000 UTC m=+562.334158289" Jul 14 11:47:22.941474 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:22.941442 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b78fdddb5-w66m7" Jul 14 11:47:22.941953 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:22.941512 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-644f64cffc-klcsf" Jul 14 11:47:23.016950 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:23.016906 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-644f64cffc-klcsf"] Jul 14 11:47:23.017241 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:23.017212 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-644f64cffc-klcsf" podUID="b2dbe732-c5be-4821-b917-5ba2d15eba7f" containerName="manager" containerID="cri-o://e6005fe882371c6ec2f1c6439342a898f9723f0854abf625d1a45267806afce4" gracePeriod=30 Jul 14 11:47:23.267020 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:23.266991 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-644f64cffc-klcsf" Jul 14 11:47:23.308248 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:23.308212 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2dbe732-c5be-4821-b917-5ba2d15eba7f-webhook-cert\") pod \"b2dbe732-c5be-4821-b917-5ba2d15eba7f\" (UID: \"b2dbe732-c5be-4821-b917-5ba2d15eba7f\") " Jul 14 11:47:23.308436 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:23.308362 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfpm5\" (UniqueName: \"kubernetes.io/projected/b2dbe732-c5be-4821-b917-5ba2d15eba7f-kube-api-access-sfpm5\") pod \"b2dbe732-c5be-4821-b917-5ba2d15eba7f\" (UID: \"b2dbe732-c5be-4821-b917-5ba2d15eba7f\") " Jul 14 11:47:23.310408 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:23.310382 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2dbe732-c5be-4821-b917-5ba2d15eba7f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b2dbe732-c5be-4821-b917-5ba2d15eba7f" (UID: "b2dbe732-c5be-4821-b917-5ba2d15eba7f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:47:23.310532 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:23.310450 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2dbe732-c5be-4821-b917-5ba2d15eba7f-kube-api-access-sfpm5" (OuterVolumeSpecName: "kube-api-access-sfpm5") pod "b2dbe732-c5be-4821-b917-5ba2d15eba7f" (UID: "b2dbe732-c5be-4821-b917-5ba2d15eba7f"). InnerVolumeSpecName "kube-api-access-sfpm5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:47:23.409794 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:23.409754 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfpm5\" (UniqueName: \"kubernetes.io/projected/b2dbe732-c5be-4821-b917-5ba2d15eba7f-kube-api-access-sfpm5\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:47:23.409794 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:23.409779 2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2dbe732-c5be-4821-b917-5ba2d15eba7f-webhook-cert\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:47:23.992122 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:23.992076 2582 generic.go:356] "Generic (PLEG): container finished" podID="b2dbe732-c5be-4821-b917-5ba2d15eba7f" containerID="e6005fe882371c6ec2f1c6439342a898f9723f0854abf625d1a45267806afce4" exitCode=0 Jul 14 11:47:23.992535 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:23.992140 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-644f64cffc-klcsf" Jul 14 11:47:23.992535 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:23.992160 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-644f64cffc-klcsf" event={"ID":"b2dbe732-c5be-4821-b917-5ba2d15eba7f","Type":"ContainerDied","Data":"e6005fe882371c6ec2f1c6439342a898f9723f0854abf625d1a45267806afce4"} Jul 14 11:47:23.992535 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:23.992219 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-644f64cffc-klcsf" event={"ID":"b2dbe732-c5be-4821-b917-5ba2d15eba7f","Type":"ContainerDied","Data":"b0c9c2cfaa9010034ec31c226a3c589bd15f0d58ee5d07dd225b542fae293c03"} Jul 14 11:47:23.992535 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:23.992245 2582 scope.go:117] "RemoveContainer" containerID="e6005fe882371c6ec2f1c6439342a898f9723f0854abf625d1a45267806afce4" Jul 14 11:47:24.002350 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:24.002332 2582 scope.go:117] "RemoveContainer" containerID="e6005fe882371c6ec2f1c6439342a898f9723f0854abf625d1a45267806afce4" Jul 14 11:47:24.002656 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:47:24.002633 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6005fe882371c6ec2f1c6439342a898f9723f0854abf625d1a45267806afce4\": container with ID starting with e6005fe882371c6ec2f1c6439342a898f9723f0854abf625d1a45267806afce4 not found: ID does not exist" containerID="e6005fe882371c6ec2f1c6439342a898f9723f0854abf625d1a45267806afce4" Jul 14 11:47:24.002758 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:24.002660 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6005fe882371c6ec2f1c6439342a898f9723f0854abf625d1a45267806afce4"} err="failed to get container status \"e6005fe882371c6ec2f1c6439342a898f9723f0854abf625d1a45267806afce4\": rpc error: code = NotFound desc = could not find container \"e6005fe882371c6ec2f1c6439342a898f9723f0854abf625d1a45267806afce4\": container with ID starting with e6005fe882371c6ec2f1c6439342a898f9723f0854abf625d1a45267806afce4 not found: ID does not exist" Jul 14 11:47:24.019711 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:24.018629 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-644f64cffc-klcsf"] Jul 14 11:47:24.025749 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:24.025720 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-644f64cffc-klcsf"] Jul 14 11:47:24.292014 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:24.291926 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2dbe732-c5be-4821-b917-5ba2d15eba7f" path="/var/lib/kubelet/pods/b2dbe732-c5be-4821-b917-5ba2d15eba7f/volumes" Jul 14 11:47:42.107562 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:42.107525 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-67c78b686b-95gd4"] Jul 14 11:47:42.108028 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:42.107978 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2dbe732-c5be-4821-b917-5ba2d15eba7f" containerName="manager" Jul 14 11:47:42.108028 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:42.107991 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2dbe732-c5be-4821-b917-5ba2d15eba7f" containerName="manager" Jul 14 11:47:42.108165 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:42.108052 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2dbe732-c5be-4821-b917-5ba2d15eba7f" containerName="manager" Jul 14 11:47:42.112844 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:42.112823 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67c78b686b-95gd4" Jul 14 11:47:42.116868 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:42.116828 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-62k4x\"" Jul 14 11:47:42.118160 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:42.118136 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 14 11:47:42.130365 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:42.130337 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-67c78b686b-95gd4"] Jul 14 11:47:42.190451 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:42.190411 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b306a96-7cc8-426c-9cd9-479651106aa9-openshift-service-ca\") pod \"maas-api-67c78b686b-95gd4\" (UID: \"1b306a96-7cc8-426c-9cd9-479651106aa9\") " pod="odh-ai-gateway-infra/maas-api-67c78b686b-95gd4" Jul 14 11:47:42.190451 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:42.190453 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b306a96-7cc8-426c-9cd9-479651106aa9-maas-api-tls\") pod \"maas-api-67c78b686b-95gd4\" (UID: \"1b306a96-7cc8-426c-9cd9-479651106aa9\") " pod="odh-ai-gateway-infra/maas-api-67c78b686b-95gd4" Jul 14 11:47:42.190708 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:42.190531 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kj68\" (UniqueName: \"kubernetes.io/projected/1b306a96-7cc8-426c-9cd9-479651106aa9-kube-api-access-9kj68\") pod \"maas-api-67c78b686b-95gd4\" (UID: \"1b306a96-7cc8-426c-9cd9-479651106aa9\") " pod="odh-ai-gateway-infra/maas-api-67c78b686b-95gd4" Jul 14 11:47:42.291067 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:42.291030 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b306a96-7cc8-426c-9cd9-479651106aa9-maas-api-tls\") pod \"maas-api-67c78b686b-95gd4\" (UID: \"1b306a96-7cc8-426c-9cd9-479651106aa9\") " pod="odh-ai-gateway-infra/maas-api-67c78b686b-95gd4" Jul 14 11:47:42.291261 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:42.291080 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kj68\" (UniqueName: \"kubernetes.io/projected/1b306a96-7cc8-426c-9cd9-479651106aa9-kube-api-access-9kj68\") pod \"maas-api-67c78b686b-95gd4\" (UID: \"1b306a96-7cc8-426c-9cd9-479651106aa9\") " pod="odh-ai-gateway-infra/maas-api-67c78b686b-95gd4" Jul 14 11:47:42.291261 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:42.291190 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b306a96-7cc8-426c-9cd9-479651106aa9-openshift-service-ca\") pod \"maas-api-67c78b686b-95gd4\" (UID: \"1b306a96-7cc8-426c-9cd9-479651106aa9\") " pod="odh-ai-gateway-infra/maas-api-67c78b686b-95gd4" Jul 14 11:47:42.291870 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:42.291844 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b306a96-7cc8-426c-9cd9-479651106aa9-openshift-service-ca\") pod \"maas-api-67c78b686b-95gd4\" (UID: \"1b306a96-7cc8-426c-9cd9-479651106aa9\") " pod="odh-ai-gateway-infra/maas-api-67c78b686b-95gd4" Jul 14 11:47:42.293605 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:42.293585 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b306a96-7cc8-426c-9cd9-479651106aa9-maas-api-tls\") pod \"maas-api-67c78b686b-95gd4\" (UID: \"1b306a96-7cc8-426c-9cd9-479651106aa9\") " pod="odh-ai-gateway-infra/maas-api-67c78b686b-95gd4" Jul 14 11:47:42.304596 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:42.304575 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kj68\" (UniqueName: \"kubernetes.io/projected/1b306a96-7cc8-426c-9cd9-479651106aa9-kube-api-access-9kj68\") pod \"maas-api-67c78b686b-95gd4\" (UID: \"1b306a96-7cc8-426c-9cd9-479651106aa9\") " pod="odh-ai-gateway-infra/maas-api-67c78b686b-95gd4" Jul 14 11:47:42.423902 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:42.423825 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67c78b686b-95gd4" Jul 14 11:47:42.577078 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:42.577052 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-67c78b686b-95gd4"] Jul 14 11:47:42.579292 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:47:42.579262 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b306a96_7cc8_426c_9cd9_479651106aa9.slice/crio-f251a1578e13f41607321813d0e69ef7e8dc12bc59233c12f358987f7fa95752 WatchSource:0}: Error finding container f251a1578e13f41607321813d0e69ef7e8dc12bc59233c12f358987f7fa95752: Status 404 returned error can't find the container with id f251a1578e13f41607321813d0e69ef7e8dc12bc59233c12f358987f7fa95752 Jul 14 11:47:42.808241 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:42.808205 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-r5xf6"] Jul 14 11:47:42.846015 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:42.845985 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-r5xf6"] Jul 14 11:47:42.846212 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:42.846102 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-r5xf6" Jul 14 11:47:42.849170 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:42.849145 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 14 11:47:42.849297 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:42.849262 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-h6nsc\"" Jul 14 11:47:42.998280 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:42.998241 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e8fdda3-85e3-47bc-8c2f-4fa9b417a496-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-r5xf6\" (UID: \"5e8fdda3-85e3-47bc-8c2f-4fa9b417a496\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-r5xf6" Jul 14 11:47:42.998447 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:42.998328 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mv2w\" (UniqueName: \"kubernetes.io/projected/5e8fdda3-85e3-47bc-8c2f-4fa9b417a496-kube-api-access-2mv2w\") pod \"payload-processing-f9b8d9b9b-r5xf6\" (UID: \"5e8fdda3-85e3-47bc-8c2f-4fa9b417a496\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-r5xf6" Jul 14 11:47:43.087085 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:43.086998 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67c78b686b-95gd4" event={"ID":"1b306a96-7cc8-426c-9cd9-479651106aa9","Type":"ContainerStarted","Data":"f251a1578e13f41607321813d0e69ef7e8dc12bc59233c12f358987f7fa95752"} Jul 14 11:47:43.099140 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:43.099087 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e8fdda3-85e3-47bc-8c2f-4fa9b417a496-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-r5xf6\" (UID: \"5e8fdda3-85e3-47bc-8c2f-4fa9b417a496\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-r5xf6" Jul 14 11:47:43.099295 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:43.099201 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mv2w\" (UniqueName: \"kubernetes.io/projected/5e8fdda3-85e3-47bc-8c2f-4fa9b417a496-kube-api-access-2mv2w\") pod \"payload-processing-f9b8d9b9b-r5xf6\" (UID: \"5e8fdda3-85e3-47bc-8c2f-4fa9b417a496\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-r5xf6" Jul 14 11:47:43.099901 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:43.099880 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e8fdda3-85e3-47bc-8c2f-4fa9b417a496-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-r5xf6\" (UID: \"5e8fdda3-85e3-47bc-8c2f-4fa9b417a496\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-r5xf6" Jul 14 11:47:43.108585 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:43.108546 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mv2w\" (UniqueName: \"kubernetes.io/projected/5e8fdda3-85e3-47bc-8c2f-4fa9b417a496-kube-api-access-2mv2w\") pod \"payload-processing-f9b8d9b9b-r5xf6\" (UID: \"5e8fdda3-85e3-47bc-8c2f-4fa9b417a496\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-r5xf6" Jul 14 11:47:43.157227 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:43.157190 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-r5xf6" Jul 14 11:47:43.298541 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:43.298505 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-r5xf6"] Jul 14 11:47:43.302565 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:47:43.302477 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e8fdda3_85e3_47bc_8c2f_4fa9b417a496.slice/crio-a140acf48aeb28b13b42915879db32c84e0f7e2558a4632ca233bb5634e3c6d6 WatchSource:0}: Error finding container a140acf48aeb28b13b42915879db32c84e0f7e2558a4632ca233bb5634e3c6d6: Status 404 returned error can't find the container with id a140acf48aeb28b13b42915879db32c84e0f7e2558a4632ca233bb5634e3c6d6 Jul 14 11:47:44.096600 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:44.096547 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-r5xf6" event={"ID":"5e8fdda3-85e3-47bc-8c2f-4fa9b417a496","Type":"ContainerStarted","Data":"a140acf48aeb28b13b42915879db32c84e0f7e2558a4632ca233bb5634e3c6d6"} Jul 14 11:47:45.102711 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:45.102674 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67c78b686b-95gd4" event={"ID":"1b306a96-7cc8-426c-9cd9-479651106aa9","Type":"ContainerStarted","Data":"c0d81b8685eade2a97f32409aea9180e5a35205359f6d57a06d9113f99ad122c"} Jul 14 11:47:45.103175 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:45.102790 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-67c78b686b-95gd4" Jul 14 11:47:45.104400 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:45.104373 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-r5xf6" event={"ID":"5e8fdda3-85e3-47bc-8c2f-4fa9b417a496","Type":"ContainerStarted","Data":"a1f0c63d61a3967a3661b5e46b06271dfc1e89f30d968fd443709b9490e63216"} Jul 14 11:47:45.104534 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:45.104426 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-r5xf6" Jul 14 11:47:45.137371 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:45.137266 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-67c78b686b-95gd4" podStartSLOduration=1.690621391 podStartE2EDuration="3.137251041s" totalImagesPullingTime="1.44662965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:47:45.135161739 +0000 UTC m=+595.497813041" watchObservedRunningTime="2026-07-14 11:47:45.137251041 +0000 UTC m=+595.499902343" Jul 14 11:47:45.157529 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:45.157472 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-r5xf6" podStartSLOduration=1.605200177 podStartE2EDuration="3.157456216s" totalImagesPullingTime="1.552256039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:47:45.155731663 +0000 UTC m=+595.518382967" watchObservedRunningTime="2026-07-14 11:47:45.157456216 +0000 UTC m=+595.520107518" Jul 14 11:47:51.114197 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:51.114167 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-67c78b686b-95gd4" Jul 14 11:47:56.110907 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:47:56.110876 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-r5xf6" Jul 14 11:48:43.917546 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:43.917508 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc"] Jul 14 11:48:43.920939 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:43.920917 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc" Jul 14 11:48:43.928413 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:43.928372 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 14 11:48:43.929549 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:43.929524 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 14 11:48:43.929549 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:43.929535 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8qpv8\"" Jul 14 11:48:43.929703 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:43.929623 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 14 11:48:43.933704 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:43.933667 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc"] Jul 14 11:48:43.964328 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:43.964290 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5669f9e2-00d4-45cf-8ec5-9c6661e1c76d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b9sfc\" (UID: \"5669f9e2-00d4-45cf-8ec5-9c6661e1c76d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc" Jul 14 11:48:43.964515 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:43.964339 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5669f9e2-00d4-45cf-8ec5-9c6661e1c76d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b9sfc\" (UID: \"5669f9e2-00d4-45cf-8ec5-9c6661e1c76d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc" Jul 14 11:48:43.964515 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:43.964438 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5669f9e2-00d4-45cf-8ec5-9c6661e1c76d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b9sfc\" (UID: \"5669f9e2-00d4-45cf-8ec5-9c6661e1c76d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc" Jul 14 11:48:43.964515 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:43.964459 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5669f9e2-00d4-45cf-8ec5-9c6661e1c76d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b9sfc\" (UID: \"5669f9e2-00d4-45cf-8ec5-9c6661e1c76d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc" Jul 14 11:48:43.964515 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:43.964483 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5669f9e2-00d4-45cf-8ec5-9c6661e1c76d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b9sfc\" (UID: \"5669f9e2-00d4-45cf-8ec5-9c6661e1c76d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc" Jul 14 11:48:43.964712 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:43.964556 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcgk6\" (UniqueName: \"kubernetes.io/projected/5669f9e2-00d4-45cf-8ec5-9c6661e1c76d-kube-api-access-lcgk6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b9sfc\" (UID: \"5669f9e2-00d4-45cf-8ec5-9c6661e1c76d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc" Jul 14 11:48:44.065862 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:44.065823 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5669f9e2-00d4-45cf-8ec5-9c6661e1c76d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b9sfc\" (UID: \"5669f9e2-00d4-45cf-8ec5-9c6661e1c76d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc" Jul 14 11:48:44.066049 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:44.065877 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5669f9e2-00d4-45cf-8ec5-9c6661e1c76d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b9sfc\" (UID: \"5669f9e2-00d4-45cf-8ec5-9c6661e1c76d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc" Jul 14 11:48:44.066049 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:44.065944 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5669f9e2-00d4-45cf-8ec5-9c6661e1c76d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b9sfc\" (UID: \"5669f9e2-00d4-45cf-8ec5-9c6661e1c76d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc" Jul 14 11:48:44.066049 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:44.065966 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5669f9e2-00d4-45cf-8ec5-9c6661e1c76d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b9sfc\" (UID: \"5669f9e2-00d4-45cf-8ec5-9c6661e1c76d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc" Jul 14 11:48:44.066049 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:44.065989 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5669f9e2-00d4-45cf-8ec5-9c6661e1c76d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b9sfc\" (UID: \"5669f9e2-00d4-45cf-8ec5-9c6661e1c76d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc" Jul 14 11:48:44.066303 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:44.066138 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcgk6\" (UniqueName: \"kubernetes.io/projected/5669f9e2-00d4-45cf-8ec5-9c6661e1c76d-kube-api-access-lcgk6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b9sfc\" (UID: \"5669f9e2-00d4-45cf-8ec5-9c6661e1c76d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc" Jul 14 11:48:44.066359 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:44.066297 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5669f9e2-00d4-45cf-8ec5-9c6661e1c76d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b9sfc\" (UID: \"5669f9e2-00d4-45cf-8ec5-9c6661e1c76d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc" Jul 14 11:48:44.066359 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:44.066343 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5669f9e2-00d4-45cf-8ec5-9c6661e1c76d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b9sfc\" (UID: \"5669f9e2-00d4-45cf-8ec5-9c6661e1c76d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc" Jul 14 11:48:44.066443 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:44.066416 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5669f9e2-00d4-45cf-8ec5-9c6661e1c76d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b9sfc\" (UID: \"5669f9e2-00d4-45cf-8ec5-9c6661e1c76d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc" Jul 14 11:48:44.068321 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:44.068300 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5669f9e2-00d4-45cf-8ec5-9c6661e1c76d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b9sfc\" (UID: \"5669f9e2-00d4-45cf-8ec5-9c6661e1c76d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc" Jul 14 11:48:44.068435 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:44.068419 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5669f9e2-00d4-45cf-8ec5-9c6661e1c76d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b9sfc\" (UID: \"5669f9e2-00d4-45cf-8ec5-9c6661e1c76d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc" Jul 14 11:48:44.075861 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:44.075837 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcgk6\" (UniqueName: \"kubernetes.io/projected/5669f9e2-00d4-45cf-8ec5-9c6661e1c76d-kube-api-access-lcgk6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b9sfc\" (UID: \"5669f9e2-00d4-45cf-8ec5-9c6661e1c76d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc" Jul 14 11:48:44.239552 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:44.239516 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc" Jul 14 11:48:44.383960 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:44.383927 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc"] Jul 14 11:48:44.387393 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:48:44.387366 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5669f9e2_00d4_45cf_8ec5_9c6661e1c76d.slice/crio-c0860af915a94c0b6a00061fa0c2037c3d14b374d9bcf147d8e18645c39d9544 WatchSource:0}: Error finding container c0860af915a94c0b6a00061fa0c2037c3d14b374d9bcf147d8e18645c39d9544: Status 404 returned error can't find the container with id c0860af915a94c0b6a00061fa0c2037c3d14b374d9bcf147d8e18645c39d9544 Jul 14 11:48:44.388644 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:44.388628 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 11:48:45.392215 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:45.392175 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc" event={"ID":"5669f9e2-00d4-45cf-8ec5-9c6661e1c76d","Type":"ContainerStarted","Data":"c0860af915a94c0b6a00061fa0c2037c3d14b374d9bcf147d8e18645c39d9544"} Jul 14 11:48:46.399158 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:46.399119 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc" event={"ID":"5669f9e2-00d4-45cf-8ec5-9c6661e1c76d","Type":"ContainerStarted","Data":"decb75cd5684cc8c12cdd24d5da1e1108f98dcdd8c9d9ebede686fa897e87330"} Jul 14 11:48:46.423606 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:46.423553 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc" podStartSLOduration=2.370104218 podStartE2EDuration="3.423535571s" totalImagesPullingTime="1.053431353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:48:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:48:46.421365794 +0000 UTC m=+656.784017098" watchObservedRunningTime="2026-07-14 11:48:46.423535571 +0000 UTC m=+656.786186874" Jul 14 11:48:54.239953 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:54.239906 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc" Jul 14 11:48:54.240397 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:54.239980 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc" Jul 14 11:48:54.252756 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:54.252727 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc" Jul 14 11:48:54.385587 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:54.385547 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj"] Jul 14 11:48:54.389264 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:54.389240 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj" Jul 14 11:48:54.392448 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:54.392423 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 14 11:48:54.401236 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:54.401208 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj"] Jul 14 11:48:54.449387 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:54.449358 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b9sfc" Jul 14 11:48:54.466343 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:54.466300 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/315ee210-ca26-487f-b404-a2f3e868529e-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj\" (UID: \"315ee210-ca26-487f-b404-a2f3e868529e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj" Jul 14 11:48:54.466343 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:54.466346 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zkmk\" (UniqueName: \"kubernetes.io/projected/315ee210-ca26-487f-b404-a2f3e868529e-kube-api-access-4zkmk\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj\" (UID: \"315ee210-ca26-487f-b404-a2f3e868529e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj" Jul 14 11:48:54.466587 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:54.466437 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/315ee210-ca26-487f-b404-a2f3e868529e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj\" (UID: \"315ee210-ca26-487f-b404-a2f3e868529e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj" Jul 14 11:48:54.466587 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:54.466501 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/315ee210-ca26-487f-b404-a2f3e868529e-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj\" (UID: \"315ee210-ca26-487f-b404-a2f3e868529e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj" Jul 14 11:48:54.466587 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:54.466579 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/315ee210-ca26-487f-b404-a2f3e868529e-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj\" (UID: \"315ee210-ca26-487f-b404-a2f3e868529e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj" Jul 14 11:48:54.466691 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:54.466599 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/315ee210-ca26-487f-b404-a2f3e868529e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj\" (UID: \"315ee210-ca26-487f-b404-a2f3e868529e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj" Jul 14 11:48:54.568210 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:54.568089 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/315ee210-ca26-487f-b404-a2f3e868529e-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj\" (UID: \"315ee210-ca26-487f-b404-a2f3e868529e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj" Jul 14 11:48:54.568210 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:54.568159 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/315ee210-ca26-487f-b404-a2f3e868529e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj\" (UID: \"315ee210-ca26-487f-b404-a2f3e868529e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj" Jul 14 11:48:54.568210 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:54.568197 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/315ee210-ca26-487f-b404-a2f3e868529e-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj\" (UID: \"315ee210-ca26-487f-b404-a2f3e868529e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj" Jul 14 11:48:54.568459 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:54.568226 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zkmk\" (UniqueName: \"kubernetes.io/projected/315ee210-ca26-487f-b404-a2f3e868529e-kube-api-access-4zkmk\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj\" (UID: \"315ee210-ca26-487f-b404-a2f3e868529e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj" Jul 14 11:48:54.568459 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:54.568349 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/315ee210-ca26-487f-b404-a2f3e868529e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj\" (UID: \"315ee210-ca26-487f-b404-a2f3e868529e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj" Jul 14 11:48:54.568459 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:54.568394 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/315ee210-ca26-487f-b404-a2f3e868529e-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj\" (UID: \"315ee210-ca26-487f-b404-a2f3e868529e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj" Jul 14 11:48:54.568645 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:54.568620 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/315ee210-ca26-487f-b404-a2f3e868529e-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj\" (UID: \"315ee210-ca26-487f-b404-a2f3e868529e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj" Jul 14 11:48:54.568850 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:54.568818 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/315ee210-ca26-487f-b404-a2f3e868529e-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj\" (UID: \"315ee210-ca26-487f-b404-a2f3e868529e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj" Jul 14 11:48:54.568975 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:54.568862 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/315ee210-ca26-487f-b404-a2f3e868529e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj\" (UID: \"315ee210-ca26-487f-b404-a2f3e868529e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj" Jul 14 11:48:54.570451 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:54.570429 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/315ee210-ca26-487f-b404-a2f3e868529e-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj\" (UID: \"315ee210-ca26-487f-b404-a2f3e868529e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj" Jul 14 11:48:54.571110 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:54.571073 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/315ee210-ca26-487f-b404-a2f3e868529e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj\" (UID: \"315ee210-ca26-487f-b404-a2f3e868529e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj" Jul 14 11:48:54.581588 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:54.581556 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zkmk\" (UniqueName: \"kubernetes.io/projected/315ee210-ca26-487f-b404-a2f3e868529e-kube-api-access-4zkmk\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj\" (UID: \"315ee210-ca26-487f-b404-a2f3e868529e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj" Jul 14 11:48:54.713310 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:54.713271 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj" Jul 14 11:48:54.861388 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:54.861363 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj"] Jul 14 11:48:54.863639 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:48:54.863610 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod315ee210_ca26_487f_b404_a2f3e868529e.slice/crio-86f3cd3c6d150481162581c17907007a5cee72411dab27fca98ca29a7a9d4c53 WatchSource:0}: Error finding container 86f3cd3c6d150481162581c17907007a5cee72411dab27fca98ca29a7a9d4c53: Status 404 returned error can't find the container with id 86f3cd3c6d150481162581c17907007a5cee72411dab27fca98ca29a7a9d4c53 Jul 14 11:48:55.444630 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:55.444590 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj" event={"ID":"315ee210-ca26-487f-b404-a2f3e868529e","Type":"ContainerStarted","Data":"b687df6dc7ffafa9b3c62d7b89d5f363d5a0f2dc390e83407e9cdfb88da05e37"} Jul 14 11:48:55.444630 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:55.444636 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj" event={"ID":"315ee210-ca26-487f-b404-a2f3e868529e","Type":"ContainerStarted","Data":"86f3cd3c6d150481162581c17907007a5cee72411dab27fca98ca29a7a9d4c53"} Jul 14 11:48:55.466763 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:48:55.466714 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj" podStartSLOduration=1.291106967 podStartE2EDuration="1.466699195s" totalImagesPullingTime="175.592228ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:48:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:48:55.464733022 +0000 UTC m=+665.827384319" watchObservedRunningTime="2026-07-14 11:48:55.466699195 +0000 UTC m=+665.829350499" Jul 14 11:49:04.714159 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:49:04.714084 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj" Jul 14 11:49:04.714689 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:49:04.714177 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj" Jul 14 11:49:04.727136 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:49:04.727087 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj" Jul 14 11:49:05.509379 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:49:05.509349 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj" Jul 14 11:49:48.519932 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:49:48.519858 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-bb77cfb67-lz9ds"] Jul 14 11:49:48.523409 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:49:48.523382 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bb77cfb67-lz9ds" Jul 14 11:49:48.527420 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:49:48.527395 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rnk6k\"" Jul 14 11:49:48.527563 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:49:48.527395 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 14 11:49:48.538744 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:49:48.538712 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-bb77cfb67-lz9ds"] Jul 14 11:49:48.692600 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:49:48.692559 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbwrt\" (UniqueName: \"kubernetes.io/projected/76452430-32cb-4189-a9fa-3c58b7b4e713-kube-api-access-hbwrt\") pod \"authorino-bb77cfb67-lz9ds\" (UID: \"76452430-32cb-4189-a9fa-3c58b7b4e713\") " pod="kuadrant-system/authorino-bb77cfb67-lz9ds" Jul 14 11:49:48.692780 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:49:48.692613 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/76452430-32cb-4189-a9fa-3c58b7b4e713-tls-cert\") pod \"authorino-bb77cfb67-lz9ds\" (UID: \"76452430-32cb-4189-a9fa-3c58b7b4e713\") " pod="kuadrant-system/authorino-bb77cfb67-lz9ds" Jul 14 11:49:48.793884 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:49:48.793776 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbwrt\" (UniqueName: \"kubernetes.io/projected/76452430-32cb-4189-a9fa-3c58b7b4e713-kube-api-access-hbwrt\") pod \"authorino-bb77cfb67-lz9ds\" (UID: \"76452430-32cb-4189-a9fa-3c58b7b4e713\") " pod="kuadrant-system/authorino-bb77cfb67-lz9ds" Jul 14 11:49:48.793884 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:49:48.793835 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/76452430-32cb-4189-a9fa-3c58b7b4e713-tls-cert\") pod \"authorino-bb77cfb67-lz9ds\" (UID: \"76452430-32cb-4189-a9fa-3c58b7b4e713\") " pod="kuadrant-system/authorino-bb77cfb67-lz9ds" Jul 14 11:49:48.796443 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:49:48.796408 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/76452430-32cb-4189-a9fa-3c58b7b4e713-tls-cert\") pod \"authorino-bb77cfb67-lz9ds\" (UID: \"76452430-32cb-4189-a9fa-3c58b7b4e713\") " pod="kuadrant-system/authorino-bb77cfb67-lz9ds" Jul 14 11:49:48.803193 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:49:48.803159 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbwrt\" (UniqueName: \"kubernetes.io/projected/76452430-32cb-4189-a9fa-3c58b7b4e713-kube-api-access-hbwrt\") pod \"authorino-bb77cfb67-lz9ds\" (UID: \"76452430-32cb-4189-a9fa-3c58b7b4e713\") " pod="kuadrant-system/authorino-bb77cfb67-lz9ds" Jul 14 11:49:48.834193 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:49:48.834155 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bb77cfb67-lz9ds" Jul 14 11:49:48.995704 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:49:48.995680 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-bb77cfb67-lz9ds"] Jul 14 11:49:48.997459 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:49:48.997428 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76452430_32cb_4189_a9fa_3c58b7b4e713.slice/crio-c70b242058a5dedb067c4a740e13e106f0e2d95fa4177a63449784e23f9176c5 WatchSource:0}: Error finding container c70b242058a5dedb067c4a740e13e106f0e2d95fa4177a63449784e23f9176c5: Status 404 returned error can't find the container with id c70b242058a5dedb067c4a740e13e106f0e2d95fa4177a63449784e23f9176c5 Jul 14 11:49:49.737001 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:49:49.736961 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-bb77cfb67-lz9ds" event={"ID":"76452430-32cb-4189-a9fa-3c58b7b4e713","Type":"ContainerStarted","Data":"59ee0efc92b6883d9e5cfd2b607378d2b66b4e6801fbf8a674c3537afa7b7f89"} Jul 14 11:49:49.737001 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:49:49.737005 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-bb77cfb67-lz9ds" event={"ID":"76452430-32cb-4189-a9fa-3c58b7b4e713","Type":"ContainerStarted","Data":"c70b242058a5dedb067c4a740e13e106f0e2d95fa4177a63449784e23f9176c5"} Jul 14 11:49:49.757289 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:49:49.757223 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-bb77cfb67-lz9ds" podStartSLOduration=1.443151302 podStartE2EDuration="1.757202114s" totalImagesPullingTime="314.050812ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:49:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:49:49.756272914 +0000 UTC m=+720.118924218" watchObservedRunningTime="2026-07-14 11:49:49.757202114 +0000 UTC m=+720.119853421" Jul 14 11:51:02.677202 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:02.677168 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b78fdddb5-w66m7"] Jul 14 11:51:02.677700 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:02.677364 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-b78fdddb5-w66m7" podUID="505b92c6-aa32-48b3-a694-086f070787a2" containerName="manager" containerID="cri-o://16d66cc2876709311a7a11e4ae8c0f465c0f0f6f5789d8c22dc4d64fb7c7d8c7" gracePeriod=30 Jul 14 11:51:02.928944 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:02.928881 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b78fdddb5-w66m7" Jul 14 11:51:03.028727 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:03.028694 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/505b92c6-aa32-48b3-a694-086f070787a2-webhook-cert\") pod \"505b92c6-aa32-48b3-a694-086f070787a2\" (UID: \"505b92c6-aa32-48b3-a694-086f070787a2\") " Jul 14 11:51:03.028931 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:03.028766 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nr8lb\" (UniqueName: \"kubernetes.io/projected/505b92c6-aa32-48b3-a694-086f070787a2-kube-api-access-nr8lb\") pod \"505b92c6-aa32-48b3-a694-086f070787a2\" (UID: \"505b92c6-aa32-48b3-a694-086f070787a2\") " Jul 14 11:51:03.030842 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:03.030813 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/505b92c6-aa32-48b3-a694-086f070787a2-kube-api-access-nr8lb" (OuterVolumeSpecName: "kube-api-access-nr8lb") pod "505b92c6-aa32-48b3-a694-086f070787a2" (UID: "505b92c6-aa32-48b3-a694-086f070787a2"). InnerVolumeSpecName "kube-api-access-nr8lb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:51:03.030842 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:03.030831 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/505b92c6-aa32-48b3-a694-086f070787a2-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "505b92c6-aa32-48b3-a694-086f070787a2" (UID: "505b92c6-aa32-48b3-a694-086f070787a2"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:51:03.103814 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:03.103776 2582 generic.go:356] "Generic (PLEG): container finished" podID="505b92c6-aa32-48b3-a694-086f070787a2" containerID="16d66cc2876709311a7a11e4ae8c0f465c0f0f6f5789d8c22dc4d64fb7c7d8c7" exitCode=0 Jul 14 11:51:03.103814 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:03.103819 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b78fdddb5-w66m7" Jul 14 11:51:03.104013 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:03.103856 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b78fdddb5-w66m7" event={"ID":"505b92c6-aa32-48b3-a694-086f070787a2","Type":"ContainerDied","Data":"16d66cc2876709311a7a11e4ae8c0f465c0f0f6f5789d8c22dc4d64fb7c7d8c7"} Jul 14 11:51:03.104013 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:03.103907 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b78fdddb5-w66m7" event={"ID":"505b92c6-aa32-48b3-a694-086f070787a2","Type":"ContainerDied","Data":"cd3b41f3a0e90b4eda271799477cee30e26b61bd9dd8a64a3dccee116c4bde9c"} Jul 14 11:51:03.104013 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:03.103930 2582 scope.go:117] "RemoveContainer" containerID="16d66cc2876709311a7a11e4ae8c0f465c0f0f6f5789d8c22dc4d64fb7c7d8c7" Jul 14 11:51:03.112851 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:03.112832 2582 scope.go:117] "RemoveContainer" containerID="16d66cc2876709311a7a11e4ae8c0f465c0f0f6f5789d8c22dc4d64fb7c7d8c7" Jul 14 11:51:03.113185 ip-10-0-136-205 kubenswrapper[2582]: E0714 11:51:03.113162 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16d66cc2876709311a7a11e4ae8c0f465c0f0f6f5789d8c22dc4d64fb7c7d8c7\": container with ID starting with 16d66cc2876709311a7a11e4ae8c0f465c0f0f6f5789d8c22dc4d64fb7c7d8c7 not found: ID does not exist" containerID="16d66cc2876709311a7a11e4ae8c0f465c0f0f6f5789d8c22dc4d64fb7c7d8c7" Jul 14 11:51:03.113290 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:03.113193 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16d66cc2876709311a7a11e4ae8c0f465c0f0f6f5789d8c22dc4d64fb7c7d8c7"} err="failed to get container status \"16d66cc2876709311a7a11e4ae8c0f465c0f0f6f5789d8c22dc4d64fb7c7d8c7\": rpc error: code = NotFound desc = could not find container \"16d66cc2876709311a7a11e4ae8c0f465c0f0f6f5789d8c22dc4d64fb7c7d8c7\": container with ID starting with 16d66cc2876709311a7a11e4ae8c0f465c0f0f6f5789d8c22dc4d64fb7c7d8c7 not found: ID does not exist" Jul 14 11:51:03.129799 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:03.129773 2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/505b92c6-aa32-48b3-a694-086f070787a2-webhook-cert\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:51:03.129799 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:03.129799 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nr8lb\" (UniqueName: \"kubernetes.io/projected/505b92c6-aa32-48b3-a694-086f070787a2-kube-api-access-nr8lb\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 11:51:03.134994 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:03.134967 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b78fdddb5-w66m7"] Jul 14 11:51:03.155457 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:03.155429 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-b78fdddb5-w66m7"] Jul 14 11:51:04.060052 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:04.060009 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b78fdddb5-f8td5"] Jul 14 11:51:04.060624 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:04.060601 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="505b92c6-aa32-48b3-a694-086f070787a2" containerName="manager" Jul 14 11:51:04.060713 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:04.060626 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="505b92c6-aa32-48b3-a694-086f070787a2" containerName="manager" Jul 14 11:51:04.060768 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:04.060757 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="505b92c6-aa32-48b3-a694-086f070787a2" containerName="manager" Jul 14 11:51:04.065089 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:04.065063 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b78fdddb5-f8td5" Jul 14 11:51:04.074893 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:04.074868 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7ssq8\"" Jul 14 11:51:04.075042 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:04.074903 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 14 11:51:04.075042 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:04.074930 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 14 11:51:04.081018 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:04.080983 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b78fdddb5-f8td5"] Jul 14 11:51:04.139650 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:04.139609 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/de82ed98-f182-4fc9-ae2d-c001d40f7174-webhook-cert\") pod \"maas-controller-b78fdddb5-f8td5\" (UID: \"de82ed98-f182-4fc9-ae2d-c001d40f7174\") " pod="opendatahub/maas-controller-b78fdddb5-f8td5" Jul 14 11:51:04.139836 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:04.139752 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hl68\" (UniqueName: \"kubernetes.io/projected/de82ed98-f182-4fc9-ae2d-c001d40f7174-kube-api-access-7hl68\") pod \"maas-controller-b78fdddb5-f8td5\" (UID: \"de82ed98-f182-4fc9-ae2d-c001d40f7174\") " pod="opendatahub/maas-controller-b78fdddb5-f8td5" Jul 14 11:51:04.240798 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:04.240759 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hl68\" (UniqueName: \"kubernetes.io/projected/de82ed98-f182-4fc9-ae2d-c001d40f7174-kube-api-access-7hl68\") pod \"maas-controller-b78fdddb5-f8td5\" (UID: \"de82ed98-f182-4fc9-ae2d-c001d40f7174\") " pod="opendatahub/maas-controller-b78fdddb5-f8td5" Jul 14 11:51:04.240969 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:04.240843 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/de82ed98-f182-4fc9-ae2d-c001d40f7174-webhook-cert\") pod \"maas-controller-b78fdddb5-f8td5\" (UID: \"de82ed98-f182-4fc9-ae2d-c001d40f7174\") " pod="opendatahub/maas-controller-b78fdddb5-f8td5" Jul 14 11:51:04.243570 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:04.243545 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/de82ed98-f182-4fc9-ae2d-c001d40f7174-webhook-cert\") pod \"maas-controller-b78fdddb5-f8td5\" (UID: \"de82ed98-f182-4fc9-ae2d-c001d40f7174\") " pod="opendatahub/maas-controller-b78fdddb5-f8td5" Jul 14 11:51:04.258522 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:04.258490 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hl68\" (UniqueName: \"kubernetes.io/projected/de82ed98-f182-4fc9-ae2d-c001d40f7174-kube-api-access-7hl68\") pod \"maas-controller-b78fdddb5-f8td5\" (UID: \"de82ed98-f182-4fc9-ae2d-c001d40f7174\") " pod="opendatahub/maas-controller-b78fdddb5-f8td5" Jul 14 11:51:04.292933 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:04.292897 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="505b92c6-aa32-48b3-a694-086f070787a2" path="/var/lib/kubelet/pods/505b92c6-aa32-48b3-a694-086f070787a2/volumes" Jul 14 11:51:04.375768 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:04.375671 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b78fdddb5-f8td5" Jul 14 11:51:04.517665 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:04.517636 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b78fdddb5-f8td5"] Jul 14 11:51:04.519342 ip-10-0-136-205 kubenswrapper[2582]: W0714 11:51:04.519307 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde82ed98_f182_4fc9_ae2d_c001d40f7174.slice/crio-cd7d3456b96f1526c55b072e6c74c8d68bbe5af6e8045deac467ef6dd6428ac6 WatchSource:0}: Error finding container cd7d3456b96f1526c55b072e6c74c8d68bbe5af6e8045deac467ef6dd6428ac6: Status 404 returned error can't find the container with id cd7d3456b96f1526c55b072e6c74c8d68bbe5af6e8045deac467ef6dd6428ac6 Jul 14 11:51:05.116762 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:05.116727 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b78fdddb5-f8td5" event={"ID":"de82ed98-f182-4fc9-ae2d-c001d40f7174","Type":"ContainerStarted","Data":"f92eb9f34e08a6045b4c74931b48ef456bd7ba788878b582168ac4d79587cee4"} Jul 14 11:51:05.117252 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:05.116784 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b78fdddb5-f8td5" event={"ID":"de82ed98-f182-4fc9-ae2d-c001d40f7174","Type":"ContainerStarted","Data":"cd7d3456b96f1526c55b072e6c74c8d68bbe5af6e8045deac467ef6dd6428ac6"} Jul 14 11:51:05.117252 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:05.116812 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b78fdddb5-f8td5" Jul 14 11:51:05.149986 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:05.149926 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-b78fdddb5-f8td5" podStartSLOduration=0.661848251 podStartE2EDuration="1.149908411s" totalImagesPullingTime="488.06016ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:51:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:51:05.148212349 +0000 UTC m=+795.510863654" watchObservedRunningTime="2026-07-14 11:51:05.149908411 +0000 UTC m=+795.512559715" Jul 14 11:51:16.124612 ip-10-0-136-205 kubenswrapper[2582]: I0714 11:51:16.124529 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b78fdddb5-f8td5" Jul 14 12:15:00.137895 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:00.137854 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733855-r62rq"] Jul 14 12:15:00.141933 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:00.141906 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a015ba-29733855-6k2nd"] Jul 14 12:15:00.142105 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:00.142018 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733855-r62rq" Jul 14 12:15:00.144868 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:00.144844 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7pf27\"" Jul 14 12:15:00.145259 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:00.145243 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a015ba-29733855-6k2nd" Jul 14 12:15:00.151341 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:00.151314 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733855-r62rq"] Jul 14 12:15:00.155027 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:00.155003 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733855-r62rq" Jul 14 12:15:00.155647 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:00.155619 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a015ba-29733855-6k2nd"] Jul 14 12:15:00.164264 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:00.164239 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a015ba-29733855-6k2nd" Jul 14 12:15:00.318363 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:00.318327 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733855-r62rq"] Jul 14 12:15:00.322403 ip-10-0-136-205 kubenswrapper[2582]: W0714 12:15:00.322366 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode33f426c_de35_4b16_9cbe_a4b9456de08e.slice/crio-8fd9629b1c47b01030ce5b907d27daa0914ce37d417029694059f190aca8cae3 WatchSource:0}: Error finding container 8fd9629b1c47b01030ce5b907d27daa0914ce37d417029694059f190aca8cae3: Status 404 returned error can't find the container with id 8fd9629b1c47b01030ce5b907d27daa0914ce37d417029694059f190aca8cae3 Jul 14 12:15:00.324394 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:00.324372 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 12:15:00.342941 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:00.342917 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a015ba-29733855-6k2nd"] Jul 14 12:15:00.347188 ip-10-0-136-205 kubenswrapper[2582]: W0714 12:15:00.347155 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ea7246e_26f3_4e0c_9de7_6ffc85de8243.slice/crio-ade3abfc853dadbbc5b0a91196d1adeca6bd3932ee85f7ceb60a41e8516f6f51 WatchSource:0}: Error finding container ade3abfc853dadbbc5b0a91196d1adeca6bd3932ee85f7ceb60a41e8516f6f51: Status 404 returned error can't find the container with id ade3abfc853dadbbc5b0a91196d1adeca6bd3932ee85f7ceb60a41e8516f6f51 Jul 14 12:15:00.368650 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:00.368618 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a015ba-29733855-6k2nd" event={"ID":"2ea7246e-26f3-4e0c-9de7-6ffc85de8243","Type":"ContainerStarted","Data":"ade3abfc853dadbbc5b0a91196d1adeca6bd3932ee85f7ceb60a41e8516f6f51"} Jul 14 12:15:00.369672 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:00.369647 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733855-r62rq" event={"ID":"e33f426c-de35-4b16-9cbe-a4b9456de08e","Type":"ContainerStarted","Data":"8fd9629b1c47b01030ce5b907d27daa0914ce37d417029694059f190aca8cae3"} Jul 14 12:15:03.388946 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:03.388849 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733855-r62rq" event={"ID":"e33f426c-de35-4b16-9cbe-a4b9456de08e","Type":"ContainerStarted","Data":"4dc1f807bd6df00ff4fda77c6eab434604f176839e2e12e73bfa608af67c2fa7"} Jul 14 12:15:03.390360 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:03.390336 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a015ba-29733855-6k2nd" event={"ID":"2ea7246e-26f3-4e0c-9de7-6ffc85de8243","Type":"ContainerStarted","Data":"1a6ce01cfe3dd57b5d1f059e983b7bcf6c67a16934a8120b775cba946addad0e"} Jul 14 12:15:03.432434 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:03.432364 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733855-r62rq" podStartSLOduration=1.047941478 podStartE2EDuration="3.432346355s" totalImagesPullingTime="2.384404877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 12:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 12:15:03.430968477 +0000 UTC m=+2233.793619781" watchObservedRunningTime="2026-07-14 12:15:03.432346355 +0000 UTC m=+2233.794997660" Jul 14 12:15:03.458159 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:03.458085 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a015ba-29733855-6k2nd" podStartSLOduration=1.094775639 podStartE2EDuration="3.458069611s" totalImagesPullingTime="2.363293972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 12:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 12:15:03.456435144 +0000 UTC m=+2233.819086448" watchObservedRunningTime="2026-07-14 12:15:03.458069611 +0000 UTC m=+2233.820720914" Jul 14 12:15:04.397297 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:04.397254 2582 generic.go:356] "Generic (PLEG): container finished" podID="e33f426c-de35-4b16-9cbe-a4b9456de08e" containerID="4dc1f807bd6df00ff4fda77c6eab434604f176839e2e12e73bfa608af67c2fa7" exitCode=0 Jul 14 12:15:04.397686 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:04.397339 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733855-r62rq" event={"ID":"e33f426c-de35-4b16-9cbe-a4b9456de08e","Type":"ContainerDied","Data":"4dc1f807bd6df00ff4fda77c6eab434604f176839e2e12e73bfa608af67c2fa7"} Jul 14 12:15:04.398946 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:04.398921 2582 generic.go:356] "Generic (PLEG): container finished" podID="2ea7246e-26f3-4e0c-9de7-6ffc85de8243" containerID="1a6ce01cfe3dd57b5d1f059e983b7bcf6c67a16934a8120b775cba946addad0e" exitCode=0 Jul 14 12:15:04.399074 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:04.398950 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a015ba-29733855-6k2nd" event={"ID":"2ea7246e-26f3-4e0c-9de7-6ffc85de8243","Type":"ContainerDied","Data":"1a6ce01cfe3dd57b5d1f059e983b7bcf6c67a16934a8120b775cba946addad0e"} Jul 14 12:15:05.543249 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:05.543219 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733855-r62rq" Jul 14 12:15:05.579307 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:05.579277 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a015ba-29733855-6k2nd" Jul 14 12:15:06.410846 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:06.410815 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a015ba-29733855-6k2nd" Jul 14 12:15:06.411031 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:06.410813 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a015ba-29733855-6k2nd" event={"ID":"2ea7246e-26f3-4e0c-9de7-6ffc85de8243","Type":"ContainerDied","Data":"ade3abfc853dadbbc5b0a91196d1adeca6bd3932ee85f7ceb60a41e8516f6f51"} Jul 14 12:15:06.411031 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:06.410975 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ade3abfc853dadbbc5b0a91196d1adeca6bd3932ee85f7ceb60a41e8516f6f51" Jul 14 12:15:06.412235 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:06.412216 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733855-r62rq" Jul 14 12:15:06.412342 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:06.412248 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733855-r62rq" event={"ID":"e33f426c-de35-4b16-9cbe-a4b9456de08e","Type":"ContainerDied","Data":"8fd9629b1c47b01030ce5b907d27daa0914ce37d417029694059f190aca8cae3"} Jul 14 12:15:06.412342 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:06.412284 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8fd9629b1c47b01030ce5b907d27daa0914ce37d417029694059f190aca8cae3" Jul 14 12:15:44.053863 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:44.053768 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ae12a0-phhnn"] Jul 14 12:15:44.054457 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:44.054438 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e33f426c-de35-4b16-9cbe-a4b9456de08e" containerName="cleanup" Jul 14 12:15:44.054503 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:44.054461 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e33f426c-de35-4b16-9cbe-a4b9456de08e" containerName="cleanup" Jul 14 12:15:44.054503 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:44.054476 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ea7246e-26f3-4e0c-9de7-6ffc85de8243" containerName="cleanup" Jul 14 12:15:44.054503 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:44.054485 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ea7246e-26f3-4e0c-9de7-6ffc85de8243" containerName="cleanup" Jul 14 12:15:44.054601 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:44.054588 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ea7246e-26f3-4e0c-9de7-6ffc85de8243" containerName="cleanup" Jul 14 12:15:44.054636 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:44.054603 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e33f426c-de35-4b16-9cbe-a4b9456de08e" containerName="cleanup" Jul 14 12:15:44.057774 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:44.057756 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ae12a0-phhnn" Jul 14 12:15:44.061067 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:44.061045 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7pf27\"" Jul 14 12:15:44.071049 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:44.071018 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ae12a0-phhnn"] Jul 14 12:15:44.163728 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:44.163679 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/797e39c7-505b-402e-a93b-7c9e2b0b2fbd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-ae12a0-phhnn\" (UID: \"797e39c7-505b-402e-a93b-7c9e2b0b2fbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ae12a0-phhnn" Jul 14 12:15:44.264516 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:44.264475 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/797e39c7-505b-402e-a93b-7c9e2b0b2fbd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-ae12a0-phhnn\" (UID: \"797e39c7-505b-402e-a93b-7c9e2b0b2fbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ae12a0-phhnn" Jul 14 12:15:44.265169 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:44.265147 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/797e39c7-505b-402e-a93b-7c9e2b0b2fbd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-ae12a0-phhnn\" (UID: \"797e39c7-505b-402e-a93b-7c9e2b0b2fbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ae12a0-phhnn" Jul 14 12:15:44.367764 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:44.367683 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ae12a0-phhnn" Jul 14 12:15:44.510998 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:44.510969 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ae12a0-phhnn"] Jul 14 12:15:44.513485 ip-10-0-136-205 kubenswrapper[2582]: W0714 12:15:44.513450 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod797e39c7_505b_402e_a93b_7c9e2b0b2fbd.slice/crio-7b041097d0babc1a9726e17a0d78effbc3efa7f5ef51bd029ee4cc6ffb764691 WatchSource:0}: Error finding container 7b041097d0babc1a9726e17a0d78effbc3efa7f5ef51bd029ee4cc6ffb764691: Status 404 returned error can't find the container with id 7b041097d0babc1a9726e17a0d78effbc3efa7f5ef51bd029ee4cc6ffb764691 Jul 14 12:15:44.612246 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:44.612209 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ae12a0-phhnn" event={"ID":"797e39c7-505b-402e-a93b-7c9e2b0b2fbd","Type":"ContainerStarted","Data":"7b041097d0babc1a9726e17a0d78effbc3efa7f5ef51bd029ee4cc6ffb764691"} Jul 14 12:15:45.619407 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:45.619313 2582 generic.go:356] "Generic (PLEG): container finished" podID="797e39c7-505b-402e-a93b-7c9e2b0b2fbd" containerID="1936a2f839316c782107b76918ab7ac20d4e49a9d4ddfe0ee1c27ebdc1779ab9" exitCode=0 Jul 14 12:15:45.619756 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:45.619397 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ae12a0-phhnn" event={"ID":"797e39c7-505b-402e-a93b-7c9e2b0b2fbd","Type":"ContainerDied","Data":"1936a2f839316c782107b76918ab7ac20d4e49a9d4ddfe0ee1c27ebdc1779ab9"} Jul 14 12:15:46.770798 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:46.770770 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ae12a0-phhnn" Jul 14 12:15:46.889289 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:46.889197 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/797e39c7-505b-402e-a93b-7c9e2b0b2fbd-maas-api-service-ca\") pod \"797e39c7-505b-402e-a93b-7c9e2b0b2fbd\" (UID: \"797e39c7-505b-402e-a93b-7c9e2b0b2fbd\") " Jul 14 12:15:46.889598 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:46.889575 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/797e39c7-505b-402e-a93b-7c9e2b0b2fbd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "797e39c7-505b-402e-a93b-7c9e2b0b2fbd" (UID: "797e39c7-505b-402e-a93b-7c9e2b0b2fbd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 12:15:46.990807 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:46.990771 2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/797e39c7-505b-402e-a93b-7c9e2b0b2fbd-maas-api-service-ca\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 12:15:47.631872 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:47.631835 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ae12a0-phhnn" Jul 14 12:15:47.632020 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:47.631873 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ae12a0-phhnn" event={"ID":"797e39c7-505b-402e-a93b-7c9e2b0b2fbd","Type":"ContainerDied","Data":"7b041097d0babc1a9726e17a0d78effbc3efa7f5ef51bd029ee4cc6ffb764691"} Jul 14 12:15:47.632020 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:15:47.631921 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b041097d0babc1a9726e17a0d78effbc3efa7f5ef51bd029ee4cc6ffb764691" Jul 14 12:16:20.835326 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:16:20.835283 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a015ba-29733855-6k2nd"] Jul 14 12:16:20.841071 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:16:20.841039 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a015ba-29733855-6k2nd"] Jul 14 12:16:22.292566 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:16:22.292529 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ea7246e-26f3-4e0c-9de7-6ffc85de8243" path="/var/lib/kubelet/pods/2ea7246e-26f3-4e0c-9de7-6ffc85de8243/volumes" Jul 14 12:20:56.112402 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.112368 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w"] Jul 14 12:20:56.112915 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.112844 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="797e39c7-505b-402e-a93b-7c9e2b0b2fbd" containerName="revoke-keys" Jul 14 12:20:56.112915 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.112858 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="797e39c7-505b-402e-a93b-7c9e2b0b2fbd" containerName="revoke-keys" Jul 14 12:20:56.113021 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.112953 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="797e39c7-505b-402e-a93b-7c9e2b0b2fbd" containerName="revoke-keys" Jul 14 12:20:56.116334 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.116313 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" Jul 14 12:20:56.120781 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.120761 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-cac82f\"/\"kube-root-ca.crt\"" Jul 14 12:20:56.120781 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.120770 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-cac82f\"/\"sub-test-model-cac82f-kserve-self-signed-certs\"" Jul 14 12:20:56.120934 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.120773 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-cac82f\"/\"openshift-service-ca.crt\"" Jul 14 12:20:56.120934 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.120770 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-cac82f\"/\"default-dockercfg-px7hg\"" Jul 14 12:20:56.127156 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.127134 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w"] Jul 14 12:20:56.218312 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.218264 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b31a1be-468d-4d59-8222-eff105edea6e-tmp-dir\") pod \"sub-test-model-cac82f-kserve-ff6976fb9-v4d7w\" (UID: \"3b31a1be-468d-4d59-8222-eff105edea6e\") " pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" Jul 14 12:20:56.218312 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.218319 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b31a1be-468d-4d59-8222-eff105edea6e-tls-certs\") pod \"sub-test-model-cac82f-kserve-ff6976fb9-v4d7w\" (UID: \"3b31a1be-468d-4d59-8222-eff105edea6e\") " pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" Jul 14 12:20:56.218562 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.218376 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b31a1be-468d-4d59-8222-eff105edea6e-model-cache\") pod \"sub-test-model-cac82f-kserve-ff6976fb9-v4d7w\" (UID: \"3b31a1be-468d-4d59-8222-eff105edea6e\") " pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" Jul 14 12:20:56.218562 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.218405 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crmjz\" (UniqueName: \"kubernetes.io/projected/3b31a1be-468d-4d59-8222-eff105edea6e-kube-api-access-crmjz\") pod \"sub-test-model-cac82f-kserve-ff6976fb9-v4d7w\" (UID: \"3b31a1be-468d-4d59-8222-eff105edea6e\") " pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" Jul 14 12:20:56.218562 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.218455 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b31a1be-468d-4d59-8222-eff105edea6e-dshm\") pod \"sub-test-model-cac82f-kserve-ff6976fb9-v4d7w\" (UID: \"3b31a1be-468d-4d59-8222-eff105edea6e\") " pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" Jul 14 12:20:56.218562 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.218529 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b31a1be-468d-4d59-8222-eff105edea6e-home\") pod \"sub-test-model-cac82f-kserve-ff6976fb9-v4d7w\" (UID: \"3b31a1be-468d-4d59-8222-eff105edea6e\") " pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" Jul 14 12:20:56.319324 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.319280 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b31a1be-468d-4d59-8222-eff105edea6e-tmp-dir\") pod \"sub-test-model-cac82f-kserve-ff6976fb9-v4d7w\" (UID: \"3b31a1be-468d-4d59-8222-eff105edea6e\") " pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" Jul 14 12:20:56.319324 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.319326 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b31a1be-468d-4d59-8222-eff105edea6e-tls-certs\") pod \"sub-test-model-cac82f-kserve-ff6976fb9-v4d7w\" (UID: \"3b31a1be-468d-4d59-8222-eff105edea6e\") " pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" Jul 14 12:20:56.319589 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.319453 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b31a1be-468d-4d59-8222-eff105edea6e-model-cache\") pod \"sub-test-model-cac82f-kserve-ff6976fb9-v4d7w\" (UID: \"3b31a1be-468d-4d59-8222-eff105edea6e\") " pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" Jul 14 12:20:56.319589 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.319498 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crmjz\" (UniqueName: \"kubernetes.io/projected/3b31a1be-468d-4d59-8222-eff105edea6e-kube-api-access-crmjz\") pod \"sub-test-model-cac82f-kserve-ff6976fb9-v4d7w\" (UID: \"3b31a1be-468d-4d59-8222-eff105edea6e\") " pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" Jul 14 12:20:56.319589 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.319565 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b31a1be-468d-4d59-8222-eff105edea6e-dshm\") pod \"sub-test-model-cac82f-kserve-ff6976fb9-v4d7w\" (UID: \"3b31a1be-468d-4d59-8222-eff105edea6e\") " pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" Jul 14 12:20:56.319748 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.319594 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b31a1be-468d-4d59-8222-eff105edea6e-home\") pod \"sub-test-model-cac82f-kserve-ff6976fb9-v4d7w\" (UID: \"3b31a1be-468d-4d59-8222-eff105edea6e\") " pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" Jul 14 12:20:56.319748 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.319714 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b31a1be-468d-4d59-8222-eff105edea6e-tmp-dir\") pod \"sub-test-model-cac82f-kserve-ff6976fb9-v4d7w\" (UID: \"3b31a1be-468d-4d59-8222-eff105edea6e\") " pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" Jul 14 12:20:56.319858 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.319774 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b31a1be-468d-4d59-8222-eff105edea6e-model-cache\") pod \"sub-test-model-cac82f-kserve-ff6976fb9-v4d7w\" (UID: \"3b31a1be-468d-4d59-8222-eff105edea6e\") " pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" Jul 14 12:20:56.319924 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.319908 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b31a1be-468d-4d59-8222-eff105edea6e-home\") pod \"sub-test-model-cac82f-kserve-ff6976fb9-v4d7w\" (UID: \"3b31a1be-468d-4d59-8222-eff105edea6e\") " pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" Jul 14 12:20:56.321636 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.321613 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b31a1be-468d-4d59-8222-eff105edea6e-dshm\") pod \"sub-test-model-cac82f-kserve-ff6976fb9-v4d7w\" (UID: \"3b31a1be-468d-4d59-8222-eff105edea6e\") " pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" Jul 14 12:20:56.321979 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.321959 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b31a1be-468d-4d59-8222-eff105edea6e-tls-certs\") pod \"sub-test-model-cac82f-kserve-ff6976fb9-v4d7w\" (UID: \"3b31a1be-468d-4d59-8222-eff105edea6e\") " pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" Jul 14 12:20:56.336274 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.336238 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crmjz\" (UniqueName: \"kubernetes.io/projected/3b31a1be-468d-4d59-8222-eff105edea6e-kube-api-access-crmjz\") pod \"sub-test-model-cac82f-kserve-ff6976fb9-v4d7w\" (UID: \"3b31a1be-468d-4d59-8222-eff105edea6e\") " pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" Jul 14 12:20:56.426495 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.426395 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" Jul 14 12:20:56.573596 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:56.573558 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w"] Jul 14 12:20:56.576964 ip-10-0-136-205 kubenswrapper[2582]: W0714 12:20:56.576915 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b31a1be_468d_4d59_8222_eff105edea6e.slice/crio-c9857fdfe0a05acd6f1e614333f720805b9766ae1d8e50d8820a350e804bba8c WatchSource:0}: Error finding container c9857fdfe0a05acd6f1e614333f720805b9766ae1d8e50d8820a350e804bba8c: Status 404 returned error can't find the container with id c9857fdfe0a05acd6f1e614333f720805b9766ae1d8e50d8820a350e804bba8c Jul 14 12:20:57.218930 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:57.218893 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" event={"ID":"3b31a1be-468d-4d59-8222-eff105edea6e","Type":"ContainerStarted","Data":"93e7fcd32c0c02a35fc9ecf5ec8177551d6fd3d0a66cbe9abe35b4d02fcefb42"} Jul 14 12:20:57.219353 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:57.218941 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" event={"ID":"3b31a1be-468d-4d59-8222-eff105edea6e","Type":"ContainerStarted","Data":"c9857fdfe0a05acd6f1e614333f720805b9766ae1d8e50d8820a350e804bba8c"} Jul 14 12:20:57.249787 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:20:57.249737 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" podStartSLOduration=1.2497202299999999 podStartE2EDuration="1.24972023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 12:20:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 12:20:57.249480271 +0000 UTC m=+2587.612131576" watchObservedRunningTime="2026-07-14 12:20:57.24972023 +0000 UTC m=+2587.612371534" Jul 14 12:21:06.427291 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:21:06.427250 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" Jul 14 12:21:06.427798 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:21:06.427314 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" Jul 14 12:21:06.439979 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:21:06.439942 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" Jul 14 12:21:07.284191 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:21:07.284156 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" Jul 14 12:21:51.430814 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:21:51.430736 2582 scope.go:117] "RemoveContainer" containerID="1a6ce01cfe3dd57b5d1f059e983b7bcf6c67a16934a8120b775cba946addad0e" Jul 14 12:22:02.811411 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:02.811369 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w"] Jul 14 12:22:17.831604 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:17.831563 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" podUID="3b31a1be-468d-4d59-8222-eff105edea6e" containerName="main" containerID="cri-o://93e7fcd32c0c02a35fc9ecf5ec8177551d6fd3d0a66cbe9abe35b4d02fcefb42" gracePeriod=45 Jul 14 12:22:18.089495 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:18.089423 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" Jul 14 12:22:18.226257 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:18.226224 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b31a1be-468d-4d59-8222-eff105edea6e-dshm\") pod \"3b31a1be-468d-4d59-8222-eff105edea6e\" (UID: \"3b31a1be-468d-4d59-8222-eff105edea6e\") " Jul 14 12:22:18.226257 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:18.226267 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b31a1be-468d-4d59-8222-eff105edea6e-tmp-dir\") pod \"3b31a1be-468d-4d59-8222-eff105edea6e\" (UID: \"3b31a1be-468d-4d59-8222-eff105edea6e\") " Jul 14 12:22:18.226541 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:18.226284 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b31a1be-468d-4d59-8222-eff105edea6e-tls-certs\") pod \"3b31a1be-468d-4d59-8222-eff105edea6e\" (UID: \"3b31a1be-468d-4d59-8222-eff105edea6e\") " Jul 14 12:22:18.226541 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:18.226318 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b31a1be-468d-4d59-8222-eff105edea6e-model-cache\") pod \"3b31a1be-468d-4d59-8222-eff105edea6e\" (UID: \"3b31a1be-468d-4d59-8222-eff105edea6e\") " Jul 14 12:22:18.226541 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:18.226340 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crmjz\" (UniqueName: \"kubernetes.io/projected/3b31a1be-468d-4d59-8222-eff105edea6e-kube-api-access-crmjz\") pod \"3b31a1be-468d-4d59-8222-eff105edea6e\" (UID: \"3b31a1be-468d-4d59-8222-eff105edea6e\") " Jul 14 12:22:18.226541 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:18.226372 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b31a1be-468d-4d59-8222-eff105edea6e-home\") pod \"3b31a1be-468d-4d59-8222-eff105edea6e\" (UID: \"3b31a1be-468d-4d59-8222-eff105edea6e\") " Jul 14 12:22:18.226741 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:18.226623 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b31a1be-468d-4d59-8222-eff105edea6e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3b31a1be-468d-4d59-8222-eff105edea6e" (UID: "3b31a1be-468d-4d59-8222-eff105edea6e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 12:22:18.226741 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:18.226638 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b31a1be-468d-4d59-8222-eff105edea6e-model-cache" (OuterVolumeSpecName: "model-cache") pod "3b31a1be-468d-4d59-8222-eff105edea6e" (UID: "3b31a1be-468d-4d59-8222-eff105edea6e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 12:22:18.226741 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:18.226691 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b31a1be-468d-4d59-8222-eff105edea6e-home" (OuterVolumeSpecName: "home") pod "3b31a1be-468d-4d59-8222-eff105edea6e" (UID: "3b31a1be-468d-4d59-8222-eff105edea6e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 12:22:18.228663 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:18.228633 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b31a1be-468d-4d59-8222-eff105edea6e-dshm" (OuterVolumeSpecName: "dshm") pod "3b31a1be-468d-4d59-8222-eff105edea6e" (UID: "3b31a1be-468d-4d59-8222-eff105edea6e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 12:22:18.228773 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:18.228689 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b31a1be-468d-4d59-8222-eff105edea6e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3b31a1be-468d-4d59-8222-eff105edea6e" (UID: "3b31a1be-468d-4d59-8222-eff105edea6e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 12:22:18.228773 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:18.228706 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b31a1be-468d-4d59-8222-eff105edea6e-kube-api-access-crmjz" (OuterVolumeSpecName: "kube-api-access-crmjz") pod "3b31a1be-468d-4d59-8222-eff105edea6e" (UID: "3b31a1be-468d-4d59-8222-eff105edea6e"). InnerVolumeSpecName "kube-api-access-crmjz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 12:22:18.327490 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:18.327448 2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b31a1be-468d-4d59-8222-eff105edea6e-dshm\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 12:22:18.327665 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:18.327504 2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b31a1be-468d-4d59-8222-eff105edea6e-tmp-dir\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 12:22:18.327665 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:18.327514 2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b31a1be-468d-4d59-8222-eff105edea6e-tls-certs\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 12:22:18.327665 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:18.327522 2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b31a1be-468d-4d59-8222-eff105edea6e-model-cache\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 12:22:18.327665 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:18.327530 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crmjz\" (UniqueName: \"kubernetes.io/projected/3b31a1be-468d-4d59-8222-eff105edea6e-kube-api-access-crmjz\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 12:22:18.327665 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:18.327539 2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b31a1be-468d-4d59-8222-eff105edea6e-home\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 12:22:18.655824 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:18.655790 2582 generic.go:356] "Generic (PLEG): container finished" podID="3b31a1be-468d-4d59-8222-eff105edea6e" containerID="93e7fcd32c0c02a35fc9ecf5ec8177551d6fd3d0a66cbe9abe35b4d02fcefb42" exitCode=0 Jul 14 12:22:18.656005 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:18.655833 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" Jul 14 12:22:18.656005 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:18.655873 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" event={"ID":"3b31a1be-468d-4d59-8222-eff105edea6e","Type":"ContainerDied","Data":"93e7fcd32c0c02a35fc9ecf5ec8177551d6fd3d0a66cbe9abe35b4d02fcefb42"} Jul 14 12:22:18.656005 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:18.655913 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w" event={"ID":"3b31a1be-468d-4d59-8222-eff105edea6e","Type":"ContainerDied","Data":"c9857fdfe0a05acd6f1e614333f720805b9766ae1d8e50d8820a350e804bba8c"} Jul 14 12:22:18.656005 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:18.655929 2582 scope.go:117] "RemoveContainer" containerID="93e7fcd32c0c02a35fc9ecf5ec8177551d6fd3d0a66cbe9abe35b4d02fcefb42" Jul 14 12:22:18.664638 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:18.664615 2582 scope.go:117] "RemoveContainer" containerID="93e7fcd32c0c02a35fc9ecf5ec8177551d6fd3d0a66cbe9abe35b4d02fcefb42" Jul 14 12:22:18.664931 ip-10-0-136-205 kubenswrapper[2582]: E0714 12:22:18.664909 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93e7fcd32c0c02a35fc9ecf5ec8177551d6fd3d0a66cbe9abe35b4d02fcefb42\": container with ID starting with 93e7fcd32c0c02a35fc9ecf5ec8177551d6fd3d0a66cbe9abe35b4d02fcefb42 not found: ID does not exist" containerID="93e7fcd32c0c02a35fc9ecf5ec8177551d6fd3d0a66cbe9abe35b4d02fcefb42" Jul 14 12:22:18.665004 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:18.664939 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93e7fcd32c0c02a35fc9ecf5ec8177551d6fd3d0a66cbe9abe35b4d02fcefb42"} err="failed to get container status \"93e7fcd32c0c02a35fc9ecf5ec8177551d6fd3d0a66cbe9abe35b4d02fcefb42\": rpc error: code = NotFound desc = could not find container \"93e7fcd32c0c02a35fc9ecf5ec8177551d6fd3d0a66cbe9abe35b4d02fcefb42\": container with ID starting with 93e7fcd32c0c02a35fc9ecf5ec8177551d6fd3d0a66cbe9abe35b4d02fcefb42 not found: ID does not exist" Jul 14 12:22:18.678885 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:18.678853 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w"] Jul 14 12:22:18.684557 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:18.684521 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-cac82f/sub-test-model-cac82f-kserve-ff6976fb9-v4d7w"] Jul 14 12:22:20.292227 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:22:20.292190 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b31a1be-468d-4d59-8222-eff105edea6e" path="/var/lib/kubelet/pods/3b31a1be-468d-4d59-8222-eff105edea6e/volumes" Jul 14 12:23:29.669002 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:29.668964 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7673-139638377860656"] Jul 14 12:23:29.669511 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:29.669416 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b31a1be-468d-4d59-8222-eff105edea6e" containerName="main" Jul 14 12:23:29.669511 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:29.669429 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b31a1be-468d-4d59-8222-eff105edea6e" containerName="main" Jul 14 12:23:29.669511 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:29.669503 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b31a1be-468d-4d59-8222-eff105edea6e" containerName="main" Jul 14 12:23:29.672451 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:29.672434 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7673-139638377860656" Jul 14 12:23:29.676559 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:29.676537 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-gl5s8\"" Jul 14 12:23:29.696675 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:29.696645 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7673-139638377860656"] Jul 14 12:23:29.830025 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:29.829970 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cv6j\" (UniqueName: \"kubernetes.io/projected/4b1e7027-70c9-42aa-940a-bb1ee7514a68-kube-api-access-4cv6j\") pod \"test-curl-7673-139638377860656\" (UID: \"4b1e7027-70c9-42aa-940a-bb1ee7514a68\") " pod="openshift-ingress/test-curl-7673-139638377860656" Jul 14 12:23:29.931326 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:29.931215 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cv6j\" (UniqueName: \"kubernetes.io/projected/4b1e7027-70c9-42aa-940a-bb1ee7514a68-kube-api-access-4cv6j\") pod \"test-curl-7673-139638377860656\" (UID: \"4b1e7027-70c9-42aa-940a-bb1ee7514a68\") " pod="openshift-ingress/test-curl-7673-139638377860656" Jul 14 12:23:29.945758 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:29.945731 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cv6j\" (UniqueName: \"kubernetes.io/projected/4b1e7027-70c9-42aa-940a-bb1ee7514a68-kube-api-access-4cv6j\") pod \"test-curl-7673-139638377860656\" (UID: \"4b1e7027-70c9-42aa-940a-bb1ee7514a68\") " pod="openshift-ingress/test-curl-7673-139638377860656" Jul 14 12:23:29.981494 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:29.981459 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7673-139638377860656" Jul 14 12:23:30.129694 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:30.129653 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7673-139638377860656"] Jul 14 12:23:30.132985 ip-10-0-136-205 kubenswrapper[2582]: W0714 12:23:30.132954 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b1e7027_70c9_42aa_940a_bb1ee7514a68.slice/crio-9d5b48cb560ddf91382dc5136e2f900562852cf22a10ca81a54e124184c380a2 WatchSource:0}: Error finding container 9d5b48cb560ddf91382dc5136e2f900562852cf22a10ca81a54e124184c380a2: Status 404 returned error can't find the container with id 9d5b48cb560ddf91382dc5136e2f900562852cf22a10ca81a54e124184c380a2 Jul 14 12:23:30.134732 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:30.134711 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 12:23:31.031463 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:31.031424 2582 generic.go:356] "Generic (PLEG): container finished" podID="4b1e7027-70c9-42aa-940a-bb1ee7514a68" containerID="0fd2534fd3db669953e950e1ac9cc0d226b637b2b1e949d471ff754477dde8b5" exitCode=0 Jul 14 12:23:31.031895 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:31.031511 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7673-139638377860656" event={"ID":"4b1e7027-70c9-42aa-940a-bb1ee7514a68","Type":"ContainerDied","Data":"0fd2534fd3db669953e950e1ac9cc0d226b637b2b1e949d471ff754477dde8b5"} Jul 14 12:23:31.031895 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:31.031552 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7673-139638377860656" event={"ID":"4b1e7027-70c9-42aa-940a-bb1ee7514a68","Type":"ContainerStarted","Data":"9d5b48cb560ddf91382dc5136e2f900562852cf22a10ca81a54e124184c380a2"} Jul 14 12:23:32.178304 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:32.178278 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7673-139638377860656" Jul 14 12:23:32.225349 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:32.225324 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7673-139638377860656_4b1e7027-70c9-42aa-940a-bb1ee7514a68/test-curl-7673-139638377860656/0.log" Jul 14 12:23:32.252969 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:32.252934 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7673-139638377860656"] Jul 14 12:23:32.270042 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:32.264628 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7673-139638377860656"] Jul 14 12:23:32.356534 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:32.356429 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cv6j\" (UniqueName: \"kubernetes.io/projected/4b1e7027-70c9-42aa-940a-bb1ee7514a68-kube-api-access-4cv6j\") pod \"4b1e7027-70c9-42aa-940a-bb1ee7514a68\" (UID: \"4b1e7027-70c9-42aa-940a-bb1ee7514a68\") " Jul 14 12:23:32.358667 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:32.358637 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b1e7027-70c9-42aa-940a-bb1ee7514a68-kube-api-access-4cv6j" (OuterVolumeSpecName: "kube-api-access-4cv6j") pod "4b1e7027-70c9-42aa-940a-bb1ee7514a68" (UID: "4b1e7027-70c9-42aa-940a-bb1ee7514a68"). InnerVolumeSpecName "kube-api-access-4cv6j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 12:23:32.389793 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:32.389757 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7673-139638377857072"] Jul 14 12:23:32.390200 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:32.390187 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b1e7027-70c9-42aa-940a-bb1ee7514a68" containerName="test-curl-7673-139638377860656" Jul 14 12:23:32.390260 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:32.390202 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b1e7027-70c9-42aa-940a-bb1ee7514a68" containerName="test-curl-7673-139638377860656" Jul 14 12:23:32.390303 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:32.390267 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b1e7027-70c9-42aa-940a-bb1ee7514a68" containerName="test-curl-7673-139638377860656" Jul 14 12:23:32.393324 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:32.393307 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7673-139638377857072" Jul 14 12:23:32.403307 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:32.403281 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7673-139638377857072"] Jul 14 12:23:32.457787 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:32.457749 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cv6j\" (UniqueName: \"kubernetes.io/projected/4b1e7027-70c9-42aa-940a-bb1ee7514a68-kube-api-access-4cv6j\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 12:23:32.558497 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:32.558450 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7th9\" (UniqueName: \"kubernetes.io/projected/41f9dabd-587d-4ba1-9a88-ed9b6cbf48a5-kube-api-access-l7th9\") pod \"test-curl-7673-139638377857072\" (UID: \"41f9dabd-587d-4ba1-9a88-ed9b6cbf48a5\") " pod="openshift-ingress/test-curl-7673-139638377857072" Jul 14 12:23:32.660055 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:32.659968 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7th9\" (UniqueName: \"kubernetes.io/projected/41f9dabd-587d-4ba1-9a88-ed9b6cbf48a5-kube-api-access-l7th9\") pod \"test-curl-7673-139638377857072\" (UID: \"41f9dabd-587d-4ba1-9a88-ed9b6cbf48a5\") " pod="openshift-ingress/test-curl-7673-139638377857072" Jul 14 12:23:32.670592 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:32.670565 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7th9\" (UniqueName: \"kubernetes.io/projected/41f9dabd-587d-4ba1-9a88-ed9b6cbf48a5-kube-api-access-l7th9\") pod \"test-curl-7673-139638377857072\" (UID: \"41f9dabd-587d-4ba1-9a88-ed9b6cbf48a5\") " pod="openshift-ingress/test-curl-7673-139638377857072" Jul 14 12:23:32.703248 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:32.703205 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7673-139638377857072" Jul 14 12:23:32.850402 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:32.850375 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7673-139638377857072"] Jul 14 12:23:32.853040 ip-10-0-136-205 kubenswrapper[2582]: W0714 12:23:32.853012 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41f9dabd_587d_4ba1_9a88_ed9b6cbf48a5.slice/crio-c534e8097915b668e00ff819fadf1b883023edda18a76380f0c43f86f38dcb05 WatchSource:0}: Error finding container c534e8097915b668e00ff819fadf1b883023edda18a76380f0c43f86f38dcb05: Status 404 returned error can't find the container with id c534e8097915b668e00ff819fadf1b883023edda18a76380f0c43f86f38dcb05 Jul 14 12:23:33.043015 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:33.042984 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7673-139638377860656" Jul 14 12:23:33.043273 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:33.043026 2582 scope.go:117] "RemoveContainer" containerID="0fd2534fd3db669953e950e1ac9cc0d226b637b2b1e949d471ff754477dde8b5" Jul 14 12:23:33.044400 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:33.044368 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7673-139638377857072" event={"ID":"41f9dabd-587d-4ba1-9a88-ed9b6cbf48a5","Type":"ContainerStarted","Data":"c534e8097915b668e00ff819fadf1b883023edda18a76380f0c43f86f38dcb05"} Jul 14 12:23:34.051875 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:34.051839 2582 generic.go:356] "Generic (PLEG): container finished" podID="41f9dabd-587d-4ba1-9a88-ed9b6cbf48a5" containerID="b8969ad3ec789000baa8f0963fd1ae2be12ed6dd83b24b9ff5702313e26bd94c" exitCode=0 Jul 14 12:23:34.052263 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:34.051907 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7673-139638377857072" event={"ID":"41f9dabd-587d-4ba1-9a88-ed9b6cbf48a5","Type":"ContainerDied","Data":"b8969ad3ec789000baa8f0963fd1ae2be12ed6dd83b24b9ff5702313e26bd94c"} Jul 14 12:23:34.292448 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:34.292410 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b1e7027-70c9-42aa-940a-bb1ee7514a68" path="/var/lib/kubelet/pods/4b1e7027-70c9-42aa-940a-bb1ee7514a68/volumes" Jul 14 12:23:35.204418 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:35.204389 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7673-139638377857072" Jul 14 12:23:35.236295 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:35.236266 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7673-139638377857072_41f9dabd-587d-4ba1-9a88-ed9b6cbf48a5/test-curl-7673-139638377857072/0.log" Jul 14 12:23:35.268452 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:35.268416 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7673-139638377857072"] Jul 14 12:23:35.279588 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:35.279557 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7673-139638377857072"] Jul 14 12:23:35.391566 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:35.391469 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7th9\" (UniqueName: \"kubernetes.io/projected/41f9dabd-587d-4ba1-9a88-ed9b6cbf48a5-kube-api-access-l7th9\") pod \"41f9dabd-587d-4ba1-9a88-ed9b6cbf48a5\" (UID: \"41f9dabd-587d-4ba1-9a88-ed9b6cbf48a5\") " Jul 14 12:23:35.393665 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:35.393637 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41f9dabd-587d-4ba1-9a88-ed9b6cbf48a5-kube-api-access-l7th9" (OuterVolumeSpecName: "kube-api-access-l7th9") pod "41f9dabd-587d-4ba1-9a88-ed9b6cbf48a5" (UID: "41f9dabd-587d-4ba1-9a88-ed9b6cbf48a5"). InnerVolumeSpecName "kube-api-access-l7th9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 12:23:35.448742 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:35.448700 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7673-139638377595216"] Jul 14 12:23:35.449170 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:35.449156 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41f9dabd-587d-4ba1-9a88-ed9b6cbf48a5" containerName="test-curl-7673-139638377857072" Jul 14 12:23:35.449219 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:35.449172 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="41f9dabd-587d-4ba1-9a88-ed9b6cbf48a5" containerName="test-curl-7673-139638377857072" Jul 14 12:23:35.449252 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:35.449237 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="41f9dabd-587d-4ba1-9a88-ed9b6cbf48a5" containerName="test-curl-7673-139638377857072" Jul 14 12:23:35.452296 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:35.452280 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7673-139638377595216" Jul 14 12:23:35.461873 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:35.461844 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7673-139638377595216"] Jul 14 12:23:35.493109 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:35.493071 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7th9\" (UniqueName: \"kubernetes.io/projected/41f9dabd-587d-4ba1-9a88-ed9b6cbf48a5-kube-api-access-l7th9\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 12:23:35.594559 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:35.594520 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt59d\" (UniqueName: \"kubernetes.io/projected/11834a39-63df-4ebd-8c46-a58f973d3515-kube-api-access-nt59d\") pod \"test-curl-7673-139638377595216\" (UID: \"11834a39-63df-4ebd-8c46-a58f973d3515\") " pod="openshift-ingress/test-curl-7673-139638377595216" Jul 14 12:23:35.695695 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:35.695651 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt59d\" (UniqueName: \"kubernetes.io/projected/11834a39-63df-4ebd-8c46-a58f973d3515-kube-api-access-nt59d\") pod \"test-curl-7673-139638377595216\" (UID: \"11834a39-63df-4ebd-8c46-a58f973d3515\") " pod="openshift-ingress/test-curl-7673-139638377595216" Jul 14 12:23:35.707131 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:35.707079 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt59d\" (UniqueName: \"kubernetes.io/projected/11834a39-63df-4ebd-8c46-a58f973d3515-kube-api-access-nt59d\") pod \"test-curl-7673-139638377595216\" (UID: \"11834a39-63df-4ebd-8c46-a58f973d3515\") " pod="openshift-ingress/test-curl-7673-139638377595216" Jul 14 12:23:35.762618 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:35.762581 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7673-139638377595216" Jul 14 12:23:35.911285 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:35.911258 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7673-139638377595216"] Jul 14 12:23:35.912792 ip-10-0-136-205 kubenswrapper[2582]: W0714 12:23:35.912760 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11834a39_63df_4ebd_8c46_a58f973d3515.slice/crio-9b6997463bd1427a9c062114728048a727ade2892c6aaa506b98c10b024a6c06 WatchSource:0}: Error finding container 9b6997463bd1427a9c062114728048a727ade2892c6aaa506b98c10b024a6c06: Status 404 returned error can't find the container with id 9b6997463bd1427a9c062114728048a727ade2892c6aaa506b98c10b024a6c06 Jul 14 12:23:36.063292 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:36.063202 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7673-139638377857072" Jul 14 12:23:36.063453 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:36.063211 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c534e8097915b668e00ff819fadf1b883023edda18a76380f0c43f86f38dcb05" Jul 14 12:23:36.064432 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:36.064410 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7673-139638377595216" event={"ID":"11834a39-63df-4ebd-8c46-a58f973d3515","Type":"ContainerStarted","Data":"9b6997463bd1427a9c062114728048a727ade2892c6aaa506b98c10b024a6c06"} Jul 14 12:23:36.074867 ip-10-0-136-205 kubenswrapper[2582]: E0714 12:23:36.074836 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7673-139638377857072\" is forbidden: User \"system:node:ip-10-0-136-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-136-205.ec2.internal' and this object" podUID="41f9dabd-587d-4ba1-9a88-ed9b6cbf48a5" pod="openshift-ingress/test-curl-7673-139638377857072" Jul 14 12:23:36.293273 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:36.293247 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41f9dabd-587d-4ba1-9a88-ed9b6cbf48a5" path="/var/lib/kubelet/pods/41f9dabd-587d-4ba1-9a88-ed9b6cbf48a5/volumes" Jul 14 12:23:37.070636 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:37.070598 2582 generic.go:356] "Generic (PLEG): container finished" podID="11834a39-63df-4ebd-8c46-a58f973d3515" containerID="ad96f51cfea74507efda9a6c274994aad9685400f051d15af49a0d6371d12255" exitCode=0 Jul 14 12:23:37.070838 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:37.070674 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7673-139638377595216" event={"ID":"11834a39-63df-4ebd-8c46-a58f973d3515","Type":"ContainerDied","Data":"ad96f51cfea74507efda9a6c274994aad9685400f051d15af49a0d6371d12255"} Jul 14 12:23:38.222296 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:38.222269 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7673-139638377595216" Jul 14 12:23:38.252882 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:38.252850 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7673-139638377595216_11834a39-63df-4ebd-8c46-a58f973d3515/test-curl-7673-139638377595216/0.log" Jul 14 12:23:38.284174 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:38.284139 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7673-139638377595216"] Jul 14 12:23:38.295496 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:38.295471 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7673-139638377595216"] Jul 14 12:23:38.319498 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:38.319462 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nt59d\" (UniqueName: \"kubernetes.io/projected/11834a39-63df-4ebd-8c46-a58f973d3515-kube-api-access-nt59d\") pod \"11834a39-63df-4ebd-8c46-a58f973d3515\" (UID: \"11834a39-63df-4ebd-8c46-a58f973d3515\") " Jul 14 12:23:38.321685 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:38.321649 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11834a39-63df-4ebd-8c46-a58f973d3515-kube-api-access-nt59d" (OuterVolumeSpecName: "kube-api-access-nt59d") pod "11834a39-63df-4ebd-8c46-a58f973d3515" (UID: "11834a39-63df-4ebd-8c46-a58f973d3515"). InnerVolumeSpecName "kube-api-access-nt59d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 12:23:38.421020 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:38.420986 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nt59d\" (UniqueName: \"kubernetes.io/projected/11834a39-63df-4ebd-8c46-a58f973d3515-kube-api-access-nt59d\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 12:23:38.421676 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:38.421650 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7673-139638377595216"] Jul 14 12:23:38.422112 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:38.422085 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11834a39-63df-4ebd-8c46-a58f973d3515" containerName="test-curl-7673-139638377595216" Jul 14 12:23:38.422157 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:38.422112 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="11834a39-63df-4ebd-8c46-a58f973d3515" containerName="test-curl-7673-139638377595216" Jul 14 12:23:38.422188 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:38.422171 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="11834a39-63df-4ebd-8c46-a58f973d3515" containerName="test-curl-7673-139638377595216" Jul 14 12:23:38.425333 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:38.425315 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7673-139638377595216" Jul 14 12:23:38.446490 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:38.446460 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7673-139638377595216"] Jul 14 12:23:38.522376 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:38.522338 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gmp5\" (UniqueName: \"kubernetes.io/projected/9f4d523b-8d24-407b-9f20-f8ab0a76ce8d-kube-api-access-8gmp5\") pod \"test-curl-7673-139638377595216\" (UID: \"9f4d523b-8d24-407b-9f20-f8ab0a76ce8d\") " pod="openshift-ingress/test-curl-7673-139638377595216" Jul 14 12:23:38.623462 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:38.623367 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gmp5\" (UniqueName: \"kubernetes.io/projected/9f4d523b-8d24-407b-9f20-f8ab0a76ce8d-kube-api-access-8gmp5\") pod \"test-curl-7673-139638377595216\" (UID: \"9f4d523b-8d24-407b-9f20-f8ab0a76ce8d\") " pod="openshift-ingress/test-curl-7673-139638377595216" Jul 14 12:23:38.633843 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:38.633819 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gmp5\" (UniqueName: \"kubernetes.io/projected/9f4d523b-8d24-407b-9f20-f8ab0a76ce8d-kube-api-access-8gmp5\") pod \"test-curl-7673-139638377595216\" (UID: \"9f4d523b-8d24-407b-9f20-f8ab0a76ce8d\") " pod="openshift-ingress/test-curl-7673-139638377595216" Jul 14 12:23:38.734796 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:38.734751 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7673-139638377595216" Jul 14 12:23:38.882723 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:38.882692 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7673-139638377595216"] Jul 14 12:23:38.884724 ip-10-0-136-205 kubenswrapper[2582]: W0714 12:23:38.884698 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f4d523b_8d24_407b_9f20_f8ab0a76ce8d.slice/crio-bc4da395df9564a8dfbb4b78208b61ee24bbc45d3ae698bbfc1ba0152acbde1e WatchSource:0}: Error finding container bc4da395df9564a8dfbb4b78208b61ee24bbc45d3ae698bbfc1ba0152acbde1e: Status 404 returned error can't find the container with id bc4da395df9564a8dfbb4b78208b61ee24bbc45d3ae698bbfc1ba0152acbde1e Jul 14 12:23:39.081793 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:39.081759 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7673-139638377595216" Jul 14 12:23:39.081968 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:39.081769 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b6997463bd1427a9c062114728048a727ade2892c6aaa506b98c10b024a6c06" Jul 14 12:23:39.082884 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:39.082858 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7673-139638377595216" event={"ID":"9f4d523b-8d24-407b-9f20-f8ab0a76ce8d","Type":"ContainerStarted","Data":"bc4da395df9564a8dfbb4b78208b61ee24bbc45d3ae698bbfc1ba0152acbde1e"} Jul 14 12:23:39.095091 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:39.095053 2582 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7673-139638377595216" oldPodUID="11834a39-63df-4ebd-8c46-a58f973d3515" podUID="9f4d523b-8d24-407b-9f20-f8ab0a76ce8d" Jul 14 12:23:40.089633 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:40.089602 2582 generic.go:356] "Generic (PLEG): container finished" podID="9f4d523b-8d24-407b-9f20-f8ab0a76ce8d" containerID="6462314745ce5efee0720b7b62d77bfbc57480b74a1bb7b98bd6371a4acd0614" exitCode=0 Jul 14 12:23:40.090019 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:40.089687 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7673-139638377595216" event={"ID":"9f4d523b-8d24-407b-9f20-f8ab0a76ce8d","Type":"ContainerDied","Data":"6462314745ce5efee0720b7b62d77bfbc57480b74a1bb7b98bd6371a4acd0614"} Jul 14 12:23:40.294353 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:40.294316 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11834a39-63df-4ebd-8c46-a58f973d3515" path="/var/lib/kubelet/pods/11834a39-63df-4ebd-8c46-a58f973d3515/volumes" Jul 14 12:23:41.251929 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:41.251902 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7673-139638377595216" Jul 14 12:23:41.280969 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:41.280940 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7673-139638377595216_9f4d523b-8d24-407b-9f20-f8ab0a76ce8d/test-curl-7673-139638377595216/0.log" Jul 14 12:23:41.307866 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:41.307830 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7673-139638377595216"] Jul 14 12:23:41.315171 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:41.315142 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7673-139638377595216"] Jul 14 12:23:41.349521 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:41.349422 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gmp5\" (UniqueName: \"kubernetes.io/projected/9f4d523b-8d24-407b-9f20-f8ab0a76ce8d-kube-api-access-8gmp5\") pod \"9f4d523b-8d24-407b-9f20-f8ab0a76ce8d\" (UID: \"9f4d523b-8d24-407b-9f20-f8ab0a76ce8d\") " Jul 14 12:23:41.351501 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:41.351468 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f4d523b-8d24-407b-9f20-f8ab0a76ce8d-kube-api-access-8gmp5" (OuterVolumeSpecName: "kube-api-access-8gmp5") pod "9f4d523b-8d24-407b-9f20-f8ab0a76ce8d" (UID: "9f4d523b-8d24-407b-9f20-f8ab0a76ce8d"). InnerVolumeSpecName "kube-api-access-8gmp5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 12:23:41.450655 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:41.450611 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gmp5\" (UniqueName: \"kubernetes.io/projected/9f4d523b-8d24-407b-9f20-f8ab0a76ce8d-kube-api-access-8gmp5\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 12:23:41.462501 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:41.462463 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7673-139638377596224"] Jul 14 12:23:41.462942 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:41.462925 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f4d523b-8d24-407b-9f20-f8ab0a76ce8d" containerName="test-curl-7673-139638377595216" Jul 14 12:23:41.463005 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:41.462944 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f4d523b-8d24-407b-9f20-f8ab0a76ce8d" containerName="test-curl-7673-139638377595216" Jul 14 12:23:41.463038 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:41.463004 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f4d523b-8d24-407b-9f20-f8ab0a76ce8d" containerName="test-curl-7673-139638377595216" Jul 14 12:23:41.466150 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:41.466131 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7673-139638377596224" Jul 14 12:23:41.489747 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:41.489716 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7673-139638377596224"] Jul 14 12:23:41.551978 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:41.551930 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28tzv\" (UniqueName: \"kubernetes.io/projected/d67cdf64-d75a-48f5-9282-86d6ff8eca53-kube-api-access-28tzv\") pod \"test-curl-7673-139638377596224\" (UID: \"d67cdf64-d75a-48f5-9282-86d6ff8eca53\") " pod="openshift-ingress/test-curl-7673-139638377596224" Jul 14 12:23:41.653404 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:41.653299 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28tzv\" (UniqueName: \"kubernetes.io/projected/d67cdf64-d75a-48f5-9282-86d6ff8eca53-kube-api-access-28tzv\") pod \"test-curl-7673-139638377596224\" (UID: \"d67cdf64-d75a-48f5-9282-86d6ff8eca53\") " pod="openshift-ingress/test-curl-7673-139638377596224" Jul 14 12:23:41.664062 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:41.664026 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28tzv\" (UniqueName: \"kubernetes.io/projected/d67cdf64-d75a-48f5-9282-86d6ff8eca53-kube-api-access-28tzv\") pod \"test-curl-7673-139638377596224\" (UID: \"d67cdf64-d75a-48f5-9282-86d6ff8eca53\") " pod="openshift-ingress/test-curl-7673-139638377596224" Jul 14 12:23:41.775874 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:41.775832 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7673-139638377596224" Jul 14 12:23:41.922834 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:41.922807 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7673-139638377596224"] Jul 14 12:23:41.925033 ip-10-0-136-205 kubenswrapper[2582]: W0714 12:23:41.925008 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd67cdf64_d75a_48f5_9282_86d6ff8eca53.slice/crio-3f7318a8bf034108a7eea253b9c829bad39164ebd83a5da269d93b3d383fb11d WatchSource:0}: Error finding container 3f7318a8bf034108a7eea253b9c829bad39164ebd83a5da269d93b3d383fb11d: Status 404 returned error can't find the container with id 3f7318a8bf034108a7eea253b9c829bad39164ebd83a5da269d93b3d383fb11d Jul 14 12:23:42.101392 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:42.101364 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc4da395df9564a8dfbb4b78208b61ee24bbc45d3ae698bbfc1ba0152acbde1e" Jul 14 12:23:42.101392 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:42.101377 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7673-139638377595216" Jul 14 12:23:42.102649 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:42.102625 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7673-139638377596224" event={"ID":"d67cdf64-d75a-48f5-9282-86d6ff8eca53","Type":"ContainerStarted","Data":"3f7318a8bf034108a7eea253b9c829bad39164ebd83a5da269d93b3d383fb11d"} Jul 14 12:23:42.113059 ip-10-0-136-205 kubenswrapper[2582]: E0714 12:23:42.113026 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7673-139638377595216\" is forbidden: User \"system:node:ip-10-0-136-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-136-205.ec2.internal' and this object" podUID="9f4d523b-8d24-407b-9f20-f8ab0a76ce8d" pod="openshift-ingress/test-curl-7673-139638377595216" Jul 14 12:23:42.294070 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:42.294041 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f4d523b-8d24-407b-9f20-f8ab0a76ce8d" path="/var/lib/kubelet/pods/9f4d523b-8d24-407b-9f20-f8ab0a76ce8d/volumes" Jul 14 12:23:43.109031 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:43.108992 2582 generic.go:356] "Generic (PLEG): container finished" podID="d67cdf64-d75a-48f5-9282-86d6ff8eca53" containerID="aa3c526feae70fa33ec07ffeecf512fd70ae42045542d046d654eab3ba11499f" exitCode=0 Jul 14 12:23:43.109232 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:43.109055 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7673-139638377596224" event={"ID":"d67cdf64-d75a-48f5-9282-86d6ff8eca53","Type":"ContainerDied","Data":"aa3c526feae70fa33ec07ffeecf512fd70ae42045542d046d654eab3ba11499f"} Jul 14 12:23:44.266180 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:44.266152 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7673-139638377596224" Jul 14 12:23:44.304191 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:44.304161 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7673-139638377596224_d67cdf64-d75a-48f5-9282-86d6ff8eca53/test-curl-7673-139638377596224/0.log" Jul 14 12:23:44.331612 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:44.331580 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7673-139638377596224"] Jul 14 12:23:44.339128 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:44.339072 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7673-139638377596224"] Jul 14 12:23:44.378647 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:44.378559 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28tzv\" (UniqueName: \"kubernetes.io/projected/d67cdf64-d75a-48f5-9282-86d6ff8eca53-kube-api-access-28tzv\") pod \"d67cdf64-d75a-48f5-9282-86d6ff8eca53\" (UID: \"d67cdf64-d75a-48f5-9282-86d6ff8eca53\") " Jul 14 12:23:44.380754 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:44.380729 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d67cdf64-d75a-48f5-9282-86d6ff8eca53-kube-api-access-28tzv" (OuterVolumeSpecName: "kube-api-access-28tzv") pod "d67cdf64-d75a-48f5-9282-86d6ff8eca53" (UID: "d67cdf64-d75a-48f5-9282-86d6ff8eca53"). InnerVolumeSpecName "kube-api-access-28tzv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 12:23:44.479535 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:44.479503 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28tzv\" (UniqueName: \"kubernetes.io/projected/d67cdf64-d75a-48f5-9282-86d6ff8eca53-kube-api-access-28tzv\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 12:23:45.120477 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:45.120450 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7673-139638377596224" Jul 14 12:23:45.120658 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:45.120447 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f7318a8bf034108a7eea253b9c829bad39164ebd83a5da269d93b3d383fb11d" Jul 14 12:23:45.131508 ip-10-0-136-205 kubenswrapper[2582]: E0714 12:23:45.131473 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7673-139638377596224\" is forbidden: User \"system:node:ip-10-0-136-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-136-205.ec2.internal' and this object" podUID="d67cdf64-d75a-48f5-9282-86d6ff8eca53" pod="openshift-ingress/test-curl-7673-139638377596224" Jul 14 12:23:46.292510 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:46.292476 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d67cdf64-d75a-48f5-9282-86d6ff8eca53" path="/var/lib/kubelet/pods/d67cdf64-d75a-48f5-9282-86d6ff8eca53/volumes" Jul 14 12:23:47.356588 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:47.356553 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-cac82f-dtl95"] Jul 14 12:23:47.357217 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:47.357195 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d67cdf64-d75a-48f5-9282-86d6ff8eca53" containerName="test-curl-7673-139638377596224" Jul 14 12:23:47.357307 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:47.357219 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d67cdf64-d75a-48f5-9282-86d6ff8eca53" containerName="test-curl-7673-139638377596224" Jul 14 12:23:47.357387 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:47.357374 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d67cdf64-d75a-48f5-9282-86d6ff8eca53" containerName="test-curl-7673-139638377596224" Jul 14 12:23:47.360832 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:47.360808 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-cac82f-dtl95" Jul 14 12:23:47.366749 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:47.366727 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7pf27\"" Jul 14 12:23:47.376113 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:47.376064 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-cac82f-dtl95"] Jul 14 12:23:47.405867 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:47.405829 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7d1c920-dfcd-4d5f-bab0-164d97a55fac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-cac82f-dtl95\" (UID: \"a7d1c920-dfcd-4d5f-bab0-164d97a55fac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-cac82f-dtl95" Jul 14 12:23:47.507283 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:47.507238 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7d1c920-dfcd-4d5f-bab0-164d97a55fac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-cac82f-dtl95\" (UID: \"a7d1c920-dfcd-4d5f-bab0-164d97a55fac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-cac82f-dtl95" Jul 14 12:23:47.507916 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:47.507893 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7d1c920-dfcd-4d5f-bab0-164d97a55fac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-cac82f-dtl95\" (UID: \"a7d1c920-dfcd-4d5f-bab0-164d97a55fac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-cac82f-dtl95" Jul 14 12:23:47.671465 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:47.671378 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-cac82f-dtl95" Jul 14 12:23:47.825226 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:47.825195 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-cac82f-dtl95"] Jul 14 12:23:47.826431 ip-10-0-136-205 kubenswrapper[2582]: W0714 12:23:47.826409 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7d1c920_dfcd_4d5f_bab0_164d97a55fac.slice/crio-a5594642d97ac84cd6477c7c9c07d93d4f0a0699fdedc25353a7ec5819574db9 WatchSource:0}: Error finding container a5594642d97ac84cd6477c7c9c07d93d4f0a0699fdedc25353a7ec5819574db9: Status 404 returned error can't find the container with id a5594642d97ac84cd6477c7c9c07d93d4f0a0699fdedc25353a7ec5819574db9 Jul 14 12:23:48.138281 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:48.138248 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-cac82f-dtl95" event={"ID":"a7d1c920-dfcd-4d5f-bab0-164d97a55fac","Type":"ContainerStarted","Data":"a5594642d97ac84cd6477c7c9c07d93d4f0a0699fdedc25353a7ec5819574db9"} Jul 14 12:23:49.145141 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:49.145080 2582 generic.go:356] "Generic (PLEG): container finished" podID="a7d1c920-dfcd-4d5f-bab0-164d97a55fac" containerID="5484c2aaea9a854a376eaf24dc7b16d87e9deb87e9c9d4815d548f6f3be86ffa" exitCode=0 Jul 14 12:23:49.145585 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:49.145165 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-cac82f-dtl95" event={"ID":"a7d1c920-dfcd-4d5f-bab0-164d97a55fac","Type":"ContainerDied","Data":"5484c2aaea9a854a376eaf24dc7b16d87e9deb87e9c9d4815d548f6f3be86ffa"} Jul 14 12:23:50.290909 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:50.290883 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-cac82f-dtl95" Jul 14 12:23:50.335281 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:50.335244 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7d1c920-dfcd-4d5f-bab0-164d97a55fac-maas-api-service-ca\") pod \"a7d1c920-dfcd-4d5f-bab0-164d97a55fac\" (UID: \"a7d1c920-dfcd-4d5f-bab0-164d97a55fac\") " Jul 14 12:23:50.335606 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:50.335586 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7d1c920-dfcd-4d5f-bab0-164d97a55fac-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a7d1c920-dfcd-4d5f-bab0-164d97a55fac" (UID: "a7d1c920-dfcd-4d5f-bab0-164d97a55fac"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 12:23:50.436844 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:50.436817 2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7d1c920-dfcd-4d5f-bab0-164d97a55fac-maas-api-service-ca\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 12:23:51.158463 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:51.158432 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-cac82f-dtl95" Jul 14 12:23:51.158463 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:51.158454 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-cac82f-dtl95" event={"ID":"a7d1c920-dfcd-4d5f-bab0-164d97a55fac","Type":"ContainerDied","Data":"a5594642d97ac84cd6477c7c9c07d93d4f0a0699fdedc25353a7ec5819574db9"} Jul 14 12:23:51.158729 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:23:51.158509 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5594642d97ac84cd6477c7c9c07d93d4f0a0699fdedc25353a7ec5819574db9" Jul 14 12:24:13.637923 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:13.637841 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-480a7f-l2mz5"] Jul 14 12:24:13.638411 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:13.638392 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7d1c920-dfcd-4d5f-bab0-164d97a55fac" containerName="revoke-keys" Jul 14 12:24:13.638454 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:13.638413 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7d1c920-dfcd-4d5f-bab0-164d97a55fac" containerName="revoke-keys" Jul 14 12:24:13.638533 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:13.638522 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7d1c920-dfcd-4d5f-bab0-164d97a55fac" containerName="revoke-keys" Jul 14 12:24:13.643384 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:13.643357 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-480a7f-l2mz5" Jul 14 12:24:13.647559 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:13.647540 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7pf27\"" Jul 14 12:24:13.655295 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:13.655269 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-480a7f-l2mz5"] Jul 14 12:24:13.771573 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:13.771532 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f836f2a-d379-4ab7-a67e-4e1d8ad61d1c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-480a7f-l2mz5\" (UID: \"2f836f2a-d379-4ab7-a67e-4e1d8ad61d1c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-480a7f-l2mz5" Jul 14 12:24:13.872545 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:13.872495 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f836f2a-d379-4ab7-a67e-4e1d8ad61d1c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-480a7f-l2mz5\" (UID: \"2f836f2a-d379-4ab7-a67e-4e1d8ad61d1c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-480a7f-l2mz5" Jul 14 12:24:13.873221 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:13.873201 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f836f2a-d379-4ab7-a67e-4e1d8ad61d1c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-480a7f-l2mz5\" (UID: \"2f836f2a-d379-4ab7-a67e-4e1d8ad61d1c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-480a7f-l2mz5" Jul 14 12:24:13.954476 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:13.954441 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-480a7f-l2mz5" Jul 14 12:24:14.101457 ip-10-0-136-205 kubenswrapper[2582]: W0714 12:24:14.101415 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f836f2a_d379_4ab7_a67e_4e1d8ad61d1c.slice/crio-252f7627ce079d6dc36bb6bb0c986fabe10e783f45596efedab6f33598f0846d WatchSource:0}: Error finding container 252f7627ce079d6dc36bb6bb0c986fabe10e783f45596efedab6f33598f0846d: Status 404 returned error can't find the container with id 252f7627ce079d6dc36bb6bb0c986fabe10e783f45596efedab6f33598f0846d Jul 14 12:24:14.101968 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:14.101941 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-480a7f-l2mz5"] Jul 14 12:24:14.291851 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:14.291756 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-480a7f-l2mz5" event={"ID":"2f836f2a-d379-4ab7-a67e-4e1d8ad61d1c","Type":"ContainerStarted","Data":"252f7627ce079d6dc36bb6bb0c986fabe10e783f45596efedab6f33598f0846d"} Jul 14 12:24:15.292883 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:15.292847 2582 generic.go:356] "Generic (PLEG): container finished" podID="2f836f2a-d379-4ab7-a67e-4e1d8ad61d1c" containerID="ed8e99af2b3108ef47f64cab4f168fd90143eb5f2b838dcd558b175b3c7801c1" exitCode=0 Jul 14 12:24:15.293289 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:15.292930 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-480a7f-l2mz5" event={"ID":"2f836f2a-d379-4ab7-a67e-4e1d8ad61d1c","Type":"ContainerDied","Data":"ed8e99af2b3108ef47f64cab4f168fd90143eb5f2b838dcd558b175b3c7801c1"} Jul 14 12:24:16.435782 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:16.435754 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-480a7f-l2mz5" Jul 14 12:24:16.497778 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:16.497748 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f836f2a-d379-4ab7-a67e-4e1d8ad61d1c-maas-api-service-ca\") pod \"2f836f2a-d379-4ab7-a67e-4e1d8ad61d1c\" (UID: \"2f836f2a-d379-4ab7-a67e-4e1d8ad61d1c\") " Jul 14 12:24:16.498141 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:16.498115 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f836f2a-d379-4ab7-a67e-4e1d8ad61d1c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2f836f2a-d379-4ab7-a67e-4e1d8ad61d1c" (UID: "2f836f2a-d379-4ab7-a67e-4e1d8ad61d1c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 12:24:16.599494 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:16.599410 2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f836f2a-d379-4ab7-a67e-4e1d8ad61d1c-maas-api-service-ca\") on node \"ip-10-0-136-205.ec2.internal\" DevicePath \"\"" Jul 14 12:24:17.314484 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:17.314449 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-480a7f-l2mz5" Jul 14 12:24:17.314661 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:17.314484 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-480a7f-l2mz5" event={"ID":"2f836f2a-d379-4ab7-a67e-4e1d8ad61d1c","Type":"ContainerDied","Data":"252f7627ce079d6dc36bb6bb0c986fabe10e783f45596efedab6f33598f0846d"} Jul 14 12:24:17.314661 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:17.314550 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="252f7627ce079d6dc36bb6bb0c986fabe10e783f45596efedab6f33598f0846d" Jul 14 12:24:40.244358 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:40.244314 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-bb77cfb67-lz9ds_76452430-32cb-4189-a9fa-3c58b7b4e713/authorino/0.log" Jul 14 12:24:45.544626 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:45.544590 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-b78fdddb5-f8td5_de82ed98-f182-4fc9-ae2d-c001d40f7174/manager/0.log" Jul 14 12:24:46.053024 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:46.052995 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c944d8cbf-tbf24_201355bf-d5b5-476c-9a28-432fc64a5545/copy-manifests/0.log" Jul 14 12:24:46.061961 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:46.061927 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c944d8cbf-tbf24_201355bf-d5b5-476c-9a28-432fc64a5545/manager/0.log" Jul 14 12:24:46.557374 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:46.557340 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-67c78b686b-95gd4_1b306a96-7cc8-426c-9cd9-479651106aa9/maas-api/0.log" Jul 14 12:24:46.789923 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:46.789890 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29733855-r62rq_e33f426c-de35-4b16-9cbe-a4b9456de08e/cleanup/0.log" Jul 14 12:24:47.477870 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:47.477843 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-ae12a0-phhnn_797e39c7-505b-402e-a93b-7c9e2b0b2fbd/revoke-keys/0.log" Jul 14 12:24:48.066987 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:48.066961 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-cac82f-dtl95_a7d1c920-dfcd-4d5f-bab0-164d97a55fac/revoke-keys/0.log" Jul 14 12:24:48.182706 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:48.182675 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-480a7f-l2mz5_2f836f2a-d379-4ab7-a67e-4e1d8ad61d1c/revoke-keys/0.log" Jul 14 12:24:48.297681 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:48.297652 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-gjqg6_03254699-08fc-4f84-b4e4-4aaeb2f522fc/postgres/0.log" Jul 14 12:24:49.636337 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:49.636300 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-bb77cfb67-lz9ds_76452430-32cb-4189-a9fa-3c58b7b4e713/authorino/0.log" Jul 14 12:24:49.752799 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:49.752767 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-phtnn_66a01bea-7419-4352-b1cf-fcce4fe69dc2/manager/0.log" Jul 14 12:24:51.203551 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:51.203514 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d55c74c4b-t7nxv_99fca359-3d03-41b7-a10d-b08e944a8394/kube-auth-proxy/0.log" Jul 14 12:24:51.590109 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:51.590010 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-r5xf6_5e8fdda3-85e3-47bc-8c2f-4fa9b417a496/payload-processing/0.log" Jul 14 12:24:52.623893 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:52.623846 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-b9sfc_5669f9e2-00d4-45cf-8ec5-9c6661e1c76d/main/0.log" Jul 14 12:24:52.737854 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:24:52.737814 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-ffnhj_315ee210-ca26-487f-b404-a2f3e868529e/main/0.log" Jul 14 12:25:00.192420 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:00.192380 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tzr85_58e8bad1-cbf8-4e99-a3c4-e1ed762ac2ed/global-pull-secret-syncer/0.log" Jul 14 12:25:00.426714 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:00.426686 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-d5t8j_26896a0a-efe8-47c3-8ba4-725363407c4f/konnectivity-agent/0.log" Jul 14 12:25:00.543456 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:00.543330 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-205.ec2.internal_0f2609a843c4dae5cfd321dd4169d5da/haproxy/0.log" Jul 14 12:25:05.793470 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:05.793437 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-bb77cfb67-lz9ds_76452430-32cb-4189-a9fa-3c58b7b4e713/authorino/0.log" Jul 14 12:25:05.830256 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:05.830156 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-phtnn_66a01bea-7419-4352-b1cf-fcce4fe69dc2/manager/0.log" Jul 14 12:25:08.311720 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:08.311688 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-9fhh5_33570f3c-7195-4140-abde-620064e6a076/cluster-monitoring-operator/0.log" Jul 14 12:25:08.343644 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:08.343610 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-wnm9k_63e25b04-9c3d-4e02-93ef-0323a6430f1a/kube-state-metrics/0.log" Jul 14 12:25:08.375312 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:08.375282 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-wnm9k_63e25b04-9c3d-4e02-93ef-0323a6430f1a/kube-rbac-proxy-main/0.log" Jul 14 12:25:08.404382 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:08.404351 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-wnm9k_63e25b04-9c3d-4e02-93ef-0323a6430f1a/kube-rbac-proxy-self/0.log" Jul 14 12:25:08.436927 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:08.436895 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6fd85b8888-kwb5f_6418eecb-846e-448e-9d2c-a41f67b09ce4/metrics-server/0.log" Jul 14 12:25:08.467420 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:08.467326 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-c9wxm_8c7fa955-8964-484d-a0eb-37ac08a12fe1/monitoring-plugin/0.log" Jul 14 12:25:08.503018 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:08.502991 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dcw2c_4df7bd22-061c-44c2-bb65-63e702106cd9/node-exporter/0.log" Jul 14 12:25:08.528510 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:08.528474 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dcw2c_4df7bd22-061c-44c2-bb65-63e702106cd9/kube-rbac-proxy/0.log" Jul 14 12:25:08.555177 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:08.555149 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dcw2c_4df7bd22-061c-44c2-bb65-63e702106cd9/init-textfile/0.log" Jul 14 12:25:08.778046 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:08.777970 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-kw885_cd9c4153-0a48-42d9-af01-94ac9e4757de/kube-rbac-proxy-main/0.log" Jul 14 12:25:08.805300 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:08.805267 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-kw885_cd9c4153-0a48-42d9-af01-94ac9e4757de/kube-rbac-proxy-self/0.log" Jul 14 12:25:08.832007 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:08.831979 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-kw885_cd9c4153-0a48-42d9-af01-94ac9e4757de/openshift-state-metrics/0.log" Jul 14 12:25:08.876572 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:08.876541 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_867ee989-74d0-41f4-9434-d26da67f950f/prometheus/0.log" Jul 14 12:25:08.902544 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:08.902511 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_867ee989-74d0-41f4-9434-d26da67f950f/config-reloader/0.log" Jul 14 12:25:08.933843 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:08.933805 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_867ee989-74d0-41f4-9434-d26da67f950f/thanos-sidecar/0.log" Jul 14 12:25:08.963493 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:08.963469 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_867ee989-74d0-41f4-9434-d26da67f950f/kube-rbac-proxy-web/0.log" Jul 14 12:25:09.003217 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:09.003187 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_867ee989-74d0-41f4-9434-d26da67f950f/kube-rbac-proxy/0.log" Jul 14 12:25:09.029405 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:09.029319 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_867ee989-74d0-41f4-9434-d26da67f950f/kube-rbac-proxy-thanos/0.log" Jul 14 12:25:09.057387 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:09.057360 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_867ee989-74d0-41f4-9434-d26da67f950f/init-config-reloader/0.log" Jul 14 12:25:09.095883 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:09.095843 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-chck7_5d297dcf-8d92-45c0-9976-b2a65c64eef9/prometheus-operator/0.log" Jul 14 12:25:09.118535 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:09.118509 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-chck7_5d297dcf-8d92-45c0-9976-b2a65c64eef9/kube-rbac-proxy/0.log" Jul 14 12:25:09.179444 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:09.179377 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-57c9957ccc-ph9gs_3aeb72b6-36bf-4532-9420-1dc39f65246c/telemeter-client/0.log" Jul 14 12:25:09.209313 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:09.209283 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-57c9957ccc-ph9gs_3aeb72b6-36bf-4532-9420-1dc39f65246c/reload/0.log" Jul 14 12:25:09.232817 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:09.232789 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-57c9957ccc-ph9gs_3aeb72b6-36bf-4532-9420-1dc39f65246c/kube-rbac-proxy/0.log" Jul 14 12:25:09.274890 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:09.274864 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d64689769-x9qwz_a82bc27a-4025-4bfa-b653-526605543465/thanos-query/0.log" Jul 14 12:25:09.299838 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:09.299739 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d64689769-x9qwz_a82bc27a-4025-4bfa-b653-526605543465/kube-rbac-proxy-web/0.log" Jul 14 12:25:09.328703 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:09.328675 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d64689769-x9qwz_a82bc27a-4025-4bfa-b653-526605543465/kube-rbac-proxy/0.log" Jul 14 12:25:09.353520 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:09.353484 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d64689769-x9qwz_a82bc27a-4025-4bfa-b653-526605543465/prom-label-proxy/0.log" Jul 14 12:25:09.381888 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:09.381860 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d64689769-x9qwz_a82bc27a-4025-4bfa-b653-526605543465/kube-rbac-proxy-rules/0.log" Jul 14 12:25:09.414081 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:09.414050 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d64689769-x9qwz_a82bc27a-4025-4bfa-b653-526605543465/kube-rbac-proxy-metrics/0.log" Jul 14 12:25:10.222394 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:10.222348 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t6fcf/perf-node-gather-daemonset-2qf2q"] Jul 14 12:25:10.222890 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:10.222871 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f836f2a-d379-4ab7-a67e-4e1d8ad61d1c" containerName="revoke-keys" Jul 14 12:25:10.222998 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:10.222894 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f836f2a-d379-4ab7-a67e-4e1d8ad61d1c" containerName="revoke-keys" Jul 14 12:25:10.222998 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:10.222989 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f836f2a-d379-4ab7-a67e-4e1d8ad61d1c" containerName="revoke-keys" Jul 14 12:25:10.226488 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:10.226465 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t6fcf/perf-node-gather-daemonset-2qf2q" Jul 14 12:25:10.229337 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:10.229314 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t6fcf\"/\"kube-root-ca.crt\"" Jul 14 12:25:10.229452 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:10.229398 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-t6fcf\"/\"default-dockercfg-tcbhs\"" Jul 14 12:25:10.230644 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:10.230622 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t6fcf\"/\"openshift-service-ca.crt\"" Jul 14 12:25:10.235967 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:10.235940 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t6fcf/perf-node-gather-daemonset-2qf2q"] Jul 14 12:25:10.337431 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:10.337389 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d6eb43f8-e594-479a-8d04-79f304dface0-proc\") pod \"perf-node-gather-daemonset-2qf2q\" (UID: \"d6eb43f8-e594-479a-8d04-79f304dface0\") " pod="openshift-must-gather-t6fcf/perf-node-gather-daemonset-2qf2q" Jul 14 12:25:10.337859 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:10.337472 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6wwt\" (UniqueName: \"kubernetes.io/projected/d6eb43f8-e594-479a-8d04-79f304dface0-kube-api-access-k6wwt\") pod \"perf-node-gather-daemonset-2qf2q\" (UID: \"d6eb43f8-e594-479a-8d04-79f304dface0\") " pod="openshift-must-gather-t6fcf/perf-node-gather-daemonset-2qf2q" Jul 14 12:25:10.337859 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:10.337515 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d6eb43f8-e594-479a-8d04-79f304dface0-lib-modules\") pod \"perf-node-gather-daemonset-2qf2q\" (UID: \"d6eb43f8-e594-479a-8d04-79f304dface0\") " pod="openshift-must-gather-t6fcf/perf-node-gather-daemonset-2qf2q" Jul 14 12:25:10.337859 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:10.337573 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d6eb43f8-e594-479a-8d04-79f304dface0-podres\") pod \"perf-node-gather-daemonset-2qf2q\" (UID: \"d6eb43f8-e594-479a-8d04-79f304dface0\") " pod="openshift-must-gather-t6fcf/perf-node-gather-daemonset-2qf2q" Jul 14 12:25:10.337859 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:10.337619 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6eb43f8-e594-479a-8d04-79f304dface0-sys\") pod \"perf-node-gather-daemonset-2qf2q\" (UID: \"d6eb43f8-e594-479a-8d04-79f304dface0\") " pod="openshift-must-gather-t6fcf/perf-node-gather-daemonset-2qf2q" Jul 14 12:25:10.438215 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:10.438166 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d6eb43f8-e594-479a-8d04-79f304dface0-proc\") pod \"perf-node-gather-daemonset-2qf2q\" (UID: \"d6eb43f8-e594-479a-8d04-79f304dface0\") " pod="openshift-must-gather-t6fcf/perf-node-gather-daemonset-2qf2q" Jul 14 12:25:10.438399 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:10.438246 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6wwt\" (UniqueName: \"kubernetes.io/projected/d6eb43f8-e594-479a-8d04-79f304dface0-kube-api-access-k6wwt\") pod \"perf-node-gather-daemonset-2qf2q\" (UID: \"d6eb43f8-e594-479a-8d04-79f304dface0\") " pod="openshift-must-gather-t6fcf/perf-node-gather-daemonset-2qf2q" Jul 14 12:25:10.438399 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:10.438261 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d6eb43f8-e594-479a-8d04-79f304dface0-proc\") pod \"perf-node-gather-daemonset-2qf2q\" (UID: \"d6eb43f8-e594-479a-8d04-79f304dface0\") " pod="openshift-must-gather-t6fcf/perf-node-gather-daemonset-2qf2q" Jul 14 12:25:10.438399 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:10.438286 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d6eb43f8-e594-479a-8d04-79f304dface0-lib-modules\") pod \"perf-node-gather-daemonset-2qf2q\" (UID: \"d6eb43f8-e594-479a-8d04-79f304dface0\") " pod="openshift-must-gather-t6fcf/perf-node-gather-daemonset-2qf2q" Jul 14 12:25:10.438399 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:10.438312 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d6eb43f8-e594-479a-8d04-79f304dface0-podres\") pod \"perf-node-gather-daemonset-2qf2q\" (UID: \"d6eb43f8-e594-479a-8d04-79f304dface0\") " pod="openshift-must-gather-t6fcf/perf-node-gather-daemonset-2qf2q" Jul 14 12:25:10.438399 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:10.438337 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6eb43f8-e594-479a-8d04-79f304dface0-sys\") pod \"perf-node-gather-daemonset-2qf2q\" (UID: \"d6eb43f8-e594-479a-8d04-79f304dface0\") " pod="openshift-must-gather-t6fcf/perf-node-gather-daemonset-2qf2q" Jul 14 12:25:10.438399 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:10.438381 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d6eb43f8-e594-479a-8d04-79f304dface0-lib-modules\") pod \"perf-node-gather-daemonset-2qf2q\" (UID: \"d6eb43f8-e594-479a-8d04-79f304dface0\") " pod="openshift-must-gather-t6fcf/perf-node-gather-daemonset-2qf2q" Jul 14 12:25:10.438608 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:10.438404 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6eb43f8-e594-479a-8d04-79f304dface0-sys\") pod \"perf-node-gather-daemonset-2qf2q\" (UID: \"d6eb43f8-e594-479a-8d04-79f304dface0\") " pod="openshift-must-gather-t6fcf/perf-node-gather-daemonset-2qf2q" Jul 14 12:25:10.438608 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:10.438443 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d6eb43f8-e594-479a-8d04-79f304dface0-podres\") pod \"perf-node-gather-daemonset-2qf2q\" (UID: \"d6eb43f8-e594-479a-8d04-79f304dface0\") " pod="openshift-must-gather-t6fcf/perf-node-gather-daemonset-2qf2q" Jul 14 12:25:10.450689 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:10.450653 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6wwt\" (UniqueName: \"kubernetes.io/projected/d6eb43f8-e594-479a-8d04-79f304dface0-kube-api-access-k6wwt\") pod \"perf-node-gather-daemonset-2qf2q\" (UID: \"d6eb43f8-e594-479a-8d04-79f304dface0\") " pod="openshift-must-gather-t6fcf/perf-node-gather-daemonset-2qf2q" Jul 14 12:25:10.537688 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:10.537590 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t6fcf/perf-node-gather-daemonset-2qf2q" Jul 14 12:25:10.687776 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:10.687752 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t6fcf/perf-node-gather-daemonset-2qf2q"] Jul 14 12:25:10.690128 ip-10-0-136-205 kubenswrapper[2582]: W0714 12:25:10.690062 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd6eb43f8_e594_479a_8d04_79f304dface0.slice/crio-5149f44b737ca7845b316a947f7da35b958941d81deb09e769644165e5b97051 WatchSource:0}: Error finding container 5149f44b737ca7845b316a947f7da35b958941d81deb09e769644165e5b97051: Status 404 returned error can't find the container with id 5149f44b737ca7845b316a947f7da35b958941d81deb09e769644165e5b97051 Jul 14 12:25:11.606618 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:11.606585 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t6fcf/perf-node-gather-daemonset-2qf2q" event={"ID":"d6eb43f8-e594-479a-8d04-79f304dface0","Type":"ContainerStarted","Data":"d0977a51001c7d313de1da0d4218358d19b49b59a09fce51b4c51524422e3046"} Jul 14 12:25:11.607084 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:11.606638 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t6fcf/perf-node-gather-daemonset-2qf2q" event={"ID":"d6eb43f8-e594-479a-8d04-79f304dface0","Type":"ContainerStarted","Data":"5149f44b737ca7845b316a947f7da35b958941d81deb09e769644165e5b97051"} Jul 14 12:25:11.607084 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:11.606691 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-t6fcf/perf-node-gather-daemonset-2qf2q" Jul 14 12:25:11.630487 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:11.630431 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t6fcf/perf-node-gather-daemonset-2qf2q" podStartSLOduration=1.630415357 podStartE2EDuration="1.630415357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 12:25:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 12:25:11.629491009 +0000 UTC m=+2841.992142315" watchObservedRunningTime="2026-07-14 12:25:11.630415357 +0000 UTC m=+2841.993066661" Jul 14 12:25:11.865806 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:11.865727 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86cc8bb759-jmfw9_df98f0f4-0c08-4a1b-a94f-ff2086aafab8/console/0.log" Jul 14 12:25:11.909838 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:11.909800 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-rz5tl_a3187fd3-a613-4c7d-8ded-8945d186d2ac/download-server/0.log" Jul 14 12:25:13.841845 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:13.841815 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hmwlj_d964c90c-a221-44a2-809c-d274d60ceb0c/dns/0.log" Jul 14 12:25:13.868818 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:13.868794 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hmwlj_d964c90c-a221-44a2-809c-d274d60ceb0c/kube-rbac-proxy/0.log" Jul 14 12:25:13.898610 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:13.898582 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-khpgc_3a59961e-8988-4654-a707-2d8eebcfd740/dns-node-resolver/0.log" Jul 14 12:25:14.642589 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:14.642559 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-trjql_ea5c34bb-6876-46ea-891f-02cbcf0ba9fe/node-ca/0.log" Jul 14 12:25:15.876817 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:15.876769 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d55c74c4b-t7nxv_99fca359-3d03-41b7-a10d-b08e944a8394/kube-auth-proxy/0.log" Jul 14 12:25:16.036276 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:16.036247 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-r5xf6_5e8fdda3-85e3-47bc-8c2f-4fa9b417a496/payload-processing/0.log" Jul 14 12:25:16.825818 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:16.825787 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fvzhp_4ceae2d9-3ec8-41c4-99b6-34be1f78fb82/serve-healthcheck-canary/0.log" Jul 14 12:25:17.423459 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:17.423424 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-9hz66_865b8f11-fdb0-430a-93c5-aa4901f6cf08/insights-operator/0.log" Jul 14 12:25:17.424384 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:17.424353 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-9hz66_865b8f11-fdb0-430a-93c5-aa4901f6cf08/insights-operator/1.log" Jul 14 12:25:17.548415 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:17.548383 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dwps6_405ed3ed-1f94-4ce6-8bb4-73432f5aace9/kube-rbac-proxy/0.log" Jul 14 12:25:17.573698 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:17.573668 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dwps6_405ed3ed-1f94-4ce6-8bb4-73432f5aace9/exporter/0.log" Jul 14 12:25:17.599378 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:17.599340 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dwps6_405ed3ed-1f94-4ce6-8bb4-73432f5aace9/extractor/0.log" Jul 14 12:25:17.621693 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:17.621661 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-t6fcf/perf-node-gather-daemonset-2qf2q" Jul 14 12:25:20.669953 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:20.669857 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-b78fdddb5-f8td5_de82ed98-f182-4fc9-ae2d-c001d40f7174/manager/0.log" Jul 14 12:25:20.863297 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:20.863263 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c944d8cbf-tbf24_201355bf-d5b5-476c-9a28-432fc64a5545/manager/0.log" Jul 14 12:25:20.890571 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:20.890542 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c944d8cbf-tbf24_201355bf-d5b5-476c-9a28-432fc64a5545/copy-manifests/0.log" Jul 14 12:25:21.037055 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:21.037017 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d55c74c4b-t7nxv_99fca359-3d03-41b7-a10d-b08e944a8394/kube-auth-proxy/0.log" Jul 14 12:25:21.153565 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:21.153531 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-r5xf6_5e8fdda3-85e3-47bc-8c2f-4fa9b417a496/payload-processing/0.log" Jul 14 12:25:22.313510 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:22.313425 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6ff9db667-bvhbk_914865bf-c1a5-4fa1-903a-3ec7f4b60d74/manager/0.log" Jul 14 12:25:22.625454 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:22.625376 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d55c74c4b-t7nxv_99fca359-3d03-41b7-a10d-b08e944a8394/kube-auth-proxy/0.log" Jul 14 12:25:22.742491 ip-10-0-136-205 kubenswrapper[2582]: I0714 12:25:22.742449 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-r5xf6_5e8fdda3-85e3-47bc-8c2f-4fa9b417a496/payload-processing/0.log"