Jul 01 20:17:05.667657 ip-10-0-141-231 systemd[1]: Starting Kubernetes Kubelet... Jul 01 20:17:06.059821 ip-10-0-141-231 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 20:17:06.059821 ip-10-0-141-231 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 20:17:06.059821 ip-10-0-141-231 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 20:17:06.059821 ip-10-0-141-231 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 20:17:06.059821 ip-10-0-141-231 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 20:17:06.061537 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.061455 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 20:17:06.068246 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068203 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 20:17:06.068370 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068353 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 20:17:06.068370 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068364 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 20:17:06.068370 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068369 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 20:17:06.068456 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068373 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 20:17:06.068456 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068376 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 20:17:06.068456 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068380 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 20:17:06.068456 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068383 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 20:17:06.068456 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068386 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 20:17:06.068456 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068389 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 20:17:06.068456 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068391 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 20:17:06.068456 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068394 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 20:17:06.068456 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068397 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 20:17:06.068456 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068399 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 20:17:06.068456 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068402 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 20:17:06.068456 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068404 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 20:17:06.068456 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068407 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 20:17:06.068456 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068410 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 20:17:06.068456 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068412 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 20:17:06.068456 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068415 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 20:17:06.068456 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068417 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 20:17:06.068456 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068420 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 20:17:06.068456 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068422 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 20:17:06.068456 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068425 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 20:17:06.068922 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068428 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 20:17:06.068922 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068430 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 20:17:06.068922 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068433 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 20:17:06.068922 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068435 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 20:17:06.068922 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068438 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 20:17:06.068922 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068441 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 20:17:06.068922 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068443 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 20:17:06.068922 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068445 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 20:17:06.068922 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068448 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 20:17:06.068922 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068456 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 20:17:06.068922 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068461 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 20:17:06.068922 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068464 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 20:17:06.068922 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068468 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 20:17:06.068922 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068471 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 01 20:17:06.068922 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068473 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 20:17:06.068922 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068476 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 20:17:06.068922 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068478 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 20:17:06.068922 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068481 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 20:17:06.068922 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068483 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 20:17:06.068922 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068486 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 20:17:06.069462 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068488 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 20:17:06.069462 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068491 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 20:17:06.069462 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068493 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 20:17:06.069462 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068496 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 20:17:06.069462 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068498 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 20:17:06.069462 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068501 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 20:17:06.069462 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068503 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 20:17:06.069462 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068506 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 20:17:06.069462 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068511 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 20:17:06.069462 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068515 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 20:17:06.069462 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068518 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 20:17:06.069462 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068521 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 20:17:06.069462 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068526 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 20:17:06.069462 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068531 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 20:17:06.069462 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068536 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 20:17:06.069462 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068539 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 20:17:06.069462 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068542 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 20:17:06.069462 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068546 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 20:17:06.069462 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068551 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 20:17:06.069902 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068555 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 20:17:06.069902 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068560 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 20:17:06.069902 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068563 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 20:17:06.069902 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068567 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 20:17:06.069902 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068570 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 20:17:06.069902 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068573 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 20:17:06.069902 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068576 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 20:17:06.069902 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068579 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 20:17:06.069902 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068582 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 20:17:06.069902 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068585 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 20:17:06.069902 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068588 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 20:17:06.069902 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068590 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 20:17:06.069902 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068593 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 20:17:06.069902 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068596 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 20:17:06.069902 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068598 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 20:17:06.069902 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068601 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 20:17:06.069902 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068604 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 20:17:06.069902 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068606 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 20:17:06.069902 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068611 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 20:17:06.069902 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068613 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 20:17:06.070393 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068618 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 20:17:06.070393 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068620 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 20:17:06.070393 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068623 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 20:17:06.070393 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068626 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 20:17:06.070393 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068628 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 20:17:06.070393 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068631 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 20:17:06.070393 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068635 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 20:17:06.070393 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068638 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 20:17:06.070393 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068641 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 20:17:06.070393 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068643 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 20:17:06.070393 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068646 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 20:17:06.070393 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068648 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 20:17:06.070393 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068651 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 20:17:06.070393 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068654 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 20:17:06.070393 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068656 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 20:17:06.070393 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.068659 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 20:17:06.070770 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070549 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 20:17:06.070770 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070558 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 20:17:06.070770 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070562 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 20:17:06.070770 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070565 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 20:17:06.070770 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070568 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 20:17:06.070770 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070572 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 20:17:06.070770 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070575 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 20:17:06.070770 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070578 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 20:17:06.070770 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070580 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 20:17:06.070770 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070583 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 20:17:06.070770 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070586 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 20:17:06.070770 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070588 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 20:17:06.070770 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070591 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 20:17:06.070770 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070594 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 20:17:06.070770 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070596 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 20:17:06.070770 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070599 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 20:17:06.070770 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070601 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 20:17:06.070770 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070605 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 20:17:06.070770 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070607 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 20:17:06.071218 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070610 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 20:17:06.071218 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070613 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 20:17:06.071218 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070616 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 20:17:06.071218 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070620 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 20:17:06.071218 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070623 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 20:17:06.071218 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070625 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 01 20:17:06.071218 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070628 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 20:17:06.071218 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070630 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 20:17:06.071218 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070633 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 20:17:06.071218 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070635 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 20:17:06.071218 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070638 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 20:17:06.071218 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070640 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 20:17:06.071218 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070643 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 20:17:06.071218 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070645 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 20:17:06.071218 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070650 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 20:17:06.071218 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070653 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 20:17:06.071218 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070656 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 20:17:06.071218 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070659 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 20:17:06.071218 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070662 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 20:17:06.071218 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070665 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 20:17:06.071704 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070667 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 20:17:06.071704 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070670 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 20:17:06.071704 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070672 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 20:17:06.071704 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070675 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 20:17:06.071704 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070677 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 20:17:06.071704 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070680 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 20:17:06.071704 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070683 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 20:17:06.071704 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070685 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 20:17:06.071704 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070688 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 20:17:06.071704 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070690 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 20:17:06.071704 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070693 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 20:17:06.071704 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070696 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 20:17:06.071704 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070698 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 20:17:06.071704 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070701 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 20:17:06.071704 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070703 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 20:17:06.071704 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070706 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 20:17:06.071704 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070708 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 20:17:06.071704 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070711 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 20:17:06.071704 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070714 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 20:17:06.071704 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070717 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 20:17:06.072173 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070721 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 20:17:06.072173 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070724 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 20:17:06.072173 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070728 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 20:17:06.072173 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070730 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 20:17:06.072173 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070733 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 20:17:06.072173 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070736 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 20:17:06.072173 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070739 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 20:17:06.072173 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070741 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 20:17:06.072173 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070744 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 20:17:06.072173 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070747 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 20:17:06.072173 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070749 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 20:17:06.072173 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070752 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 20:17:06.072173 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070755 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 20:17:06.072173 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070758 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 20:17:06.072173 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070760 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 20:17:06.072173 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070764 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 20:17:06.072173 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070767 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 20:17:06.072173 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070770 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 20:17:06.072173 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070773 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 20:17:06.072628 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070776 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 20:17:06.072628 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070779 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 20:17:06.072628 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070781 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 20:17:06.072628 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070784 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 20:17:06.072628 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070787 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 20:17:06.072628 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070790 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 20:17:06.072628 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070792 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 20:17:06.072628 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070795 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 20:17:06.072628 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070797 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 20:17:06.072628 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070799 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 20:17:06.072628 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070802 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 20:17:06.072628 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070805 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 20:17:06.072628 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070807 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 20:17:06.072628 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070810 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 20:17:06.072628 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070813 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 20:17:06.072628 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070815 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 20:17:06.072628 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070818 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 20:17:06.072628 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070820 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 20:17:06.072628 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070823 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 20:17:06.072628 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070825 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 20:17:06.073094 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.070828 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 20:17:06.073094 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071216 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 20:17:06.073094 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071221 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 20:17:06.073094 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071223 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 20:17:06.073094 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071226 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 20:17:06.073094 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071229 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 20:17:06.073094 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071232 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 20:17:06.073094 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071234 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 20:17:06.073094 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071237 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 20:17:06.073094 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071239 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 20:17:06.073094 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071242 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 20:17:06.073094 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071244 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 20:17:06.073094 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071247 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 20:17:06.073094 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071250 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 20:17:06.073094 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071252 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 20:17:06.073094 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071255 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 20:17:06.073094 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071257 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 20:17:06.073094 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071260 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 20:17:06.073094 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071263 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 20:17:06.073094 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071266 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 20:17:06.073589 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071268 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 20:17:06.073589 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071271 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 20:17:06.073589 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071273 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 20:17:06.073589 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071276 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 20:17:06.073589 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071279 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 20:17:06.073589 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071281 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 20:17:06.073589 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071284 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 20:17:06.073589 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071286 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 20:17:06.073589 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071289 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 20:17:06.073589 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071291 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 20:17:06.073589 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071294 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 20:17:06.073589 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071296 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 20:17:06.073589 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071299 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 20:17:06.073589 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071301 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 20:17:06.073589 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071304 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 20:17:06.073589 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071308 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 20:17:06.073589 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071311 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 20:17:06.073589 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071314 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 20:17:06.073589 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071317 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 20:17:06.074079 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071320 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 20:17:06.074079 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071337 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 20:17:06.074079 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071340 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 20:17:06.074079 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071343 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 20:17:06.074079 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071345 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 20:17:06.074079 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071348 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 20:17:06.074079 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071351 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 20:17:06.074079 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071354 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 20:17:06.074079 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071357 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 20:17:06.074079 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071360 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 20:17:06.074079 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071362 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 20:17:06.074079 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071366 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 20:17:06.074079 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071368 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 20:17:06.074079 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071371 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 20:17:06.074079 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071373 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 20:17:06.074079 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071376 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 20:17:06.074079 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071381 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 20:17:06.074079 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071383 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 20:17:06.074079 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071386 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 20:17:06.074079 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071388 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 20:17:06.074571 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071390 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 20:17:06.074571 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071393 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 20:17:06.074571 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071396 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 20:17:06.074571 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071399 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 20:17:06.074571 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071401 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 20:17:06.074571 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071404 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 20:17:06.074571 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071406 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 20:17:06.074571 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071409 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 20:17:06.074571 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071411 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 20:17:06.074571 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071414 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 20:17:06.074571 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071416 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 20:17:06.074571 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071419 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 20:17:06.074571 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071421 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 20:17:06.074571 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071424 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 20:17:06.074571 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071426 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 20:17:06.074571 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071429 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 20:17:06.074571 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071432 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 20:17:06.074571 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071436 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 20:17:06.074571 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071440 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 20:17:06.075013 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071442 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 20:17:06.075013 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071446 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 20:17:06.075013 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071448 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 01 20:17:06.075013 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071451 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 20:17:06.075013 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071453 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 20:17:06.075013 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071456 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 20:17:06.075013 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071460 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 20:17:06.075013 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071464 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 20:17:06.075013 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071467 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 20:17:06.075013 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071471 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 20:17:06.075013 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071473 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 20:17:06.075013 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071475 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 20:17:06.075013 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071478 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 20:17:06.075013 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071480 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 20:17:06.075013 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071483 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 20:17:06.075013 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071486 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 20:17:06.075013 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071488 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 20:17:06.075013 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071490 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 20:17:06.075013 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071493 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 20:17:06.075479 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071496 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 20:17:06.075479 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071498 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 20:17:06.075479 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.071501 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 20:17:06.075479 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071569 2574 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 20:17:06.075479 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071576 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 20:17:06.075479 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071584 2574 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 20:17:06.075479 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071590 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 20:17:06.075479 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071596 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 20:17:06.075479 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071601 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 20:17:06.075479 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071607 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 20:17:06.075479 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071612 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 20:17:06.075479 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071615 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 20:17:06.075479 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071619 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 20:17:06.075479 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071622 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 20:17:06.075479 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071625 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 20:17:06.075479 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071628 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 20:17:06.075479 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071631 2574 flags.go:64] FLAG: --cgroup-root="" Jul 01 20:17:06.075479 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071634 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 20:17:06.075479 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071637 2574 flags.go:64] FLAG: --client-ca-file="" Jul 01 20:17:06.075479 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071640 2574 flags.go:64] FLAG: --cloud-provider="external" Jul 01 20:17:06.075479 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071644 2574 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 20:17:06.075479 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071648 2574 flags.go:64] FLAG: --cluster-domain="" Jul 01 20:17:06.075479 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071653 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 20:17:06.075479 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071656 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 20:17:06.076046 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071659 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 20:17:06.076046 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071662 2574 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 20:17:06.076046 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071666 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 20:17:06.076046 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071669 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 20:17:06.076046 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071672 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 20:17:06.076046 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071675 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 20:17:06.076046 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071678 2574 flags.go:64] FLAG: --contention-profiling="false" Jul 01 20:17:06.076046 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071681 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 20:17:06.076046 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071684 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 20:17:06.076046 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071687 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 20:17:06.076046 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071689 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 20:17:06.076046 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071694 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 20:17:06.076046 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071697 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 20:17:06.076046 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071700 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 20:17:06.076046 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071702 2574 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 20:17:06.076046 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071705 2574 flags.go:64] FLAG: --enable-server="true" Jul 01 20:17:06.076046 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071708 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 20:17:06.076046 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071713 2574 flags.go:64] FLAG: --event-burst="100" Jul 01 20:17:06.076046 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071716 2574 flags.go:64] FLAG: --event-qps="50" Jul 01 20:17:06.076046 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071719 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 20:17:06.076046 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071722 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 20:17:06.076046 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071725 2574 flags.go:64] FLAG: --eviction-hard="" Jul 01 20:17:06.076046 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071729 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 20:17:06.076046 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071732 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 20:17:06.076632 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071734 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 20:17:06.076632 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071737 2574 flags.go:64] FLAG: --eviction-soft="" Jul 01 20:17:06.076632 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071740 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 20:17:06.076632 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071743 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 20:17:06.076632 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071746 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 20:17:06.076632 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071749 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 20:17:06.076632 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071753 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 20:17:06.076632 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071755 2574 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 20:17:06.076632 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071758 2574 flags.go:64] FLAG: --feature-gates="" Jul 01 20:17:06.076632 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071764 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 20:17:06.076632 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071767 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 20:17:06.076632 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071770 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 20:17:06.076632 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071773 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 20:17:06.076632 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071776 2574 flags.go:64] FLAG: --healthz-port="10248" Jul 01 20:17:06.076632 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071779 2574 flags.go:64] FLAG: --help="false" Jul 01 20:17:06.076632 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071781 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-141-231.ec2.internal" Jul 01 20:17:06.076632 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071784 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 20:17:06.076632 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071787 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 20:17:06.076632 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071790 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 20:17:06.076632 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071793 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 20:17:06.076632 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071796 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 20:17:06.076632 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071799 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 20:17:06.076632 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071802 2574 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 20:17:06.077222 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071804 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 20:17:06.077222 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071807 2574 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 20:17:06.077222 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071810 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 20:17:06.077222 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071813 2574 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 20:17:06.077222 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071818 2574 flags.go:64] FLAG: --kube-reserved="" Jul 01 20:17:06.077222 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071821 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 20:17:06.077222 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071823 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 20:17:06.077222 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071826 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 20:17:06.077222 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071829 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 20:17:06.077222 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071832 2574 flags.go:64] FLAG: --lock-file="" Jul 01 20:17:06.077222 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071835 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 20:17:06.077222 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071838 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 20:17:06.077222 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071841 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 20:17:06.077222 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071846 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 20:17:06.077222 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071849 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 20:17:06.077222 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071852 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 20:17:06.077222 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071855 2574 flags.go:64] FLAG: --logging-format="text" Jul 01 20:17:06.077222 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071858 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 20:17:06.077222 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071861 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 20:17:06.077222 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071864 2574 flags.go:64] FLAG: --manifest-url="" Jul 01 20:17:06.077222 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071866 2574 flags.go:64] FLAG: --manifest-url-header="" Jul 01 20:17:06.077222 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071870 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 20:17:06.077222 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071873 2574 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 20:17:06.077222 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071877 2574 flags.go:64] FLAG: --max-pods="110" Jul 01 20:17:06.077222 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071880 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 20:17:06.077880 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071883 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 20:17:06.077880 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071885 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 20:17:06.077880 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071888 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 20:17:06.077880 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071891 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 20:17:06.077880 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071894 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 20:17:06.077880 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071897 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 20:17:06.077880 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071904 2574 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 20:17:06.077880 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071906 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 20:17:06.077880 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071909 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 20:17:06.077880 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071912 2574 flags.go:64] FLAG: --pod-cidr="" Jul 01 20:17:06.077880 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071915 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 20:17:06.077880 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071923 2574 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 20:17:06.077880 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071926 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 20:17:06.077880 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071929 2574 flags.go:64] FLAG: --pods-per-core="0" Jul 01 20:17:06.077880 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071931 2574 flags.go:64] FLAG: --port="10250" Jul 01 20:17:06.077880 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071935 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 20:17:06.077880 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071937 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08eb91e6a3d58d504" Jul 01 20:17:06.077880 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071940 2574 flags.go:64] FLAG: --qos-reserved="" Jul 01 20:17:06.077880 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071943 2574 flags.go:64] FLAG: --read-only-port="10255" Jul 01 20:17:06.077880 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071946 2574 flags.go:64] FLAG: --register-node="true" Jul 01 20:17:06.077880 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071949 2574 flags.go:64] FLAG: --register-with-taints="" Jul 01 20:17:06.077880 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071952 2574 flags.go:64] FLAG: --registry-burst="10" Jul 01 20:17:06.077880 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071955 2574 flags.go:64] FLAG: --registry-qps="5" Jul 01 20:17:06.077880 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071958 2574 flags.go:64] FLAG: --reserved-cpus="" Jul 01 20:17:06.078466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071961 2574 flags.go:64] FLAG: --reserved-memory="" Jul 01 20:17:06.078466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071964 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 20:17:06.078466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071967 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 20:17:06.078466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071970 2574 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 20:17:06.078466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071972 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 20:17:06.078466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071975 2574 flags.go:64] FLAG: --runonce="false" Jul 01 20:17:06.078466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071978 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 20:17:06.078466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071981 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 20:17:06.078466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071984 2574 flags.go:64] FLAG: --seccomp-default="false" Jul 01 20:17:06.078466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071986 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 20:17:06.078466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071989 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 20:17:06.078466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071992 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 20:17:06.078466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071995 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 20:17:06.078466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.071998 2574 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 20:17:06.078466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.072000 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 20:17:06.078466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.072003 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 20:17:06.078466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.072006 2574 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 20:17:06.078466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.072009 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 20:17:06.078466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.072012 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 20:17:06.078466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.072016 2574 flags.go:64] FLAG: --system-cgroups="" Jul 01 20:17:06.078466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.072019 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 20:17:06.078466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.072024 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 20:17:06.078466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.072026 2574 flags.go:64] FLAG: --tls-cert-file="" Jul 01 20:17:06.078466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.072029 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 20:17:06.078466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.072035 2574 flags.go:64] FLAG: --tls-min-version="" Jul 01 20:17:06.079315 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.072039 2574 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 20:17:06.079315 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.072044 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 20:17:06.079315 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.072048 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 20:17:06.079315 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.072053 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 20:17:06.079315 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.072056 2574 flags.go:64] FLAG: --v="2" Jul 01 20:17:06.079315 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.072060 2574 flags.go:64] FLAG: --version="false" Jul 01 20:17:06.079315 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.072064 2574 flags.go:64] FLAG: --vmodule="" Jul 01 20:17:06.079315 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.072068 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 20:17:06.079315 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.072071 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 20:17:06.079315 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072188 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 20:17:06.079315 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072191 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 20:17:06.079315 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072194 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 20:17:06.079315 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072197 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 20:17:06.079315 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072200 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 20:17:06.079315 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072202 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 20:17:06.079315 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072205 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 20:17:06.079315 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072207 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 20:17:06.079315 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072210 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 20:17:06.079315 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072213 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 20:17:06.079315 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072215 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 20:17:06.079315 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072218 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 20:17:06.079315 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072220 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 20:17:06.080225 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072223 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 20:17:06.080225 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072225 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 20:17:06.080225 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072228 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 20:17:06.080225 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072230 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 20:17:06.080225 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072234 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 20:17:06.080225 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072237 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 20:17:06.080225 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072240 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 20:17:06.080225 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072242 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 20:17:06.080225 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072246 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 20:17:06.080225 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072248 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 20:17:06.080225 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072251 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 20:17:06.080225 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072254 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 20:17:06.080225 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072256 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 20:17:06.080225 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072260 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 20:17:06.080225 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072264 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 20:17:06.080225 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072267 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 20:17:06.080225 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072270 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 20:17:06.080225 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072274 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 20:17:06.080225 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072277 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 20:17:06.080225 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072279 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 20:17:06.081082 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072282 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 20:17:06.081082 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072285 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 20:17:06.081082 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072287 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 20:17:06.081082 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072290 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 20:17:06.081082 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072292 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 20:17:06.081082 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072295 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 20:17:06.081082 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072297 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 20:17:06.081082 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072299 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 20:17:06.081082 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072302 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 01 20:17:06.081082 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072305 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 20:17:06.081082 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072307 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 20:17:06.081082 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072310 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 20:17:06.081082 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072312 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 20:17:06.081082 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072315 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 20:17:06.081082 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072317 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 20:17:06.081082 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072320 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 20:17:06.081082 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072342 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 20:17:06.081082 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072345 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 20:17:06.081082 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072348 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 20:17:06.081082 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072351 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 20:17:06.081712 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072355 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 20:17:06.081712 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072358 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 20:17:06.081712 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072361 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 20:17:06.081712 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072363 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 20:17:06.081712 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072366 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 20:17:06.081712 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072368 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 20:17:06.081712 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072371 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 20:17:06.081712 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072374 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 20:17:06.081712 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072377 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 20:17:06.081712 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072379 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 20:17:06.081712 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072382 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 20:17:06.081712 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072385 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 20:17:06.081712 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072388 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 20:17:06.081712 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072391 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 20:17:06.081712 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072393 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 20:17:06.081712 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072396 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 20:17:06.081712 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072398 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 20:17:06.081712 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072401 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 20:17:06.081712 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072403 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 20:17:06.082543 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072406 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 20:17:06.082543 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072409 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 20:17:06.082543 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072411 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 20:17:06.082543 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072414 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 20:17:06.082543 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072416 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 20:17:06.082543 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072419 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 20:17:06.082543 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072421 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 20:17:06.082543 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072424 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 20:17:06.082543 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072427 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 20:17:06.082543 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072433 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 20:17:06.082543 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072436 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 20:17:06.082543 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072439 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 20:17:06.082543 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072441 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 20:17:06.082543 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072445 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 20:17:06.082543 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072448 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 20:17:06.082543 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072451 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 20:17:06.082543 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072453 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 20:17:06.082543 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072456 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 20:17:06.082543 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072459 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 20:17:06.082543 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072461 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 20:17:06.083273 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072464 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 20:17:06.083273 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072467 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 20:17:06.083273 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072469 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 20:17:06.083273 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072472 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 20:17:06.083273 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072476 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 20:17:06.083273 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072480 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 20:17:06.083273 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.072483 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 20:17:06.083273 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.073120 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 20:17:06.083273 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.080998 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 20:17:06.083273 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.081018 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 20:17:06.083273 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.081625 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 20:17:06.083273 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.081640 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 20:17:06.083273 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081730 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 20:17:06.083273 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081738 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 20:17:06.083758 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081744 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 20:17:06.083758 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081749 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 20:17:06.083758 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081754 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 20:17:06.083758 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081759 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 20:17:06.083758 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081763 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 20:17:06.083758 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081768 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 20:17:06.083758 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081772 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 20:17:06.083758 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081777 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 20:17:06.083758 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081781 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 20:17:06.083758 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081786 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 20:17:06.083758 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081790 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 20:17:06.083758 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081794 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 20:17:06.083758 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081799 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 20:17:06.083758 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081803 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 20:17:06.083758 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081807 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 20:17:06.083758 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081812 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 20:17:06.083758 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081816 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 20:17:06.083758 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081820 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 20:17:06.083758 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081824 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 20:17:06.083758 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081828 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 20:17:06.084587 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081833 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 20:17:06.084587 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081837 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 20:17:06.084587 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081841 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 20:17:06.084587 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081847 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 20:17:06.084587 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081851 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 20:17:06.084587 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081855 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 20:17:06.084587 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081859 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 20:17:06.084587 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081865 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 20:17:06.084587 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081870 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 20:17:06.084587 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081874 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 20:17:06.084587 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081878 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 20:17:06.084587 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081883 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 20:17:06.084587 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081888 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 20:17:06.084587 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081892 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 20:17:06.084587 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081896 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 20:17:06.084587 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081901 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 20:17:06.084587 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081907 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 20:17:06.084587 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081913 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 20:17:06.084587 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081918 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 20:17:06.084587 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081923 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 01 20:17:06.085249 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081927 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 20:17:06.085249 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081931 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 20:17:06.085249 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081935 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 20:17:06.085249 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081940 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 20:17:06.085249 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081944 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 20:17:06.085249 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081949 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 20:17:06.085249 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081953 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 20:17:06.085249 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081958 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 20:17:06.085249 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081962 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 20:17:06.085249 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081967 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 20:17:06.085249 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081971 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 20:17:06.085249 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081975 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 20:17:06.085249 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081979 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 20:17:06.085249 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081983 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 20:17:06.085249 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081990 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 20:17:06.085249 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.081996 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 20:17:06.085249 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082001 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 20:17:06.085249 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082005 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 20:17:06.085861 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082012 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 20:17:06.085861 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082017 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 20:17:06.085861 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082023 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 20:17:06.085861 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082028 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 20:17:06.085861 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082033 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 20:17:06.085861 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082038 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 20:17:06.085861 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082043 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 20:17:06.085861 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082047 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 20:17:06.085861 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082051 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 20:17:06.085861 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082056 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 20:17:06.085861 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082060 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 20:17:06.085861 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082064 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 20:17:06.085861 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082068 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 20:17:06.085861 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082072 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 20:17:06.085861 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082076 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 20:17:06.085861 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082080 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 20:17:06.085861 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082085 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 20:17:06.085861 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082089 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 20:17:06.085861 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082093 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 20:17:06.085861 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082097 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 20:17:06.086461 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082101 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 20:17:06.086461 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082106 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 20:17:06.086461 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082110 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 20:17:06.086461 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082114 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 20:17:06.086461 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082119 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 20:17:06.086461 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082123 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 20:17:06.086461 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082127 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 20:17:06.086461 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082131 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 20:17:06.086461 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082135 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 20:17:06.086461 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082140 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 20:17:06.086461 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082143 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 20:17:06.086461 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082147 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 20:17:06.086461 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082152 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 20:17:06.086461 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082156 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 20:17:06.086461 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082161 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 20:17:06.086461 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082166 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 20:17:06.086461 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082170 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 20:17:06.086461 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082174 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 20:17:06.086461 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082178 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 20:17:06.086925 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.082186 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 20:17:06.086925 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082377 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 20:17:06.086925 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082385 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 20:17:06.086925 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082390 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 20:17:06.086925 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082394 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 20:17:06.086925 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082399 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 20:17:06.086925 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082403 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 20:17:06.086925 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082408 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 20:17:06.086925 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082412 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 20:17:06.086925 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082416 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 20:17:06.086925 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082420 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 20:17:06.086925 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082424 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 20:17:06.086925 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082428 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 20:17:06.086925 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082432 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 20:17:06.086925 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082437 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 20:17:06.087353 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082441 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 20:17:06.087353 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082444 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 20:17:06.087353 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082450 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 20:17:06.087353 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082456 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 20:17:06.087353 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082461 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 20:17:06.087353 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082466 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 20:17:06.087353 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082470 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 20:17:06.087353 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082474 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 20:17:06.087353 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082478 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 20:17:06.087353 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082482 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 20:17:06.087353 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082486 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 20:17:06.087353 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082491 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 20:17:06.087353 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082495 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 20:17:06.087353 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082499 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 20:17:06.087353 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082505 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 20:17:06.087353 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082509 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 20:17:06.087353 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082514 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 20:17:06.087353 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082520 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 20:17:06.087353 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082526 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 20:17:06.087859 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082531 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 20:17:06.087859 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082536 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 20:17:06.087859 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082540 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 20:17:06.087859 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082545 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 20:17:06.087859 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082548 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 20:17:06.087859 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082552 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 20:17:06.087859 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082556 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 20:17:06.087859 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082560 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 20:17:06.087859 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082564 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 20:17:06.087859 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082568 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 20:17:06.087859 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082572 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 20:17:06.087859 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082576 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 20:17:06.087859 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082581 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 20:17:06.087859 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082585 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 01 20:17:06.087859 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082589 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 20:17:06.087859 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082596 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 20:17:06.087859 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082601 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 20:17:06.087859 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082606 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 20:17:06.087859 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082611 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 20:17:06.088314 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082615 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 20:17:06.088314 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082619 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 20:17:06.088314 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082624 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 20:17:06.088314 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082628 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 20:17:06.088314 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082632 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 20:17:06.088314 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082637 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 20:17:06.088314 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082641 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 20:17:06.088314 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082646 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 20:17:06.088314 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082650 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 20:17:06.088314 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082655 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 20:17:06.088314 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082660 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 20:17:06.088314 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082664 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 20:17:06.088314 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082668 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 20:17:06.088314 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082672 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 20:17:06.088314 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082676 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 20:17:06.088314 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082680 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 20:17:06.088314 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082685 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 20:17:06.088314 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082689 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 20:17:06.088314 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082693 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 20:17:06.088314 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082697 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 20:17:06.088833 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082701 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 20:17:06.088833 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082705 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 20:17:06.088833 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082709 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 20:17:06.088833 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082713 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 20:17:06.088833 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082718 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 20:17:06.088833 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082723 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 20:17:06.088833 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082727 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 20:17:06.088833 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082731 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 20:17:06.088833 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082735 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 20:17:06.088833 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082739 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 20:17:06.088833 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082743 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 20:17:06.088833 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082747 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 20:17:06.088833 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082751 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 20:17:06.088833 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082755 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 20:17:06.088833 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082760 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 20:17:06.088833 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082764 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 20:17:06.088833 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082768 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 20:17:06.088833 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082773 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 20:17:06.088833 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082777 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 20:17:06.089444 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082781 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 20:17:06.089444 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082785 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 20:17:06.089444 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082789 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 20:17:06.089444 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082793 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 20:17:06.089444 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082798 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 20:17:06.089444 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082802 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 20:17:06.089444 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082806 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 20:17:06.089444 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:06.082810 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 20:17:06.089444 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.082818 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 20:17:06.089444 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.082983 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 20:17:06.089444 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.085594 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 20:17:06.089444 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.086975 2574 server.go:1019] "Starting client certificate rotation" Jul 01 20:17:06.089444 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.087077 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 20:17:06.089444 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.087106 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 20:17:06.090016 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.089799 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 20:17:06.094269 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.094251 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 20:17:06.104402 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.104384 2574 log.go:25] "Validated CRI v1 runtime API" Jul 01 20:17:06.106357 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.106342 2574 log.go:25] "Validated CRI v1 image API" Jul 01 20:17:06.107127 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.107111 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 20:17:06.111120 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.111097 2574 fs.go:135] Filesystem UUIDs: map[0b360aa3-7576-4dd5-baf8-4c78365dc270:/dev/nvme0n1p4 402e2ff0-3c79-4717-8406-84083c2ff794:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 01 20:17:06.111184 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.111115 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 20:17:06.114774 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.114751 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 20:17:06.116640 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.116536 2574 manager.go:216] Machine: {Timestamp:2026-07-01 20:17:06.115413877 +0000 UTC m=+0.335906819 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098237 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec218f126bee86fc13d9346552a78686 SystemUUID:ec218f12-6bee-86fc-13d9-346552a78686 BootID:0913860a-62d4-4848-a9f6-845ac5216bf8 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:72:17:db:68:8f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:72:17:db:68:8f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:47:0a:6a:a9:42 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 20:17:06.116640 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.116638 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 20:17:06.116758 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.116721 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 20:17:06.120866 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.120842 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 20:17:06.121004 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.120868 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-231.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 20:17:06.121655 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.121645 2574 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 20:17:06.121695 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.121658 2574 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 20:17:06.121695 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.121665 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 20:17:06.122425 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.122415 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 20:17:06.123234 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.123225 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 20:17:06.126222 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.126210 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 01 20:17:06.126344 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.126321 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 20:17:06.126381 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.126363 2574 kubelet.go:486] "Attempting to sync node with API server" Jul 01 20:17:06.126381 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.126380 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 20:17:06.126435 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.126395 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 20:17:06.126435 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.126408 2574 kubelet.go:398] "Adding apiserver pod source" Jul 01 20:17:06.126435 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.126422 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 20:17:06.126761 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.126749 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 20:17:06.126814 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.126767 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 20:17:06.130944 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.130930 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 20:17:06.132174 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.132162 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 20:17:06.132213 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.132191 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 20:17:06.132380 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.132368 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 20:17:06.132415 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.132391 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 20:17:06.132415 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.132401 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 20:17:06.132415 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.132410 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 20:17:06.132493 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.132421 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 20:17:06.132493 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.132429 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 20:17:06.132884 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.132874 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 20:17:06.132918 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.132884 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 20:17:06.132918 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.132892 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 20:17:06.132918 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.132897 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 20:17:06.132918 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.132911 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 20:17:06.132918 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.132919 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 20:17:06.133877 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.133867 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 20:17:06.133916 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.133879 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 20:17:06.137177 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.137153 2574 server.go:1268] "Started kubelet" Jul 01 20:17:06.137246 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.137222 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 20:17:06.137358 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.137284 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 20:17:06.137410 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.137378 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 20:17:06.137589 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.137558 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-231.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 20:17:06.137672 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:06.137609 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-231.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 20:17:06.137672 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:06.137650 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 20:17:06.138643 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.138626 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 20:17:06.139100 ip-10-0-141-231 systemd[1]: Started Kubernetes Kubelet. Jul 01 20:17:06.141470 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.141449 2574 server.go:310] "Adding debug handlers to kubelet server" Jul 01 20:17:06.145292 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:06.145272 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 20:17:06.145622 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.145604 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hbzdc" Jul 01 20:17:06.146591 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.146576 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 20:17:06.146663 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.146600 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 20:17:06.146663 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:06.146653 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-231.ec2.internal\" not found" Jul 01 20:17:06.147093 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.147070 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 20:17:06.147171 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.147098 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 20:17:06.147171 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.147114 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 20:17:06.147257 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.147240 2574 reconstruct.go:97] "Volume reconstruction finished" Jul 01 20:17:06.147257 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.147251 2574 reconciler.go:29] "Reconciler: start to sync state" Jul 01 20:17:06.147363 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.147348 2574 factory.go:55] Registering systemd factory Jul 01 20:17:06.147406 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.147366 2574 factory.go:223] Registration of the systemd container factory successfully Jul 01 20:17:06.147592 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.147577 2574 factory.go:153] Registering CRI-O factory Jul 01 20:17:06.147592 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.147593 2574 factory.go:223] Registration of the crio container factory successfully Jul 01 20:17:06.147705 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.147648 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 20:17:06.147705 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.147672 2574 factory.go:103] Registering Raw factory Jul 01 20:17:06.147705 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.147688 2574 manager.go:1196] Started watching for new ooms in manager Jul 01 20:17:06.148071 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.148060 2574 manager.go:349] Starting recovery of all containers Jul 01 20:17:06.148302 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:06.147409 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-231.ec2.internal.18be43c763cb6d16 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-231.ec2.internal,UID:ip-10-0-141-231.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-231.ec2.internal,},FirstTimestamp:2026-07-01 20:17:06.137124118 +0000 UTC m=+0.357617058,LastTimestamp:2026-07-01 20:17:06.137124118 +0000 UTC m=+0.357617058,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-231.ec2.internal,}" Jul 01 20:17:06.152013 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:06.151986 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-231.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 20:17:06.152095 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:06.152023 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 20:17:06.153520 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.153497 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hbzdc" Jul 01 20:17:06.155436 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.155400 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 20:17:06.158182 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.158107 2574 manager.go:354] Recovery completed Jul 01 20:17:06.162473 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.162460 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 20:17:06.164260 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.164233 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-231.ec2.internal" event="NodeHasSufficientMemory" Jul 01 20:17:06.164350 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.164291 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-231.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 20:17:06.164350 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.164308 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-231.ec2.internal" event="NodeHasSufficientPID" Jul 01 20:17:06.164847 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.164833 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 20:17:06.165170 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.165158 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 20:17:06.165170 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.165170 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 20:17:06.165240 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.165184 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 01 20:17:06.165613 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.165547 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-231.ec2.internal" event="NodeHasSufficientMemory" Jul 01 20:17:06.165613 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.165572 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-231.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 20:17:06.165613 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.165582 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-231.ec2.internal" event="NodeHasSufficientPID" Jul 01 20:17:06.166312 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.166300 2574 policy_none.go:49] "None policy: Start" Jul 01 20:17:06.166361 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.166316 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 20:17:06.166361 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.166341 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 20:17:06.167281 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.167271 2574 policy_none.go:47] "Start" Jul 01 20:17:06.168494 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:06.168416 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-231.ec2.internal.18be43c76569578e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-231.ec2.internal,UID:ip-10-0-141-231.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-231.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-231.ec2.internal,},FirstTimestamp:2026-07-01 20:17:06.16425051 +0000 UTC m=+0.384743456,LastTimestamp:2026-07-01 20:17:06.16425051 +0000 UTC m=+0.384743456,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-231.ec2.internal,}" Jul 01 20:17:06.202895 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.202880 2574 manager.go:337] "Starting Device Plugin manager" Jul 01 20:17:06.216841 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:06.202916 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 20:17:06.216841 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.202926 2574 server.go:87] "Starting device plugin registration server" Jul 01 20:17:06.216841 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.203166 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 20:17:06.216841 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.203181 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 20:17:06.216841 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.203261 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 20:17:06.216841 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.203340 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 20:17:06.216841 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.203348 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 20:17:06.216841 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:06.203817 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 20:17:06.216841 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:06.203862 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-231.ec2.internal\" not found" Jul 01 20:17:06.216841 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.212888 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 20:17:06.216841 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.212920 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 20:17:06.216841 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.212937 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 20:17:06.216841 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:06.212963 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 20:17:06.216841 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.215863 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 20:17:06.303847 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.303818 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 20:17:06.304716 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.304693 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-231.ec2.internal" event="NodeHasSufficientMemory" Jul 01 20:17:06.304810 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.304729 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-231.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 20:17:06.304810 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.304739 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-231.ec2.internal" event="NodeHasSufficientPID" Jul 01 20:17:06.304810 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.304765 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-231.ec2.internal" Jul 01 20:17:06.313113 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.313053 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-231.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-231.ec2.internal"] Jul 01 20:17:06.313113 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.313103 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 20:17:06.313810 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.313791 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-231.ec2.internal" event="NodeHasSufficientMemory" Jul 01 20:17:06.313888 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.313816 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-231.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 20:17:06.313888 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.313827 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-231.ec2.internal" event="NodeHasSufficientPID" Jul 01 20:17:06.314269 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.314250 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-231.ec2.internal" Jul 01 20:17:06.314362 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:06.314276 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-231.ec2.internal\": node \"ip-10-0-141-231.ec2.internal\" not found" Jul 01 20:17:06.315119 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.315104 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 20:17:06.315248 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.315234 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-231.ec2.internal" Jul 01 20:17:06.315298 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.315262 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 20:17:06.315778 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.315762 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-231.ec2.internal" event="NodeHasSufficientMemory" Jul 01 20:17:06.315778 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.315772 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-231.ec2.internal" event="NodeHasSufficientMemory" Jul 01 20:17:06.315778 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.315787 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-231.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 20:17:06.315778 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.315791 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-231.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 20:17:06.315778 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.315797 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-231.ec2.internal" event="NodeHasSufficientPID" Jul 01 20:17:06.315778 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.315801 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-231.ec2.internal" event="NodeHasSufficientPID" Jul 01 20:17:06.316945 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.316929 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-231.ec2.internal" Jul 01 20:17:06.316994 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.316956 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 20:17:06.317532 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.317515 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-231.ec2.internal" event="NodeHasSufficientMemory" Jul 01 20:17:06.317628 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.317540 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-231.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 20:17:06.317628 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.317555 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-231.ec2.internal" event="NodeHasSufficientPID" Jul 01 20:17:06.332602 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:06.332582 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-231.ec2.internal\" not found" Jul 01 20:17:06.333844 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:06.333826 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-231.ec2.internal\" not found" node="ip-10-0-141-231.ec2.internal" Jul 01 20:17:06.337165 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:06.337151 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-231.ec2.internal\" not found" node="ip-10-0-141-231.ec2.internal" Jul 01 20:17:06.348414 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.348397 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af245736aa16ec85cdbac3ea0a090d37-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-231.ec2.internal\" (UID: \"af245736aa16ec85cdbac3ea0a090d37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-231.ec2.internal" Jul 01 20:17:06.348499 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.348421 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af245736aa16ec85cdbac3ea0a090d37-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-231.ec2.internal\" (UID: \"af245736aa16ec85cdbac3ea0a090d37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-231.ec2.internal" Jul 01 20:17:06.348499 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.348438 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5548dc72c03db29f83e1333607e1ad90-config\") pod \"kube-apiserver-proxy-ip-10-0-141-231.ec2.internal\" (UID: \"5548dc72c03db29f83e1333607e1ad90\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-231.ec2.internal" Jul 01 20:17:06.433501 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:06.433473 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-231.ec2.internal\" not found" Jul 01 20:17:06.449479 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.449457 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af245736aa16ec85cdbac3ea0a090d37-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-231.ec2.internal\" (UID: \"af245736aa16ec85cdbac3ea0a090d37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-231.ec2.internal" Jul 01 20:17:06.449561 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.449484 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af245736aa16ec85cdbac3ea0a090d37-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-231.ec2.internal\" (UID: \"af245736aa16ec85cdbac3ea0a090d37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-231.ec2.internal" Jul 01 20:17:06.449561 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.449501 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5548dc72c03db29f83e1333607e1ad90-config\") pod \"kube-apiserver-proxy-ip-10-0-141-231.ec2.internal\" (UID: \"5548dc72c03db29f83e1333607e1ad90\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-231.ec2.internal" Jul 01 20:17:06.449561 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.449541 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5548dc72c03db29f83e1333607e1ad90-config\") pod \"kube-apiserver-proxy-ip-10-0-141-231.ec2.internal\" (UID: \"5548dc72c03db29f83e1333607e1ad90\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-231.ec2.internal" Jul 01 20:17:06.449668 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.449557 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af245736aa16ec85cdbac3ea0a090d37-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-231.ec2.internal\" (UID: \"af245736aa16ec85cdbac3ea0a090d37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-231.ec2.internal" Jul 01 20:17:06.449668 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.449563 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af245736aa16ec85cdbac3ea0a090d37-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-231.ec2.internal\" (UID: \"af245736aa16ec85cdbac3ea0a090d37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-231.ec2.internal" Jul 01 20:17:06.534062 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:06.534026 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-231.ec2.internal\" not found" Jul 01 20:17:06.634779 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:06.634759 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-231.ec2.internal\" not found" Jul 01 20:17:06.637032 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.637010 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-231.ec2.internal" Jul 01 20:17:06.640445 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:06.640304 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-231.ec2.internal" Jul 01 20:17:06.738332 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:06.738295 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-231.ec2.internal\" not found" Jul 01 20:17:06.844968 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:06.844930 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-231.ec2.internal\" not found" Jul 01 20:17:06.945943 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:06.945862 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-231.ec2.internal\" not found" Jul 01 20:17:07.046638 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:07.046608 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-231.ec2.internal\" not found" Jul 01 20:17:07.053403 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.053381 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 20:17:07.087019 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.086983 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 20:17:07.087455 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.087150 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 20:17:07.087455 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.087154 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 20:17:07.127299 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.127274 2574 apiserver.go:52] "Watching apiserver" Jul 01 20:17:07.137214 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.137195 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 20:17:07.143558 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.143537 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 20:17:07.143893 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.143869 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-n8j6z","kube-system/konnectivity-agent-xjj2k","openshift-cluster-node-tuning-operator/tuned-564bh","openshift-dns/node-resolver-dltf8","openshift-multus/multus-2bqpm","openshift-multus/network-metrics-daemon-krqwd","openshift-network-diagnostics/network-check-target-tw94d","openshift-network-operator/iptables-alerter-5t82s","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wl24","openshift-image-registry/node-ca-mdknz","openshift-multus/multus-additional-cni-plugins-dw6kb","openshift-ovn-kubernetes/ovnkube-node-4mfbr"] Jul 01 20:17:07.145385 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.145370 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:07.145461 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:07.145443 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:17:07.146582 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.146545 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xjj2k" Jul 01 20:17:07.146816 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.146785 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-231.ec2.internal" Jul 01 20:17:07.146908 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.146821 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 20:17:07.147731 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.147712 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.148380 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.148363 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n2zsl\"" Jul 01 20:17:07.148612 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.148597 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 20:17:07.149099 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.148950 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 20:17:07.149208 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.149161 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dltf8" Jul 01 20:17:07.151045 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.151022 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.151734 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.151574 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kmd5d\"" Jul 01 20:17:07.151734 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.151624 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 20:17:07.151887 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.151869 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6dl8q\"" Jul 01 20:17:07.151960 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.151941 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 20:17:07.152018 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.151964 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:07.152018 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.151966 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 20:17:07.152111 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:07.152029 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:17:07.152158 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.152112 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 20:17:07.153221 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.153205 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zvp9w\"" Jul 01 20:17:07.153306 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.153272 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:07.153375 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:07.153351 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:17:07.154482 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.154459 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-etc-sysconfig\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.154591 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.154486 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5dd4d0cb-8571-4dd6-867a-49de95334f70-konnectivity-ca\") pod \"konnectivity-agent-xjj2k\" (UID: \"5dd4d0cb-8571-4dd6-867a-49de95334f70\") " pod="kube-system/konnectivity-agent-xjj2k" Jul 01 20:17:07.154591 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.154507 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-etc-modprobe-d\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.154591 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.154529 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-etc-kubernetes\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.154591 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.154536 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5t82s" Jul 01 20:17:07.154591 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.154564 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-etc-tuned\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.154591 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.154591 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c64a3366-7257-45a2-b9e8-1db08d59c81a-kubelet-config\") pod \"global-pull-secret-syncer-n8j6z\" (UID: \"c64a3366-7257-45a2-b9e8-1db08d59c81a\") " pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:07.154919 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.154608 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c64a3366-7257-45a2-b9e8-1db08d59c81a-dbus\") pod \"global-pull-secret-syncer-n8j6z\" (UID: \"c64a3366-7257-45a2-b9e8-1db08d59c81a\") " pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:07.154919 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.154630 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c64a3366-7257-45a2-b9e8-1db08d59c81a-original-pull-secret\") pod \"global-pull-secret-syncer-n8j6z\" (UID: \"c64a3366-7257-45a2-b9e8-1db08d59c81a\") " pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:07.154919 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.154654 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-etc-sysctl-d\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.154919 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.154676 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-etc-sysctl-conf\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.154919 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.154701 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-run\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.154919 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.154723 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-host\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.154919 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.154748 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j672h\" (UniqueName: \"kubernetes.io/projected/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-kube-api-access-j672h\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.154919 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.154772 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5dd4d0cb-8571-4dd6-867a-49de95334f70-agent-certs\") pod \"konnectivity-agent-xjj2k\" (UID: \"5dd4d0cb-8571-4dd6-867a-49de95334f70\") " pod="kube-system/konnectivity-agent-xjj2k" Jul 01 20:17:07.154919 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.154803 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-sys\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.154919 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.154831 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-lib-modules\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.154919 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.154863 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-var-lib-kubelet\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.154919 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.154888 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-tmp\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.154919 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.154912 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-etc-systemd\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.155629 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.155057 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 20:17:07.155629 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.155167 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 20:17:07.155980 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.155961 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wl24" Jul 01 20:17:07.156528 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.156509 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 20:17:07.156733 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.156718 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 20:17:07.157052 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.157037 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 20:17:07.157118 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.157045 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 20:12:06 +0000 UTC" deadline="2028-02-13 04:14:51.896937879 +0000 UTC" Jul 01 20:17:07.157118 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.157088 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14191h57m44.739853373s" Jul 01 20:17:07.157312 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.157291 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mdknz" Jul 01 20:17:07.157708 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.157686 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-29mqj\"" Jul 01 20:17:07.157926 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.157793 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 20:17:07.158029 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.157952 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4cbdc\"" Jul 01 20:17:07.158577 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.158558 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 20:17:07.158682 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.158617 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 20:17:07.158751 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.158694 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 20:17:07.158810 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.158801 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 20:17:07.159035 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.158971 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dw6kb" Jul 01 20:17:07.160648 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.160630 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.161069 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.161050 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 20:17:07.161267 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.161244 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 20:17:07.161485 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.161469 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cqr67\"" Jul 01 20:17:07.162303 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.162289 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 20:17:07.162423 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.162383 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 20:17:07.162726 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.162710 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 20:17:07.162807 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.162779 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-231.ec2.internal" Jul 01 20:17:07.162807 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.162713 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-231.ec2.internal"] Jul 01 20:17:07.163049 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.163030 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d9htx\"" Jul 01 20:17:07.163842 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.163650 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 20:17:07.163842 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.163682 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 20:17:07.163979 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.163898 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 20:17:07.164367 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.164060 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 20:17:07.164367 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.164095 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 20:17:07.164367 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.164229 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5wd7k\"" Jul 01 20:17:07.164367 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.164292 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 20:17:07.164596 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.164418 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 20:17:07.168909 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.168881 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 20:17:07.179192 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.179172 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-231.ec2.internal"] Jul 01 20:17:07.179749 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.179735 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 20:17:07.192518 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.192487 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9x499" Jul 01 20:17:07.201924 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.201881 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9x499" Jul 01 20:17:07.224253 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.224230 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 20:17:07.230561 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:07.230529 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5548dc72c03db29f83e1333607e1ad90.slice/crio-dad8a1abff9c4ce38d666ea7a7ba44b1de3920ede4be4dd3c2c2b7e4b3b2caf1 WatchSource:0}: Error finding container dad8a1abff9c4ce38d666ea7a7ba44b1de3920ede4be4dd3c2c2b7e4b3b2caf1: Status 404 returned error can't find the container with id dad8a1abff9c4ce38d666ea7a7ba44b1de3920ede4be4dd3c2c2b7e4b3b2caf1 Jul 01 20:17:07.230812 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:07.230787 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf245736aa16ec85cdbac3ea0a090d37.slice/crio-cdabff54b3c191ccc5405d2ae3c2cfeb8b30588ff5b54fec8c0b35baa1199cc1 WatchSource:0}: Error finding container cdabff54b3c191ccc5405d2ae3c2cfeb8b30588ff5b54fec8c0b35baa1199cc1: Status 404 returned error can't find the container with id cdabff54b3c191ccc5405d2ae3c2cfeb8b30588ff5b54fec8c0b35baa1199cc1 Jul 01 20:17:07.235625 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.235605 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 20:17:07.248162 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.248144 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 20:17:07.255118 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255091 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c64a3366-7257-45a2-b9e8-1db08d59c81a-original-pull-secret\") pod \"global-pull-secret-syncer-n8j6z\" (UID: \"c64a3366-7257-45a2-b9e8-1db08d59c81a\") " pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:07.255191 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255133 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-run\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.255191 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255166 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j672h\" (UniqueName: \"kubernetes.io/projected/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-kube-api-access-j672h\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.255304 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255198 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-etc-openvswitch\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.255304 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:07.255247 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:07.255304 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255262 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-run\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.255490 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:07.255313 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c64a3366-7257-45a2-b9e8-1db08d59c81a-original-pull-secret podName:c64a3366-7257-45a2-b9e8-1db08d59c81a nodeName:}" failed. No retries permitted until 2026-07-01 20:17:07.755292725 +0000 UTC m=+1.975785669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c64a3366-7257-45a2-b9e8-1db08d59c81a-original-pull-secret") pod "global-pull-secret-syncer-n8j6z" (UID: "c64a3366-7257-45a2-b9e8-1db08d59c81a") : object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:07.255490 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255359 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-node-log\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.255490 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255382 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-sys\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.255490 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255402 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-var-lib-kubelet\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.255490 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255431 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e5e6e70-82d3-4cd0-b589-68fb150c80cc-cni-binary-copy\") pod \"multus-additional-cni-plugins-dw6kb\" (UID: \"7e5e6e70-82d3-4cd0-b589-68fb150c80cc\") " pod="openshift-multus/multus-additional-cni-plugins-dw6kb" Jul 01 20:17:07.255490 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255453 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-sys\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.255490 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255470 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7e5e6e70-82d3-4cd0-b589-68fb150c80cc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dw6kb\" (UID: \"7e5e6e70-82d3-4cd0-b589-68fb150c80cc\") " pod="openshift-multus/multus-additional-cni-plugins-dw6kb" Jul 01 20:17:07.255490 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255473 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-var-lib-kubelet\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.255873 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255496 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7e5e6e70-82d3-4cd0-b589-68fb150c80cc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dw6kb\" (UID: \"7e5e6e70-82d3-4cd0-b589-68fb150c80cc\") " pod="openshift-multus/multus-additional-cni-plugins-dw6kb" Jul 01 20:17:07.255873 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255525 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/43152b18-e982-4ed0-a0b1-bbb43942c9b8-hosts-file\") pod \"node-resolver-dltf8\" (UID: \"43152b18-e982-4ed0-a0b1-bbb43942c9b8\") " pod="openshift-dns/node-resolver-dltf8" Jul 01 20:17:07.255873 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255551 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-host-kubelet\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.255873 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255584 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-run-openvswitch\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.255873 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255608 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-multus-conf-dir\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.255873 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255627 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-etc-kubernetes\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.255873 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255651 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt5qj\" (UniqueName: \"kubernetes.io/projected/f7ab33d4-814c-4979-be11-a1864e6b884b-kube-api-access-zt5qj\") pod \"aws-ebs-csi-driver-node-5wl24\" (UID: \"f7ab33d4-814c-4979-be11-a1864e6b884b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wl24" Jul 01 20:17:07.255873 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255678 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7ece6589-3e50-4328-aa47-3a030462201a-ovnkube-config\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.255873 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255695 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjcnm\" (UniqueName: \"kubernetes.io/projected/722add9e-cb45-46a9-86a3-28786a7afc60-kube-api-access-bjcnm\") pod \"network-check-target-tw94d\" (UID: \"722add9e-cb45-46a9-86a3-28786a7afc60\") " pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:07.255873 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255712 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-etc-modprobe-d\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.255873 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255727 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-etc-kubernetes\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.255873 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255767 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdmzp\" (UniqueName: \"kubernetes.io/projected/43152b18-e982-4ed0-a0b1-bbb43942c9b8-kube-api-access-mdmzp\") pod \"node-resolver-dltf8\" (UID: \"43152b18-e982-4ed0-a0b1-bbb43942c9b8\") " pod="openshift-dns/node-resolver-dltf8" Jul 01 20:17:07.255873 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255797 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-etc-kubernetes\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.255873 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255802 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-systemd-units\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.255873 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255807 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-etc-modprobe-d\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.255873 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255833 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-etc-sysctl-conf\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.256726 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255859 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-host-run-multus-certs\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.256726 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255883 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f7ab33d4-814c-4979-be11-a1864e6b884b-device-dir\") pod \"aws-ebs-csi-driver-node-5wl24\" (UID: \"f7ab33d4-814c-4979-be11-a1864e6b884b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wl24" Jul 01 20:17:07.256726 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255909 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-log-socket\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.256726 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255944 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-tmp\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.256726 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255979 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-cnibin\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.256726 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.255986 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-etc-sysctl-conf\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.256726 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256015 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-host-cni-bin\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.256726 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256036 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-os-release\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.256726 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256060 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-host-var-lib-cni-bin\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.256726 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256093 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-host-run-ovn-kubernetes\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.256726 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256124 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0077ab1f-92a9-4220-a3bd-cb3af8897040-metrics-certs\") pod \"network-metrics-daemon-krqwd\" (UID: \"0077ab1f-92a9-4220-a3bd-cb3af8897040\") " pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:07.256726 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256154 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpmhf\" (UniqueName: \"kubernetes.io/projected/d64afbbe-e3f2-480a-a21e-3da26be3234e-kube-api-access-wpmhf\") pod \"iptables-alerter-5t82s\" (UID: \"d64afbbe-e3f2-480a-a21e-3da26be3234e\") " pod="openshift-network-operator/iptables-alerter-5t82s" Jul 01 20:17:07.256726 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256170 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk6dr\" (UniqueName: \"kubernetes.io/projected/3dcbabb0-a6a2-4add-a392-561e8cedc9d2-kube-api-access-gk6dr\") pod \"node-ca-mdknz\" (UID: \"3dcbabb0-a6a2-4add-a392-561e8cedc9d2\") " pod="openshift-image-registry/node-ca-mdknz" Jul 01 20:17:07.256726 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256192 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e5e6e70-82d3-4cd0-b589-68fb150c80cc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dw6kb\" (UID: \"7e5e6e70-82d3-4cd0-b589-68fb150c80cc\") " pod="openshift-multus/multus-additional-cni-plugins-dw6kb" Jul 01 20:17:07.256726 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256216 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43152b18-e982-4ed0-a0b1-bbb43942c9b8-tmp-dir\") pod \"node-resolver-dltf8\" (UID: \"43152b18-e982-4ed0-a0b1-bbb43942c9b8\") " pod="openshift-dns/node-resolver-dltf8" Jul 01 20:17:07.256726 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256237 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-cni-binary-copy\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.256726 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256253 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-run-systemd\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.257466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256268 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-host-cni-netd\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.257466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256284 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c64a3366-7257-45a2-b9e8-1db08d59c81a-dbus\") pod \"global-pull-secret-syncer-n8j6z\" (UID: \"c64a3366-7257-45a2-b9e8-1db08d59c81a\") " pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:07.257466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256281 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 20:17:07.257466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256314 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-multus-socket-dir-parent\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.257466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256360 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-host-var-lib-cni-multus\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.257466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256383 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f7ab33d4-814c-4979-be11-a1864e6b884b-registration-dir\") pod \"aws-ebs-csi-driver-node-5wl24\" (UID: \"f7ab33d4-814c-4979-be11-a1864e6b884b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wl24" Jul 01 20:17:07.257466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256403 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-host-slash\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.257466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256425 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.257466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256468 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7ece6589-3e50-4328-aa47-3a030462201a-env-overrides\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.257466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256478 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c64a3366-7257-45a2-b9e8-1db08d59c81a-dbus\") pod \"global-pull-secret-syncer-n8j6z\" (UID: \"c64a3366-7257-45a2-b9e8-1db08d59c81a\") " pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:07.257466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256510 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d64afbbe-e3f2-480a-a21e-3da26be3234e-iptables-alerter-script\") pod \"iptables-alerter-5t82s\" (UID: \"d64afbbe-e3f2-480a-a21e-3da26be3234e\") " pod="openshift-network-operator/iptables-alerter-5t82s" Jul 01 20:17:07.257466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256532 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-lib-modules\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.257466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256548 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-system-cni-dir\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.257466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256592 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-host-run-k8s-cni-cncf-io\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.257466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256615 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3dcbabb0-a6a2-4add-a392-561e8cedc9d2-host\") pod \"node-ca-mdknz\" (UID: \"3dcbabb0-a6a2-4add-a392-561e8cedc9d2\") " pod="openshift-image-registry/node-ca-mdknz" Jul 01 20:17:07.257466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256639 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3dcbabb0-a6a2-4add-a392-561e8cedc9d2-serviceca\") pod \"node-ca-mdknz\" (UID: \"3dcbabb0-a6a2-4add-a392-561e8cedc9d2\") " pod="openshift-image-registry/node-ca-mdknz" Jul 01 20:17:07.257466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256641 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-lib-modules\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.258304 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256664 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-etc-systemd\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.258304 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256687 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e5e6e70-82d3-4cd0-b589-68fb150c80cc-os-release\") pod \"multus-additional-cni-plugins-dw6kb\" (UID: \"7e5e6e70-82d3-4cd0-b589-68fb150c80cc\") " pod="openshift-multus/multus-additional-cni-plugins-dw6kb" Jul 01 20:17:07.258304 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256702 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f7ab33d4-814c-4979-be11-a1864e6b884b-sys-fs\") pod \"aws-ebs-csi-driver-node-5wl24\" (UID: \"f7ab33d4-814c-4979-be11-a1864e6b884b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wl24" Jul 01 20:17:07.258304 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256717 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7ece6589-3e50-4328-aa47-3a030462201a-ovnkube-script-lib\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.258304 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256729 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-etc-systemd\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.258304 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256739 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clgw5\" (UniqueName: \"kubernetes.io/projected/0077ab1f-92a9-4220-a3bd-cb3af8897040-kube-api-access-clgw5\") pod \"network-metrics-daemon-krqwd\" (UID: \"0077ab1f-92a9-4220-a3bd-cb3af8897040\") " pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:07.258304 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256763 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5dd4d0cb-8571-4dd6-867a-49de95334f70-konnectivity-ca\") pod \"konnectivity-agent-xjj2k\" (UID: \"5dd4d0cb-8571-4dd6-867a-49de95334f70\") " pod="kube-system/konnectivity-agent-xjj2k" Jul 01 20:17:07.258304 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256790 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-multus-cni-dir\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.258304 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256809 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-host-var-lib-kubelet\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.258304 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256914 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7ece6589-3e50-4328-aa47-3a030462201a-ovn-node-metrics-cert\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.258304 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256946 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c64a3366-7257-45a2-b9e8-1db08d59c81a-kubelet-config\") pod \"global-pull-secret-syncer-n8j6z\" (UID: \"c64a3366-7257-45a2-b9e8-1db08d59c81a\") " pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:07.258304 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256968 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-etc-sysctl-d\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.258304 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.256988 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-host\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.258304 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.257014 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f7ab33d4-814c-4979-be11-a1864e6b884b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5wl24\" (UID: \"f7ab33d4-814c-4979-be11-a1864e6b884b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wl24" Jul 01 20:17:07.258304 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.257028 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c64a3366-7257-45a2-b9e8-1db08d59c81a-kubelet-config\") pod \"global-pull-secret-syncer-n8j6z\" (UID: \"c64a3366-7257-45a2-b9e8-1db08d59c81a\") " pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:07.258304 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.257036 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-host-run-netns\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.258304 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.257070 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5dd4d0cb-8571-4dd6-867a-49de95334f70-agent-certs\") pod \"konnectivity-agent-xjj2k\" (UID: \"5dd4d0cb-8571-4dd6-867a-49de95334f70\") " pod="kube-system/konnectivity-agent-xjj2k" Jul 01 20:17:07.259247 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.257082 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-etc-sysctl-d\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.259247 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.257116 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r82dh\" (UniqueName: \"kubernetes.io/projected/7e5e6e70-82d3-4cd0-b589-68fb150c80cc-kube-api-access-r82dh\") pod \"multus-additional-cni-plugins-dw6kb\" (UID: \"7e5e6e70-82d3-4cd0-b589-68fb150c80cc\") " pod="openshift-multus/multus-additional-cni-plugins-dw6kb" Jul 01 20:17:07.259247 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.257120 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-host\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.259247 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.257224 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-host-run-netns\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.259247 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.257252 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nvv4\" (UniqueName: \"kubernetes.io/projected/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-kube-api-access-2nvv4\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.259247 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.257277 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-run-ovn\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.259247 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.257305 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-772z8\" (UniqueName: \"kubernetes.io/projected/7ece6589-3e50-4328-aa47-3a030462201a-kube-api-access-772z8\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.259247 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.257326 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5dd4d0cb-8571-4dd6-867a-49de95334f70-konnectivity-ca\") pod \"konnectivity-agent-xjj2k\" (UID: \"5dd4d0cb-8571-4dd6-867a-49de95334f70\") " pod="kube-system/konnectivity-agent-xjj2k" Jul 01 20:17:07.259247 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.257349 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-etc-sysconfig\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.259247 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.257378 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e5e6e70-82d3-4cd0-b589-68fb150c80cc-system-cni-dir\") pod \"multus-additional-cni-plugins-dw6kb\" (UID: \"7e5e6e70-82d3-4cd0-b589-68fb150c80cc\") " pod="openshift-multus/multus-additional-cni-plugins-dw6kb" Jul 01 20:17:07.259247 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.257404 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e5e6e70-82d3-4cd0-b589-68fb150c80cc-cnibin\") pod \"multus-additional-cni-plugins-dw6kb\" (UID: \"7e5e6e70-82d3-4cd0-b589-68fb150c80cc\") " pod="openshift-multus/multus-additional-cni-plugins-dw6kb" Jul 01 20:17:07.259247 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.257408 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-etc-sysconfig\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.259247 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.257435 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-hostroot\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.259247 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.257456 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-multus-daemon-config\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.259247 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.257479 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f7ab33d4-814c-4979-be11-a1864e6b884b-etc-selinux\") pod \"aws-ebs-csi-driver-node-5wl24\" (UID: \"f7ab33d4-814c-4979-be11-a1864e6b884b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wl24" Jul 01 20:17:07.259247 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.257504 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-etc-tuned\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.259247 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.257523 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f7ab33d4-814c-4979-be11-a1864e6b884b-socket-dir\") pod \"aws-ebs-csi-driver-node-5wl24\" (UID: \"f7ab33d4-814c-4979-be11-a1864e6b884b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wl24" Jul 01 20:17:07.260075 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.257541 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-var-lib-openvswitch\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.260075 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.257562 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d64afbbe-e3f2-480a-a21e-3da26be3234e-host-slash\") pod \"iptables-alerter-5t82s\" (UID: \"d64afbbe-e3f2-480a-a21e-3da26be3234e\") " pod="openshift-network-operator/iptables-alerter-5t82s" Jul 01 20:17:07.260151 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.260093 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-tmp\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.260186 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.260158 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-etc-tuned\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.260480 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.260464 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5dd4d0cb-8571-4dd6-867a-49de95334f70-agent-certs\") pod \"konnectivity-agent-xjj2k\" (UID: \"5dd4d0cb-8571-4dd6-867a-49de95334f70\") " pod="kube-system/konnectivity-agent-xjj2k" Jul 01 20:17:07.264516 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.264493 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j672h\" (UniqueName: \"kubernetes.io/projected/936b7dc6-0dd8-46e5-962b-a4ef4b61682e-kube-api-access-j672h\") pod \"tuned-564bh\" (UID: \"936b7dc6-0dd8-46e5-962b-a4ef4b61682e\") " pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.357859 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.357828 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-host-var-lib-kubelet\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.357859 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.357862 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7ece6589-3e50-4328-aa47-3a030462201a-ovn-node-metrics-cert\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.358073 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.357879 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f7ab33d4-814c-4979-be11-a1864e6b884b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5wl24\" (UID: \"f7ab33d4-814c-4979-be11-a1864e6b884b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wl24" Jul 01 20:17:07.358073 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.357894 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-host-run-netns\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.358073 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.357911 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r82dh\" (UniqueName: \"kubernetes.io/projected/7e5e6e70-82d3-4cd0-b589-68fb150c80cc-kube-api-access-r82dh\") pod \"multus-additional-cni-plugins-dw6kb\" (UID: \"7e5e6e70-82d3-4cd0-b589-68fb150c80cc\") " pod="openshift-multus/multus-additional-cni-plugins-dw6kb" Jul 01 20:17:07.358073 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.357956 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-host-run-netns\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.358073 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.357974 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nvv4\" (UniqueName: \"kubernetes.io/projected/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-kube-api-access-2nvv4\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.358073 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.357971 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-host-var-lib-kubelet\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.358073 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.357992 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-run-ovn\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.358073 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.357991 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f7ab33d4-814c-4979-be11-a1864e6b884b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5wl24\" (UID: \"f7ab33d4-814c-4979-be11-a1864e6b884b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wl24" Jul 01 20:17:07.358073 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358018 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-772z8\" (UniqueName: \"kubernetes.io/projected/7ece6589-3e50-4328-aa47-3a030462201a-kube-api-access-772z8\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.358073 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358024 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-host-run-netns\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.358073 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358053 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-run-ovn\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.358597 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358095 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e5e6e70-82d3-4cd0-b589-68fb150c80cc-system-cni-dir\") pod \"multus-additional-cni-plugins-dw6kb\" (UID: \"7e5e6e70-82d3-4cd0-b589-68fb150c80cc\") " pod="openshift-multus/multus-additional-cni-plugins-dw6kb" Jul 01 20:17:07.358597 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358125 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e5e6e70-82d3-4cd0-b589-68fb150c80cc-cnibin\") pod \"multus-additional-cni-plugins-dw6kb\" (UID: \"7e5e6e70-82d3-4cd0-b589-68fb150c80cc\") " pod="openshift-multus/multus-additional-cni-plugins-dw6kb" Jul 01 20:17:07.358597 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358153 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-hostroot\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.358597 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358178 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-multus-daemon-config\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.358597 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358182 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-host-run-netns\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.358597 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358203 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f7ab33d4-814c-4979-be11-a1864e6b884b-etc-selinux\") pod \"aws-ebs-csi-driver-node-5wl24\" (UID: \"f7ab33d4-814c-4979-be11-a1864e6b884b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wl24" Jul 01 20:17:07.358597 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358186 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e5e6e70-82d3-4cd0-b589-68fb150c80cc-system-cni-dir\") pod \"multus-additional-cni-plugins-dw6kb\" (UID: \"7e5e6e70-82d3-4cd0-b589-68fb150c80cc\") " pod="openshift-multus/multus-additional-cni-plugins-dw6kb" Jul 01 20:17:07.358597 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358230 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f7ab33d4-814c-4979-be11-a1864e6b884b-socket-dir\") pod \"aws-ebs-csi-driver-node-5wl24\" (UID: \"f7ab33d4-814c-4979-be11-a1864e6b884b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wl24" Jul 01 20:17:07.358597 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358254 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-var-lib-openvswitch\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.358597 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358189 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e5e6e70-82d3-4cd0-b589-68fb150c80cc-cnibin\") pod \"multus-additional-cni-plugins-dw6kb\" (UID: \"7e5e6e70-82d3-4cd0-b589-68fb150c80cc\") " pod="openshift-multus/multus-additional-cni-plugins-dw6kb" Jul 01 20:17:07.358597 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358264 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-hostroot\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.358597 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358281 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d64afbbe-e3f2-480a-a21e-3da26be3234e-host-slash\") pod \"iptables-alerter-5t82s\" (UID: \"d64afbbe-e3f2-480a-a21e-3da26be3234e\") " pod="openshift-network-operator/iptables-alerter-5t82s" Jul 01 20:17:07.358597 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358354 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f7ab33d4-814c-4979-be11-a1864e6b884b-etc-selinux\") pod \"aws-ebs-csi-driver-node-5wl24\" (UID: \"f7ab33d4-814c-4979-be11-a1864e6b884b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wl24" Jul 01 20:17:07.358597 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358372 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d64afbbe-e3f2-480a-a21e-3da26be3234e-host-slash\") pod \"iptables-alerter-5t82s\" (UID: \"d64afbbe-e3f2-480a-a21e-3da26be3234e\") " pod="openshift-network-operator/iptables-alerter-5t82s" Jul 01 20:17:07.358597 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358382 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-var-lib-openvswitch\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.358597 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358409 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-etc-openvswitch\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.358597 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358433 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f7ab33d4-814c-4979-be11-a1864e6b884b-socket-dir\") pod \"aws-ebs-csi-driver-node-5wl24\" (UID: \"f7ab33d4-814c-4979-be11-a1864e6b884b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wl24" Jul 01 20:17:07.359480 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358438 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-node-log\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.359480 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358460 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-etc-openvswitch\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.359480 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358468 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-node-log\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.359480 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358487 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e5e6e70-82d3-4cd0-b589-68fb150c80cc-cni-binary-copy\") pod \"multus-additional-cni-plugins-dw6kb\" (UID: \"7e5e6e70-82d3-4cd0-b589-68fb150c80cc\") " pod="openshift-multus/multus-additional-cni-plugins-dw6kb" Jul 01 20:17:07.359480 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358516 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7e5e6e70-82d3-4cd0-b589-68fb150c80cc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dw6kb\" (UID: \"7e5e6e70-82d3-4cd0-b589-68fb150c80cc\") " pod="openshift-multus/multus-additional-cni-plugins-dw6kb" Jul 01 20:17:07.359480 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358546 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7e5e6e70-82d3-4cd0-b589-68fb150c80cc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dw6kb\" (UID: \"7e5e6e70-82d3-4cd0-b589-68fb150c80cc\") " pod="openshift-multus/multus-additional-cni-plugins-dw6kb" Jul 01 20:17:07.359480 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358590 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/43152b18-e982-4ed0-a0b1-bbb43942c9b8-hosts-file\") pod \"node-resolver-dltf8\" (UID: \"43152b18-e982-4ed0-a0b1-bbb43942c9b8\") " pod="openshift-dns/node-resolver-dltf8" Jul 01 20:17:07.359480 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358616 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-host-kubelet\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.359480 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358639 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-run-openvswitch\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.359480 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358664 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-multus-conf-dir\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.359480 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358688 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-etc-kubernetes\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.359480 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358694 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-run-openvswitch\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.359480 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358710 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt5qj\" (UniqueName: \"kubernetes.io/projected/f7ab33d4-814c-4979-be11-a1864e6b884b-kube-api-access-zt5qj\") pod \"aws-ebs-csi-driver-node-5wl24\" (UID: \"f7ab33d4-814c-4979-be11-a1864e6b884b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wl24" Jul 01 20:17:07.359480 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358734 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7ece6589-3e50-4328-aa47-3a030462201a-ovnkube-config\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.359480 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358759 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjcnm\" (UniqueName: \"kubernetes.io/projected/722add9e-cb45-46a9-86a3-28786a7afc60-kube-api-access-bjcnm\") pod \"network-check-target-tw94d\" (UID: \"722add9e-cb45-46a9-86a3-28786a7afc60\") " pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:07.359480 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358762 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-multus-conf-dir\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.359480 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358805 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-host-kubelet\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.360548 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358820 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-multus-daemon-config\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.360548 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358841 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdmzp\" (UniqueName: \"kubernetes.io/projected/43152b18-e982-4ed0-a0b1-bbb43942c9b8-kube-api-access-mdmzp\") pod \"node-resolver-dltf8\" (UID: \"43152b18-e982-4ed0-a0b1-bbb43942c9b8\") " pod="openshift-dns/node-resolver-dltf8" Jul 01 20:17:07.360548 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358870 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-systemd-units\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.360548 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358875 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-etc-kubernetes\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.360548 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358897 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-host-run-multus-certs\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.360548 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358910 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/43152b18-e982-4ed0-a0b1-bbb43942c9b8-hosts-file\") pod \"node-resolver-dltf8\" (UID: \"43152b18-e982-4ed0-a0b1-bbb43942c9b8\") " pod="openshift-dns/node-resolver-dltf8" Jul 01 20:17:07.360548 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358927 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f7ab33d4-814c-4979-be11-a1864e6b884b-device-dir\") pod \"aws-ebs-csi-driver-node-5wl24\" (UID: \"f7ab33d4-814c-4979-be11-a1864e6b884b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wl24" Jul 01 20:17:07.360548 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358946 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-systemd-units\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.360548 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358952 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-log-socket\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.360548 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.358992 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-cnibin\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.360548 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359020 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f7ab33d4-814c-4979-be11-a1864e6b884b-device-dir\") pod \"aws-ebs-csi-driver-node-5wl24\" (UID: \"f7ab33d4-814c-4979-be11-a1864e6b884b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wl24" Jul 01 20:17:07.360548 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359022 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-host-cni-bin\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.360548 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359054 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-host-cni-bin\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.360548 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359062 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-os-release\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.360548 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359089 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-host-var-lib-cni-bin\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.360548 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359097 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-log-socket\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.360548 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359117 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-host-run-ovn-kubernetes\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.360548 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359117 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e5e6e70-82d3-4cd0-b589-68fb150c80cc-cni-binary-copy\") pod \"multus-additional-cni-plugins-dw6kb\" (UID: \"7e5e6e70-82d3-4cd0-b589-68fb150c80cc\") " pod="openshift-multus/multus-additional-cni-plugins-dw6kb" Jul 01 20:17:07.361351 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359144 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-host-run-multus-certs\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.361351 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359144 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0077ab1f-92a9-4220-a3bd-cb3af8897040-metrics-certs\") pod \"network-metrics-daemon-krqwd\" (UID: \"0077ab1f-92a9-4220-a3bd-cb3af8897040\") " pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:07.361351 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359186 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpmhf\" (UniqueName: \"kubernetes.io/projected/d64afbbe-e3f2-480a-a21e-3da26be3234e-kube-api-access-wpmhf\") pod \"iptables-alerter-5t82s\" (UID: \"d64afbbe-e3f2-480a-a21e-3da26be3234e\") " pod="openshift-network-operator/iptables-alerter-5t82s" Jul 01 20:17:07.361351 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359200 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-host-run-ovn-kubernetes\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.361351 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359217 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-os-release\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.361351 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359217 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk6dr\" (UniqueName: \"kubernetes.io/projected/3dcbabb0-a6a2-4add-a392-561e8cedc9d2-kube-api-access-gk6dr\") pod \"node-ca-mdknz\" (UID: \"3dcbabb0-a6a2-4add-a392-561e8cedc9d2\") " pod="openshift-image-registry/node-ca-mdknz" Jul 01 20:17:07.361351 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359259 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e5e6e70-82d3-4cd0-b589-68fb150c80cc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dw6kb\" (UID: \"7e5e6e70-82d3-4cd0-b589-68fb150c80cc\") " pod="openshift-multus/multus-additional-cni-plugins-dw6kb" Jul 01 20:17:07.361351 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:07.359281 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:07.361351 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359285 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43152b18-e982-4ed0-a0b1-bbb43942c9b8-tmp-dir\") pod \"node-resolver-dltf8\" (UID: \"43152b18-e982-4ed0-a0b1-bbb43942c9b8\") " pod="openshift-dns/node-resolver-dltf8" Jul 01 20:17:07.361351 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359310 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-cni-binary-copy\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.361351 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359335 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-run-systemd\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.361351 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359384 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-host-cni-netd\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.361351 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359412 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-multus-socket-dir-parent\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.361351 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359438 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-host-var-lib-cni-multus\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.361351 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359211 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-cnibin\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.361351 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359464 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f7ab33d4-814c-4979-be11-a1864e6b884b-registration-dir\") pod \"aws-ebs-csi-driver-node-5wl24\" (UID: \"f7ab33d4-814c-4979-be11-a1864e6b884b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wl24" Jul 01 20:17:07.361351 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359489 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-host-slash\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.361351 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359498 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-host-var-lib-cni-bin\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.361897 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359517 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.361897 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359541 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-host-cni-netd\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.361897 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359548 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7ece6589-3e50-4328-aa47-3a030462201a-env-overrides\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.361897 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:07.359575 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0077ab1f-92a9-4220-a3bd-cb3af8897040-metrics-certs podName:0077ab1f-92a9-4220-a3bd-cb3af8897040 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:07.859553332 +0000 UTC m=+2.080046274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0077ab1f-92a9-4220-a3bd-cb3af8897040-metrics-certs") pod "network-metrics-daemon-krqwd" (UID: "0077ab1f-92a9-4220-a3bd-cb3af8897040") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:07.361897 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359577 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-run-systemd\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.361897 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359603 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d64afbbe-e3f2-480a-a21e-3da26be3234e-iptables-alerter-script\") pod \"iptables-alerter-5t82s\" (UID: \"d64afbbe-e3f2-480a-a21e-3da26be3234e\") " pod="openshift-network-operator/iptables-alerter-5t82s" Jul 01 20:17:07.361897 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359634 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-system-cni-dir\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.361897 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359638 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-multus-socket-dir-parent\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.361897 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359641 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f7ab33d4-814c-4979-be11-a1864e6b884b-registration-dir\") pod \"aws-ebs-csi-driver-node-5wl24\" (UID: \"f7ab33d4-814c-4979-be11-a1864e6b884b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wl24" Jul 01 20:17:07.361897 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359658 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-host-run-k8s-cni-cncf-io\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.361897 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359675 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43152b18-e982-4ed0-a0b1-bbb43942c9b8-tmp-dir\") pod \"node-resolver-dltf8\" (UID: \"43152b18-e982-4ed0-a0b1-bbb43942c9b8\") " pod="openshift-dns/node-resolver-dltf8" Jul 01 20:17:07.361897 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359686 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3dcbabb0-a6a2-4add-a392-561e8cedc9d2-host\") pod \"node-ca-mdknz\" (UID: \"3dcbabb0-a6a2-4add-a392-561e8cedc9d2\") " pod="openshift-image-registry/node-ca-mdknz" Jul 01 20:17:07.361897 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359680 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-host-var-lib-cni-multus\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.361897 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359707 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-host-slash\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.361897 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359714 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3dcbabb0-a6a2-4add-a392-561e8cedc9d2-serviceca\") pod \"node-ca-mdknz\" (UID: \"3dcbabb0-a6a2-4add-a392-561e8cedc9d2\") " pod="openshift-image-registry/node-ca-mdknz" Jul 01 20:17:07.361897 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359712 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ece6589-3e50-4328-aa47-3a030462201a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.361897 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359750 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-host-run-k8s-cni-cncf-io\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.362421 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359754 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e5e6e70-82d3-4cd0-b589-68fb150c80cc-os-release\") pod \"multus-additional-cni-plugins-dw6kb\" (UID: \"7e5e6e70-82d3-4cd0-b589-68fb150c80cc\") " pod="openshift-multus/multus-additional-cni-plugins-dw6kb" Jul 01 20:17:07.362421 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359795 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f7ab33d4-814c-4979-be11-a1864e6b884b-sys-fs\") pod \"aws-ebs-csi-driver-node-5wl24\" (UID: \"f7ab33d4-814c-4979-be11-a1864e6b884b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wl24" Jul 01 20:17:07.362421 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359817 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e5e6e70-82d3-4cd0-b589-68fb150c80cc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dw6kb\" (UID: \"7e5e6e70-82d3-4cd0-b589-68fb150c80cc\") " pod="openshift-multus/multus-additional-cni-plugins-dw6kb" Jul 01 20:17:07.362421 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359768 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3dcbabb0-a6a2-4add-a392-561e8cedc9d2-host\") pod \"node-ca-mdknz\" (UID: \"3dcbabb0-a6a2-4add-a392-561e8cedc9d2\") " pod="openshift-image-registry/node-ca-mdknz" Jul 01 20:17:07.362421 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359881 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f7ab33d4-814c-4979-be11-a1864e6b884b-sys-fs\") pod \"aws-ebs-csi-driver-node-5wl24\" (UID: \"f7ab33d4-814c-4979-be11-a1864e6b884b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wl24" Jul 01 20:17:07.362421 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359911 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-system-cni-dir\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.362421 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359937 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e5e6e70-82d3-4cd0-b589-68fb150c80cc-os-release\") pod \"multus-additional-cni-plugins-dw6kb\" (UID: \"7e5e6e70-82d3-4cd0-b589-68fb150c80cc\") " pod="openshift-multus/multus-additional-cni-plugins-dw6kb" Jul 01 20:17:07.362421 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359823 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7ece6589-3e50-4328-aa47-3a030462201a-ovnkube-script-lib\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.362421 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.359989 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clgw5\" (UniqueName: \"kubernetes.io/projected/0077ab1f-92a9-4220-a3bd-cb3af8897040-kube-api-access-clgw5\") pod \"network-metrics-daemon-krqwd\" (UID: \"0077ab1f-92a9-4220-a3bd-cb3af8897040\") " pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:07.362421 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.360017 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-multus-cni-dir\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.362421 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.360100 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-multus-cni-dir\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.362421 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.360224 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3dcbabb0-a6a2-4add-a392-561e8cedc9d2-serviceca\") pod \"node-ca-mdknz\" (UID: \"3dcbabb0-a6a2-4add-a392-561e8cedc9d2\") " pod="openshift-image-registry/node-ca-mdknz" Jul 01 20:17:07.362421 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.360366 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d64afbbe-e3f2-480a-a21e-3da26be3234e-iptables-alerter-script\") pod \"iptables-alerter-5t82s\" (UID: \"d64afbbe-e3f2-480a-a21e-3da26be3234e\") " pod="openshift-network-operator/iptables-alerter-5t82s" Jul 01 20:17:07.362421 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.360447 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7e5e6e70-82d3-4cd0-b589-68fb150c80cc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dw6kb\" (UID: \"7e5e6e70-82d3-4cd0-b589-68fb150c80cc\") " pod="openshift-multus/multus-additional-cni-plugins-dw6kb" Jul 01 20:17:07.362421 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.360522 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7ece6589-3e50-4328-aa47-3a030462201a-env-overrides\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.362421 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.360552 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7ece6589-3e50-4328-aa47-3a030462201a-ovnkube-script-lib\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.362421 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.360565 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-cni-binary-copy\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.362932 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.360668 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7e5e6e70-82d3-4cd0-b589-68fb150c80cc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dw6kb\" (UID: \"7e5e6e70-82d3-4cd0-b589-68fb150c80cc\") " pod="openshift-multus/multus-additional-cni-plugins-dw6kb" Jul 01 20:17:07.362932 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.360873 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7ece6589-3e50-4328-aa47-3a030462201a-ovn-node-metrics-cert\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.362932 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.360971 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7ece6589-3e50-4328-aa47-3a030462201a-ovnkube-config\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.367088 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:07.367064 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 20:17:07.367208 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:07.367092 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 20:17:07.367208 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.367095 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r82dh\" (UniqueName: \"kubernetes.io/projected/7e5e6e70-82d3-4cd0-b589-68fb150c80cc-kube-api-access-r82dh\") pod \"multus-additional-cni-plugins-dw6kb\" (UID: \"7e5e6e70-82d3-4cd0-b589-68fb150c80cc\") " pod="openshift-multus/multus-additional-cni-plugins-dw6kb" Jul 01 20:17:07.367208 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:07.367106 2574 projected.go:196] Error preparing data for projected volume kube-api-access-bjcnm for pod openshift-network-diagnostics/network-check-target-tw94d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:07.367208 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:07.367171 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/722add9e-cb45-46a9-86a3-28786a7afc60-kube-api-access-bjcnm podName:722add9e-cb45-46a9-86a3-28786a7afc60 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:07.867157465 +0000 UTC m=+2.087650413 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bjcnm" (UniqueName: "kubernetes.io/projected/722add9e-cb45-46a9-86a3-28786a7afc60-kube-api-access-bjcnm") pod "network-check-target-tw94d" (UID: "722add9e-cb45-46a9-86a3-28786a7afc60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:07.369017 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.368987 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpmhf\" (UniqueName: \"kubernetes.io/projected/d64afbbe-e3f2-480a-a21e-3da26be3234e-kube-api-access-wpmhf\") pod \"iptables-alerter-5t82s\" (UID: \"d64afbbe-e3f2-480a-a21e-3da26be3234e\") " pod="openshift-network-operator/iptables-alerter-5t82s" Jul 01 20:17:07.369386 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.369363 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk6dr\" (UniqueName: \"kubernetes.io/projected/3dcbabb0-a6a2-4add-a392-561e8cedc9d2-kube-api-access-gk6dr\") pod \"node-ca-mdknz\" (UID: \"3dcbabb0-a6a2-4add-a392-561e8cedc9d2\") " pod="openshift-image-registry/node-ca-mdknz" Jul 01 20:17:07.369583 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.369563 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nvv4\" (UniqueName: \"kubernetes.io/projected/130bae62-2f3a-4d1c-8e3c-05c0643fadd9-kube-api-access-2nvv4\") pod \"multus-2bqpm\" (UID: \"130bae62-2f3a-4d1c-8e3c-05c0643fadd9\") " pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.369892 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.369873 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-772z8\" (UniqueName: \"kubernetes.io/projected/7ece6589-3e50-4328-aa47-3a030462201a-kube-api-access-772z8\") pod \"ovnkube-node-4mfbr\" (UID: \"7ece6589-3e50-4328-aa47-3a030462201a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.370085 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.370067 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt5qj\" (UniqueName: \"kubernetes.io/projected/f7ab33d4-814c-4979-be11-a1864e6b884b-kube-api-access-zt5qj\") pod \"aws-ebs-csi-driver-node-5wl24\" (UID: \"f7ab33d4-814c-4979-be11-a1864e6b884b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wl24" Jul 01 20:17:07.370292 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.370274 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clgw5\" (UniqueName: \"kubernetes.io/projected/0077ab1f-92a9-4220-a3bd-cb3af8897040-kube-api-access-clgw5\") pod \"network-metrics-daemon-krqwd\" (UID: \"0077ab1f-92a9-4220-a3bd-cb3af8897040\") " pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:07.370987 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.370967 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdmzp\" (UniqueName: \"kubernetes.io/projected/43152b18-e982-4ed0-a0b1-bbb43942c9b8-kube-api-access-mdmzp\") pod \"node-resolver-dltf8\" (UID: \"43152b18-e982-4ed0-a0b1-bbb43942c9b8\") " pod="openshift-dns/node-resolver-dltf8" Jul 01 20:17:07.469676 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.469593 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xjj2k" Jul 01 20:17:07.477931 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:07.477900 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dd4d0cb_8571_4dd6_867a_49de95334f70.slice/crio-676bca898e021cb53043b9c052d05a98f1ed39ca32860f5329a4622e89f02c83 WatchSource:0}: Error finding container 676bca898e021cb53043b9c052d05a98f1ed39ca32860f5329a4622e89f02c83: Status 404 returned error can't find the container with id 676bca898e021cb53043b9c052d05a98f1ed39ca32860f5329a4622e89f02c83 Jul 01 20:17:07.491907 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.491888 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-564bh" Jul 01 20:17:07.500222 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:07.500193 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod936b7dc6_0dd8_46e5_962b_a4ef4b61682e.slice/crio-b21a93ed99f8a0ca0fe438c7f847df843ff71f9e5f6d3d42435b42059c894509 WatchSource:0}: Error finding container b21a93ed99f8a0ca0fe438c7f847df843ff71f9e5f6d3d42435b42059c894509: Status 404 returned error can't find the container with id b21a93ed99f8a0ca0fe438c7f847df843ff71f9e5f6d3d42435b42059c894509 Jul 01 20:17:07.515035 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.515010 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dltf8" Jul 01 20:17:07.521840 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:07.521813 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43152b18_e982_4ed0_a0b1_bbb43942c9b8.slice/crio-53bccc914db3b46593446d0f2906611a01f15281864809f790a7d14303a47706 WatchSource:0}: Error finding container 53bccc914db3b46593446d0f2906611a01f15281864809f790a7d14303a47706: Status 404 returned error can't find the container with id 53bccc914db3b46593446d0f2906611a01f15281864809f790a7d14303a47706 Jul 01 20:17:07.532578 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.532562 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2bqpm" Jul 01 20:17:07.539050 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:07.539030 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod130bae62_2f3a_4d1c_8e3c_05c0643fadd9.slice/crio-52abac3b5d390bdcb168bd21880e3aad320d25602d4a825ee8cdf971570a183c WatchSource:0}: Error finding container 52abac3b5d390bdcb168bd21880e3aad320d25602d4a825ee8cdf971570a183c: Status 404 returned error can't find the container with id 52abac3b5d390bdcb168bd21880e3aad320d25602d4a825ee8cdf971570a183c Jul 01 20:17:07.539487 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.539472 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5t82s" Jul 01 20:17:07.546485 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.546466 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wl24" Jul 01 20:17:07.546824 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:07.546806 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd64afbbe_e3f2_480a_a21e_3da26be3234e.slice/crio-31d5ab4038a3a7b0f7fcbf007df1880f60c68da85ef3676a34c750a2764f92ac WatchSource:0}: Error finding container 31d5ab4038a3a7b0f7fcbf007df1880f60c68da85ef3676a34c750a2764f92ac: Status 404 returned error can't find the container with id 31d5ab4038a3a7b0f7fcbf007df1880f60c68da85ef3676a34c750a2764f92ac Jul 01 20:17:07.552155 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.552136 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mdknz" Jul 01 20:17:07.553429 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:07.553390 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7ab33d4_814c_4979_be11_a1864e6b884b.slice/crio-7dd9da197aeb0e3700d22df948635349ffc06d59320cdcf36c594e6ce57c2953 WatchSource:0}: Error finding container 7dd9da197aeb0e3700d22df948635349ffc06d59320cdcf36c594e6ce57c2953: Status 404 returned error can't find the container with id 7dd9da197aeb0e3700d22df948635349ffc06d59320cdcf36c594e6ce57c2953 Jul 01 20:17:07.558523 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.558506 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dw6kb" Jul 01 20:17:07.559694 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:07.559675 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dcbabb0_a6a2_4add_a392_561e8cedc9d2.slice/crio-c077508aed349743789d35bcb29f7e3ca5d81685493f748513450feab1fc24b9 WatchSource:0}: Error finding container c077508aed349743789d35bcb29f7e3ca5d81685493f748513450feab1fc24b9: Status 404 returned error can't find the container with id c077508aed349743789d35bcb29f7e3ca5d81685493f748513450feab1fc24b9 Jul 01 20:17:07.564078 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.564063 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:07.571936 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:17:07.571906 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ece6589_3e50_4328_aa47_3a030462201a.slice/crio-505b530e0759166f9686629853fd9e166a139ca67df9680109e4286439ae0c8f WatchSource:0}: Error finding container 505b530e0759166f9686629853fd9e166a139ca67df9680109e4286439ae0c8f: Status 404 returned error can't find the container with id 505b530e0759166f9686629853fd9e166a139ca67df9680109e4286439ae0c8f Jul 01 20:17:07.762999 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.762922 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c64a3366-7257-45a2-b9e8-1db08d59c81a-original-pull-secret\") pod \"global-pull-secret-syncer-n8j6z\" (UID: \"c64a3366-7257-45a2-b9e8-1db08d59c81a\") " pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:07.763173 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:07.763060 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:07.763173 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:07.763130 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c64a3366-7257-45a2-b9e8-1db08d59c81a-original-pull-secret podName:c64a3366-7257-45a2-b9e8-1db08d59c81a nodeName:}" failed. No retries permitted until 2026-07-01 20:17:08.763109329 +0000 UTC m=+2.983602262 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c64a3366-7257-45a2-b9e8-1db08d59c81a-original-pull-secret") pod "global-pull-secret-syncer-n8j6z" (UID: "c64a3366-7257-45a2-b9e8-1db08d59c81a") : object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:07.863327 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.863293 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0077ab1f-92a9-4220-a3bd-cb3af8897040-metrics-certs\") pod \"network-metrics-daemon-krqwd\" (UID: \"0077ab1f-92a9-4220-a3bd-cb3af8897040\") " pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:07.863521 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:07.863434 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:07.863521 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:07.863494 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0077ab1f-92a9-4220-a3bd-cb3af8897040-metrics-certs podName:0077ab1f-92a9-4220-a3bd-cb3af8897040 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:08.863476679 +0000 UTC m=+3.083969609 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0077ab1f-92a9-4220-a3bd-cb3af8897040-metrics-certs") pod "network-metrics-daemon-krqwd" (UID: "0077ab1f-92a9-4220-a3bd-cb3af8897040") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:07.964285 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:07.964247 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjcnm\" (UniqueName: \"kubernetes.io/projected/722add9e-cb45-46a9-86a3-28786a7afc60-kube-api-access-bjcnm\") pod \"network-check-target-tw94d\" (UID: \"722add9e-cb45-46a9-86a3-28786a7afc60\") " pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:07.964474 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:07.964436 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 20:17:07.964474 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:07.964459 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 20:17:07.964474 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:07.964472 2574 projected.go:196] Error preparing data for projected volume kube-api-access-bjcnm for pod openshift-network-diagnostics/network-check-target-tw94d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:07.964624 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:07.964529 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/722add9e-cb45-46a9-86a3-28786a7afc60-kube-api-access-bjcnm podName:722add9e-cb45-46a9-86a3-28786a7afc60 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:08.964510102 +0000 UTC m=+3.185003035 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bjcnm" (UniqueName: "kubernetes.io/projected/722add9e-cb45-46a9-86a3-28786a7afc60-kube-api-access-bjcnm") pod "network-check-target-tw94d" (UID: "722add9e-cb45-46a9-86a3-28786a7afc60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:08.023111 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:08.022126 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 20:17:08.204100 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:08.203980 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 20:12:07 +0000 UTC" deadline="2028-03-21 14:53:36.053523456 +0000 UTC" Jul 01 20:17:08.204100 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:08.204043 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15090h36m27.849485143s" Jul 01 20:17:08.228222 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:08.228032 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" event={"ID":"7ece6589-3e50-4328-aa47-3a030462201a","Type":"ContainerStarted","Data":"505b530e0759166f9686629853fd9e166a139ca67df9680109e4286439ae0c8f"} Jul 01 20:17:08.230721 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:08.230689 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mdknz" event={"ID":"3dcbabb0-a6a2-4add-a392-561e8cedc9d2","Type":"ContainerStarted","Data":"c077508aed349743789d35bcb29f7e3ca5d81685493f748513450feab1fc24b9"} Jul 01 20:17:08.238064 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:08.238029 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wl24" event={"ID":"f7ab33d4-814c-4979-be11-a1864e6b884b","Type":"ContainerStarted","Data":"7dd9da197aeb0e3700d22df948635349ffc06d59320cdcf36c594e6ce57c2953"} Jul 01 20:17:08.262988 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:08.262951 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5t82s" event={"ID":"d64afbbe-e3f2-480a-a21e-3da26be3234e","Type":"ContainerStarted","Data":"31d5ab4038a3a7b0f7fcbf007df1880f60c68da85ef3676a34c750a2764f92ac"} Jul 01 20:17:08.274056 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:08.273975 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2bqpm" event={"ID":"130bae62-2f3a-4d1c-8e3c-05c0643fadd9","Type":"ContainerStarted","Data":"52abac3b5d390bdcb168bd21880e3aad320d25602d4a825ee8cdf971570a183c"} Jul 01 20:17:08.288041 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:08.288009 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dltf8" event={"ID":"43152b18-e982-4ed0-a0b1-bbb43942c9b8","Type":"ContainerStarted","Data":"53bccc914db3b46593446d0f2906611a01f15281864809f790a7d14303a47706"} Jul 01 20:17:08.293432 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:08.293379 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-231.ec2.internal" event={"ID":"af245736aa16ec85cdbac3ea0a090d37","Type":"ContainerStarted","Data":"cdabff54b3c191ccc5405d2ae3c2cfeb8b30588ff5b54fec8c0b35baa1199cc1"} Jul 01 20:17:08.295959 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:08.295920 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dw6kb" event={"ID":"7e5e6e70-82d3-4cd0-b589-68fb150c80cc","Type":"ContainerStarted","Data":"d04c7f330907fba4bf36692bca097610ecb95be1e13d2e3a7a03c69af23b6f39"} Jul 01 20:17:08.299034 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:08.298958 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-564bh" event={"ID":"936b7dc6-0dd8-46e5-962b-a4ef4b61682e","Type":"ContainerStarted","Data":"b21a93ed99f8a0ca0fe438c7f847df843ff71f9e5f6d3d42435b42059c894509"} Jul 01 20:17:08.301876 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:08.301850 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xjj2k" event={"ID":"5dd4d0cb-8571-4dd6-867a-49de95334f70","Type":"ContainerStarted","Data":"676bca898e021cb53043b9c052d05a98f1ed39ca32860f5329a4622e89f02c83"} Jul 01 20:17:08.304572 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:08.304548 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-231.ec2.internal" event={"ID":"5548dc72c03db29f83e1333607e1ad90","Type":"ContainerStarted","Data":"dad8a1abff9c4ce38d666ea7a7ba44b1de3920ede4be4dd3c2c2b7e4b3b2caf1"} Jul 01 20:17:08.772026 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:08.771940 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c64a3366-7257-45a2-b9e8-1db08d59c81a-original-pull-secret\") pod \"global-pull-secret-syncer-n8j6z\" (UID: \"c64a3366-7257-45a2-b9e8-1db08d59c81a\") " pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:08.772206 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:08.772108 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:08.772206 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:08.772181 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c64a3366-7257-45a2-b9e8-1db08d59c81a-original-pull-secret podName:c64a3366-7257-45a2-b9e8-1db08d59c81a nodeName:}" failed. No retries permitted until 2026-07-01 20:17:10.772162238 +0000 UTC m=+4.992655176 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c64a3366-7257-45a2-b9e8-1db08d59c81a-original-pull-secret") pod "global-pull-secret-syncer-n8j6z" (UID: "c64a3366-7257-45a2-b9e8-1db08d59c81a") : object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:08.873299 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:08.873094 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0077ab1f-92a9-4220-a3bd-cb3af8897040-metrics-certs\") pod \"network-metrics-daemon-krqwd\" (UID: \"0077ab1f-92a9-4220-a3bd-cb3af8897040\") " pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:08.873299 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:08.873251 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:08.873591 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:08.873314 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0077ab1f-92a9-4220-a3bd-cb3af8897040-metrics-certs podName:0077ab1f-92a9-4220-a3bd-cb3af8897040 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:10.873294749 +0000 UTC m=+5.093787704 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0077ab1f-92a9-4220-a3bd-cb3af8897040-metrics-certs") pod "network-metrics-daemon-krqwd" (UID: "0077ab1f-92a9-4220-a3bd-cb3af8897040") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:08.974144 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:08.973895 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjcnm\" (UniqueName: \"kubernetes.io/projected/722add9e-cb45-46a9-86a3-28786a7afc60-kube-api-access-bjcnm\") pod \"network-check-target-tw94d\" (UID: \"722add9e-cb45-46a9-86a3-28786a7afc60\") " pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:08.974144 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:08.974078 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 20:17:08.974144 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:08.974101 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 20:17:08.974144 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:08.974115 2574 projected.go:196] Error preparing data for projected volume kube-api-access-bjcnm for pod openshift-network-diagnostics/network-check-target-tw94d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:08.974531 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:08.974175 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/722add9e-cb45-46a9-86a3-28786a7afc60-kube-api-access-bjcnm podName:722add9e-cb45-46a9-86a3-28786a7afc60 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:10.974154269 +0000 UTC m=+5.194647200 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bjcnm" (UniqueName: "kubernetes.io/projected/722add9e-cb45-46a9-86a3-28786a7afc60-kube-api-access-bjcnm") pod "network-check-target-tw94d" (UID: "722add9e-cb45-46a9-86a3-28786a7afc60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:09.204550 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:09.204428 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 20:12:07 +0000 UTC" deadline="2028-02-29 02:44:05.397638368 +0000 UTC" Jul 01 20:17:09.204550 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:09.204492 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14574h26m56.193149548s" Jul 01 20:17:09.213959 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:09.213933 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:09.214089 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:09.214058 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:17:09.214451 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:09.214281 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:09.214451 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:09.214395 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:17:09.214451 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:09.214434 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:09.214681 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:09.214520 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:17:10.123517 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:10.123483 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 20:17:10.792771 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:10.792623 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c64a3366-7257-45a2-b9e8-1db08d59c81a-original-pull-secret\") pod \"global-pull-secret-syncer-n8j6z\" (UID: \"c64a3366-7257-45a2-b9e8-1db08d59c81a\") " pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:10.793247 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:10.792837 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:10.793247 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:10.792910 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c64a3366-7257-45a2-b9e8-1db08d59c81a-original-pull-secret podName:c64a3366-7257-45a2-b9e8-1db08d59c81a nodeName:}" failed. No retries permitted until 2026-07-01 20:17:14.792889375 +0000 UTC m=+9.013382304 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c64a3366-7257-45a2-b9e8-1db08d59c81a-original-pull-secret") pod "global-pull-secret-syncer-n8j6z" (UID: "c64a3366-7257-45a2-b9e8-1db08d59c81a") : object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:10.894001 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:10.893336 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0077ab1f-92a9-4220-a3bd-cb3af8897040-metrics-certs\") pod \"network-metrics-daemon-krqwd\" (UID: \"0077ab1f-92a9-4220-a3bd-cb3af8897040\") " pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:10.894001 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:10.893503 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:10.894001 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:10.893567 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0077ab1f-92a9-4220-a3bd-cb3af8897040-metrics-certs podName:0077ab1f-92a9-4220-a3bd-cb3af8897040 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:14.893547581 +0000 UTC m=+9.114040515 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0077ab1f-92a9-4220-a3bd-cb3af8897040-metrics-certs") pod "network-metrics-daemon-krqwd" (UID: "0077ab1f-92a9-4220-a3bd-cb3af8897040") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:10.994081 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:10.994033 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjcnm\" (UniqueName: \"kubernetes.io/projected/722add9e-cb45-46a9-86a3-28786a7afc60-kube-api-access-bjcnm\") pod \"network-check-target-tw94d\" (UID: \"722add9e-cb45-46a9-86a3-28786a7afc60\") " pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:10.994278 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:10.994255 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 20:17:10.994278 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:10.994277 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 20:17:10.994393 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:10.994293 2574 projected.go:196] Error preparing data for projected volume kube-api-access-bjcnm for pod openshift-network-diagnostics/network-check-target-tw94d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:10.994393 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:10.994355 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/722add9e-cb45-46a9-86a3-28786a7afc60-kube-api-access-bjcnm podName:722add9e-cb45-46a9-86a3-28786a7afc60 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:14.994336846 +0000 UTC m=+9.214829777 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bjcnm" (UniqueName: "kubernetes.io/projected/722add9e-cb45-46a9-86a3-28786a7afc60-kube-api-access-bjcnm") pod "network-check-target-tw94d" (UID: "722add9e-cb45-46a9-86a3-28786a7afc60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:11.214053 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:11.213962 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:11.214235 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:11.214103 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:17:11.214235 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:11.214162 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:11.214367 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:11.214242 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:17:11.214367 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:11.214287 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:11.214546 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:11.214389 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:17:13.213975 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:13.213884 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:13.214490 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:13.214022 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:17:13.214490 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:13.214245 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:13.214490 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:13.214273 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:13.214490 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:13.214389 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:17:13.214728 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:13.214494 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:17:14.830812 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:14.830768 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c64a3366-7257-45a2-b9e8-1db08d59c81a-original-pull-secret\") pod \"global-pull-secret-syncer-n8j6z\" (UID: \"c64a3366-7257-45a2-b9e8-1db08d59c81a\") " pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:14.831354 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:14.830958 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:14.831354 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:14.831045 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c64a3366-7257-45a2-b9e8-1db08d59c81a-original-pull-secret podName:c64a3366-7257-45a2-b9e8-1db08d59c81a nodeName:}" failed. No retries permitted until 2026-07-01 20:17:22.831021455 +0000 UTC m=+17.051514408 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c64a3366-7257-45a2-b9e8-1db08d59c81a-original-pull-secret") pod "global-pull-secret-syncer-n8j6z" (UID: "c64a3366-7257-45a2-b9e8-1db08d59c81a") : object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:14.931844 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:14.931798 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0077ab1f-92a9-4220-a3bd-cb3af8897040-metrics-certs\") pod \"network-metrics-daemon-krqwd\" (UID: \"0077ab1f-92a9-4220-a3bd-cb3af8897040\") " pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:14.932131 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:14.931904 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:14.932131 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:14.931985 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0077ab1f-92a9-4220-a3bd-cb3af8897040-metrics-certs podName:0077ab1f-92a9-4220-a3bd-cb3af8897040 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:22.931963336 +0000 UTC m=+17.152456274 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0077ab1f-92a9-4220-a3bd-cb3af8897040-metrics-certs") pod "network-metrics-daemon-krqwd" (UID: "0077ab1f-92a9-4220-a3bd-cb3af8897040") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:15.032675 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:15.032638 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjcnm\" (UniqueName: \"kubernetes.io/projected/722add9e-cb45-46a9-86a3-28786a7afc60-kube-api-access-bjcnm\") pod \"network-check-target-tw94d\" (UID: \"722add9e-cb45-46a9-86a3-28786a7afc60\") " pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:15.032879 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:15.032793 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 20:17:15.032879 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:15.032817 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 20:17:15.032879 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:15.032830 2574 projected.go:196] Error preparing data for projected volume kube-api-access-bjcnm for pod openshift-network-diagnostics/network-check-target-tw94d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:15.033041 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:15.032890 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/722add9e-cb45-46a9-86a3-28786a7afc60-kube-api-access-bjcnm podName:722add9e-cb45-46a9-86a3-28786a7afc60 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:23.032870282 +0000 UTC m=+17.253363210 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bjcnm" (UniqueName: "kubernetes.io/projected/722add9e-cb45-46a9-86a3-28786a7afc60-kube-api-access-bjcnm") pod "network-check-target-tw94d" (UID: "722add9e-cb45-46a9-86a3-28786a7afc60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:15.213605 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:15.213517 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:15.213605 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:15.213549 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:15.213824 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:15.213661 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:15.213824 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:15.213660 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:17:15.213940 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:15.213813 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:17:15.213940 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:15.213896 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:17:17.213450 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:17.213408 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:17.213450 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:17.213435 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:17.214045 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:17.213421 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:17.214045 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:17.213547 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:17:17.214045 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:17.213651 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:17:17.214045 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:17.213711 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:17:19.214301 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:19.214209 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:19.214729 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:19.214210 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:19.214729 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:19.214346 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:17:19.214729 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:19.214446 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:17:19.214729 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:19.214219 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:19.214729 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:19.214566 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:17:21.214085 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:21.214051 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:21.214085 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:21.214076 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:21.214644 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:21.214109 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:21.214644 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:21.214201 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:17:21.214644 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:21.214285 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:17:21.214644 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:21.214369 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:17:22.892043 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:22.892014 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c64a3366-7257-45a2-b9e8-1db08d59c81a-original-pull-secret\") pod \"global-pull-secret-syncer-n8j6z\" (UID: \"c64a3366-7257-45a2-b9e8-1db08d59c81a\") " pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:22.892447 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:22.892150 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:22.892447 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:22.892208 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c64a3366-7257-45a2-b9e8-1db08d59c81a-original-pull-secret podName:c64a3366-7257-45a2-b9e8-1db08d59c81a nodeName:}" failed. No retries permitted until 2026-07-01 20:17:38.892192131 +0000 UTC m=+33.112685059 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c64a3366-7257-45a2-b9e8-1db08d59c81a-original-pull-secret") pod "global-pull-secret-syncer-n8j6z" (UID: "c64a3366-7257-45a2-b9e8-1db08d59c81a") : object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:22.992624 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:22.992558 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0077ab1f-92a9-4220-a3bd-cb3af8897040-metrics-certs\") pod \"network-metrics-daemon-krqwd\" (UID: \"0077ab1f-92a9-4220-a3bd-cb3af8897040\") " pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:22.992743 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:22.992668 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:22.992743 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:22.992734 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0077ab1f-92a9-4220-a3bd-cb3af8897040-metrics-certs podName:0077ab1f-92a9-4220-a3bd-cb3af8897040 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:38.992715817 +0000 UTC m=+33.213208747 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0077ab1f-92a9-4220-a3bd-cb3af8897040-metrics-certs") pod "network-metrics-daemon-krqwd" (UID: "0077ab1f-92a9-4220-a3bd-cb3af8897040") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:23.092992 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:23.092852 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjcnm\" (UniqueName: \"kubernetes.io/projected/722add9e-cb45-46a9-86a3-28786a7afc60-kube-api-access-bjcnm\") pod \"network-check-target-tw94d\" (UID: \"722add9e-cb45-46a9-86a3-28786a7afc60\") " pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:23.093081 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:23.092997 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 20:17:23.093081 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:23.093016 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 20:17:23.093081 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:23.093026 2574 projected.go:196] Error preparing data for projected volume kube-api-access-bjcnm for pod openshift-network-diagnostics/network-check-target-tw94d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:23.093081 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:23.093077 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/722add9e-cb45-46a9-86a3-28786a7afc60-kube-api-access-bjcnm podName:722add9e-cb45-46a9-86a3-28786a7afc60 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:39.093060688 +0000 UTC m=+33.313553617 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bjcnm" (UniqueName: "kubernetes.io/projected/722add9e-cb45-46a9-86a3-28786a7afc60-kube-api-access-bjcnm") pod "network-check-target-tw94d" (UID: "722add9e-cb45-46a9-86a3-28786a7afc60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:23.214133 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:23.214109 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:23.214229 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:23.214196 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:23.214229 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:23.214204 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:23.214310 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:23.214198 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:17:23.214310 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:23.214283 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:17:23.214393 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:23.214369 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:17:23.345729 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:23.345587 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2bqpm" event={"ID":"130bae62-2f3a-4d1c-8e3c-05c0643fadd9","Type":"ContainerStarted","Data":"59380c52c6686716a0a82b15c4df09a93ce2a3845f0ababbc7f6d7169a2d718a"} Jul 01 20:17:23.348343 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:23.348306 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-564bh" event={"ID":"936b7dc6-0dd8-46e5-962b-a4ef4b61682e","Type":"ContainerStarted","Data":"54d4792f4945d41a89984564d67242a3659e0016e7d9736fc923c2469325a79d"} Jul 01 20:17:23.350151 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:23.350124 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-231.ec2.internal" event={"ID":"5548dc72c03db29f83e1333607e1ad90","Type":"ContainerStarted","Data":"e95c72642a96508852950dec52be9b04fc4cf14a3bb9d6cfebf16f80d383972c"} Jul 01 20:17:23.364415 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:23.364373 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2bqpm" podStartSLOduration=0.914668589 podStartE2EDuration="16.364360293s" totalImagesPullingTime="15.449691704s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:17:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:23.36394849 +0000 UTC m=+17.584441439" watchObservedRunningTime="2026-07-01 20:17:23.364360293 +0000 UTC m=+17.584853242" Jul 01 20:17:23.378606 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:23.378566 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-231.ec2.internal" podStartSLOduration=16.378552711 podStartE2EDuration="16.378552711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:17:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:23.378019907 +0000 UTC m=+17.598512867" watchObservedRunningTime="2026-07-01 20:17:23.378552711 +0000 UTC m=+17.599045660" Jul 01 20:17:23.394402 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:23.394362 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-564bh" podStartSLOduration=0.889206926 podStartE2EDuration="16.394345043s" totalImagesPullingTime="15.505138117s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:17:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:23.394003001 +0000 UTC m=+17.614495961" watchObservedRunningTime="2026-07-01 20:17:23.394345043 +0000 UTC m=+17.614837987" Jul 01 20:17:24.353820 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:24.353780 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xjj2k" event={"ID":"5dd4d0cb-8571-4dd6-867a-49de95334f70","Type":"ContainerStarted","Data":"f0303e69a0f8b4a9ab36b4e6b289a58bca0596f630320b58e43266a33a8f72bd"} Jul 01 20:17:24.355503 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:24.355460 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mdknz" event={"ID":"3dcbabb0-a6a2-4add-a392-561e8cedc9d2","Type":"ContainerStarted","Data":"26266cc16a7fcbf551e80b4b1d9aac6053fa8cad36dbcdc7e4a37c31303de2da"} Jul 01 20:17:24.357130 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:24.357104 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wl24" event={"ID":"f7ab33d4-814c-4979-be11-a1864e6b884b","Type":"ContainerStarted","Data":"aeb462cd7a74dca224471dda2080010768f4a5fd5f68ef62da2016bd0a8c96a8"} Jul 01 20:17:24.358516 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:24.358490 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5t82s" event={"ID":"d64afbbe-e3f2-480a-a21e-3da26be3234e","Type":"ContainerStarted","Data":"e32a25434ad48f2255a4bccbe3e6fbd0b3d0671b3d0727ed3e5b3b26cbe7d63b"} Jul 01 20:17:24.359699 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:24.359679 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dltf8" event={"ID":"43152b18-e982-4ed0-a0b1-bbb43942c9b8","Type":"ContainerStarted","Data":"40ca8271ea19c5d4d3e8af7197bdac87ea7096223d8c3b312e14741008d7daf7"} Jul 01 20:17:24.361049 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:24.361028 2574 generic.go:356] "Generic (PLEG): container finished" podID="af245736aa16ec85cdbac3ea0a090d37" containerID="252aace4b79c434189bb8194724a47d989ccd2b75b0e9984faf623ba81b2de72" exitCode=0 Jul 01 20:17:24.361143 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:24.361105 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-231.ec2.internal" event={"ID":"af245736aa16ec85cdbac3ea0a090d37","Type":"ContainerDied","Data":"252aace4b79c434189bb8194724a47d989ccd2b75b0e9984faf623ba81b2de72"} Jul 01 20:17:24.362386 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:24.362347 2574 generic.go:356] "Generic (PLEG): container finished" podID="7e5e6e70-82d3-4cd0-b589-68fb150c80cc" containerID="255a9ffe8fd1261bc4e6012bd80627770d2d37641d4a179189f95520f6de4069" exitCode=0 Jul 01 20:17:24.362472 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:24.362433 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dw6kb" event={"ID":"7e5e6e70-82d3-4cd0-b589-68fb150c80cc","Type":"ContainerDied","Data":"255a9ffe8fd1261bc4e6012bd80627770d2d37641d4a179189f95520f6de4069"} Jul 01 20:17:24.386205 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:24.386161 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xjj2k" podStartSLOduration=6.050047706 podStartE2EDuration="17.386148503s" totalImagesPullingTime="11.336100797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:17:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:24.385781918 +0000 UTC m=+18.606274892" watchObservedRunningTime="2026-07-01 20:17:24.386148503 +0000 UTC m=+18.606641447" Jul 01 20:17:24.430982 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:24.430943 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5t82s" podStartSLOduration=2.204077637 podStartE2EDuration="17.430928684s" totalImagesPullingTime="15.226851047s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:17:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:24.416813787 +0000 UTC m=+18.637306737" watchObservedRunningTime="2026-07-01 20:17:24.430928684 +0000 UTC m=+18.651421633" Jul 01 20:17:24.431088 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:24.431059 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mdknz" podStartSLOduration=2.217451022 podStartE2EDuration="17.431054053s" totalImagesPullingTime="15.213603031s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:17:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:24.430663255 +0000 UTC m=+18.651156205" watchObservedRunningTime="2026-07-01 20:17:24.431054053 +0000 UTC m=+18.651547002" Jul 01 20:17:24.466054 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:24.466002 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dltf8" podStartSLOduration=2.214194817 podStartE2EDuration="17.465980052s" totalImagesPullingTime="15.251785235s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:17:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:24.444041701 +0000 UTC m=+18.664534653" watchObservedRunningTime="2026-07-01 20:17:24.465980052 +0000 UTC m=+18.686473002" Jul 01 20:17:25.117340 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:25.116428 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 20:17:25.212427 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:25.212349 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T20:17:25.116447715Z","UUID":"5ff13815-4198-49a2-858e-2f7dca3492e7","Handler":null,"Name":"","Endpoint":""} Jul 01 20:17:25.213367 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:25.213342 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:25.213367 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:25.213360 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:25.213367 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:25.213363 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:25.213523 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:25.213449 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:17:25.213578 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:25.213552 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:17:25.213679 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:25.213656 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:17:25.213758 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:25.213743 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 20:17:25.213812 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:25.213784 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 20:17:25.367321 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:25.367194 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-231.ec2.internal" event={"ID":"af245736aa16ec85cdbac3ea0a090d37","Type":"ContainerStarted","Data":"17c1c5e504e98aa541c4883572c7d46843620e35bd12723924a2f03329b4d210"} Jul 01 20:17:25.370099 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:25.370022 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wl24" event={"ID":"f7ab33d4-814c-4979-be11-a1864e6b884b","Type":"ContainerStarted","Data":"ffedca7349cc191d69a0a4b3b0831e0b48a9da9e7055663633336b5d1bfe2c43"} Jul 01 20:17:25.387581 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:25.387531 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-231.ec2.internal" podStartSLOduration=18.387517519 podStartE2EDuration="18.387517519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:17:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:25.387129868 +0000 UTC m=+19.607622817" watchObservedRunningTime="2026-07-01 20:17:25.387517519 +0000 UTC m=+19.608010468" Jul 01 20:17:26.375224 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:26.375074 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wl24" event={"ID":"f7ab33d4-814c-4979-be11-a1864e6b884b","Type":"ContainerStarted","Data":"e3a7c239e57b25b94944dc01f949eebe06c1ec2f121e799db787833ca26cc0ae"} Jul 01 20:17:26.394125 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:26.394082 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5wl24" podStartSLOduration=2.552007138 podStartE2EDuration="19.394066723s" totalImagesPullingTime="16.842059585s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:17:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:26.393546411 +0000 UTC m=+20.614039360" watchObservedRunningTime="2026-07-01 20:17:26.394066723 +0000 UTC m=+20.614559671" Jul 01 20:17:27.184797 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:27.184766 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xjj2k" Jul 01 20:17:27.185277 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:27.185256 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xjj2k" Jul 01 20:17:27.213704 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:27.213678 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:27.213823 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:27.213771 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:27.213823 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:27.213784 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:17:27.213906 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:27.213843 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:17:27.213954 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:27.213901 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:27.214034 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:27.214014 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:17:27.377111 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:27.377078 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xjj2k" Jul 01 20:17:27.377590 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:27.377440 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xjj2k" Jul 01 20:17:29.213908 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:29.213870 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:29.213908 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:29.213904 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:29.214675 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:29.213995 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:17:29.214675 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:29.214047 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:29.214675 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:29.214143 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:17:29.214675 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:29.214268 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:17:31.213158 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:31.213121 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:31.213616 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:31.213170 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:31.213616 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:31.213231 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:31.213616 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:31.213248 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:17:31.213616 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:31.213309 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:17:31.213616 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:31.213408 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:17:33.213617 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:33.213543 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:33.214149 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:33.213551 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:33.214149 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:33.213556 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:33.214149 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:33.213646 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:17:33.214149 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:33.213784 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:17:33.214149 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:33.213905 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:17:35.213310 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:35.213278 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:35.213756 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:35.213278 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:35.213756 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:35.213396 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:17:35.213756 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:35.213278 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:35.213756 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:35.213440 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:17:35.213756 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:35.213511 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:17:36.398041 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:36.397873 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mfbr_7ece6589-3e50-4328-aa47-3a030462201a/ovn-acl-logging/0.log" Jul 01 20:17:36.398536 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:36.398385 2574 generic.go:356] "Generic (PLEG): container finished" podID="7ece6589-3e50-4328-aa47-3a030462201a" containerID="db866774f3c9245e6e9636c3be825c9c125dd2003809e1bd6608dd0e61312d07" exitCode=1 Jul 01 20:17:36.398536 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:36.398457 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" event={"ID":"7ece6589-3e50-4328-aa47-3a030462201a","Type":"ContainerStarted","Data":"bd2379a403690d86c1c682a17f464d964d15f98e28fab6e84efe6381888a27e5"} Jul 01 20:17:36.398650 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:36.398577 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" event={"ID":"7ece6589-3e50-4328-aa47-3a030462201a","Type":"ContainerStarted","Data":"57803a29dcae5f0642d909795ce0bde91d4fbfcb941726754f933c7b27d861c2"} Jul 01 20:17:36.398650 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:36.398630 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" event={"ID":"7ece6589-3e50-4328-aa47-3a030462201a","Type":"ContainerStarted","Data":"08480cbec33e0c31fa8c5e8a771150442566aa73a67a7cd48d4fcbb25c9c9191"} Jul 01 20:17:36.398751 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:36.398677 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" event={"ID":"7ece6589-3e50-4328-aa47-3a030462201a","Type":"ContainerStarted","Data":"e3f847ab8b06d18e1c96fbbef8a37e9786dd77cfe6e0bcd4350e768e9658fcee"} Jul 01 20:17:36.398751 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:36.398726 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" event={"ID":"7ece6589-3e50-4328-aa47-3a030462201a","Type":"ContainerDied","Data":"db866774f3c9245e6e9636c3be825c9c125dd2003809e1bd6608dd0e61312d07"} Jul 01 20:17:36.398840 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:36.398775 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" event={"ID":"7ece6589-3e50-4328-aa47-3a030462201a","Type":"ContainerStarted","Data":"fbf4f946a3ab5cbdf6de552e8a415596c221709edab11052b9595d30e0ba6fea"} Jul 01 20:17:36.400354 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:36.400309 2574 generic.go:356] "Generic (PLEG): container finished" podID="7e5e6e70-82d3-4cd0-b589-68fb150c80cc" containerID="d12c51e245ec7eaf07a4dd79411a105f11b5b8b894ab07d60c0cd247a6edd3b0" exitCode=0 Jul 01 20:17:36.400468 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:36.400357 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dw6kb" event={"ID":"7e5e6e70-82d3-4cd0-b589-68fb150c80cc","Type":"ContainerDied","Data":"d12c51e245ec7eaf07a4dd79411a105f11b5b8b894ab07d60c0cd247a6edd3b0"} Jul 01 20:17:37.213528 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:37.213496 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:37.213753 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:37.213586 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:37.213753 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:37.213671 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:17:37.213753 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:37.213591 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:17:37.213753 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:37.213591 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:37.213753 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:37.213748 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:17:38.406982 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:38.406799 2574 generic.go:356] "Generic (PLEG): container finished" podID="7e5e6e70-82d3-4cd0-b589-68fb150c80cc" containerID="abdcecaab05bd6fb16962326709f2fc9f907f3b738589021b71e569c8e0cc2d5" exitCode=0 Jul 01 20:17:38.407285 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:38.406838 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dw6kb" event={"ID":"7e5e6e70-82d3-4cd0-b589-68fb150c80cc","Type":"ContainerDied","Data":"abdcecaab05bd6fb16962326709f2fc9f907f3b738589021b71e569c8e0cc2d5"} Jul 01 20:17:38.912844 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:38.912810 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c64a3366-7257-45a2-b9e8-1db08d59c81a-original-pull-secret\") pod \"global-pull-secret-syncer-n8j6z\" (UID: \"c64a3366-7257-45a2-b9e8-1db08d59c81a\") " pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:38.913034 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:38.912976 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:38.913093 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:38.913052 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c64a3366-7257-45a2-b9e8-1db08d59c81a-original-pull-secret podName:c64a3366-7257-45a2-b9e8-1db08d59c81a nodeName:}" failed. No retries permitted until 2026-07-01 20:18:10.913034605 +0000 UTC m=+65.133527534 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c64a3366-7257-45a2-b9e8-1db08d59c81a-original-pull-secret") pod "global-pull-secret-syncer-n8j6z" (UID: "c64a3366-7257-45a2-b9e8-1db08d59c81a") : object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:39.013945 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:39.013912 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0077ab1f-92a9-4220-a3bd-cb3af8897040-metrics-certs\") pod \"network-metrics-daemon-krqwd\" (UID: \"0077ab1f-92a9-4220-a3bd-cb3af8897040\") " pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:39.014115 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:39.014030 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:39.014115 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:39.014096 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0077ab1f-92a9-4220-a3bd-cb3af8897040-metrics-certs podName:0077ab1f-92a9-4220-a3bd-cb3af8897040 nodeName:}" failed. No retries permitted until 2026-07-01 20:18:11.014079892 +0000 UTC m=+65.234572820 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0077ab1f-92a9-4220-a3bd-cb3af8897040-metrics-certs") pod "network-metrics-daemon-krqwd" (UID: "0077ab1f-92a9-4220-a3bd-cb3af8897040") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:39.115211 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:39.115178 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjcnm\" (UniqueName: \"kubernetes.io/projected/722add9e-cb45-46a9-86a3-28786a7afc60-kube-api-access-bjcnm\") pod \"network-check-target-tw94d\" (UID: \"722add9e-cb45-46a9-86a3-28786a7afc60\") " pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:39.115373 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:39.115339 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 20:17:39.115373 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:39.115355 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 20:17:39.115373 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:39.115368 2574 projected.go:196] Error preparing data for projected volume kube-api-access-bjcnm for pod openshift-network-diagnostics/network-check-target-tw94d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:39.115477 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:39.115424 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/722add9e-cb45-46a9-86a3-28786a7afc60-kube-api-access-bjcnm podName:722add9e-cb45-46a9-86a3-28786a7afc60 nodeName:}" failed. No retries permitted until 2026-07-01 20:18:11.11540906 +0000 UTC m=+65.335901990 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bjcnm" (UniqueName: "kubernetes.io/projected/722add9e-cb45-46a9-86a3-28786a7afc60-kube-api-access-bjcnm") pod "network-check-target-tw94d" (UID: "722add9e-cb45-46a9-86a3-28786a7afc60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:39.213898 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:39.213820 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:39.214028 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:39.213922 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:39.214028 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:39.213929 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:17:39.214028 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:39.213953 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:39.214124 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:39.214028 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:17:39.214124 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:39.214095 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:17:39.411606 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:39.411580 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mfbr_7ece6589-3e50-4328-aa47-3a030462201a/ovn-acl-logging/0.log" Jul 01 20:17:39.412016 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:39.411902 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" event={"ID":"7ece6589-3e50-4328-aa47-3a030462201a","Type":"ContainerStarted","Data":"068dbfa19a837c361ff9faf4accb7f5bf44ccded3dafa09d3b6a5a5bf1b49100"} Jul 01 20:17:40.416077 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:40.416045 2574 generic.go:356] "Generic (PLEG): container finished" podID="7e5e6e70-82d3-4cd0-b589-68fb150c80cc" containerID="630783fb9973fb3e718ce7908f0c098ca14df9cdb3c836ebc4c6350e5782331c" exitCode=0 Jul 01 20:17:40.416509 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:40.416103 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dw6kb" event={"ID":"7e5e6e70-82d3-4cd0-b589-68fb150c80cc","Type":"ContainerDied","Data":"630783fb9973fb3e718ce7908f0c098ca14df9cdb3c836ebc4c6350e5782331c"} Jul 01 20:17:41.213603 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:41.213476 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:41.213603 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:41.213586 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:41.213603 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:41.213599 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:17:41.213876 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:41.213611 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:41.213876 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:41.213689 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:17:41.213876 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:41.213763 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:17:41.423118 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:41.423084 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mfbr_7ece6589-3e50-4328-aa47-3a030462201a/ovn-acl-logging/0.log" Jul 01 20:17:41.423959 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:41.423541 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" event={"ID":"7ece6589-3e50-4328-aa47-3a030462201a","Type":"ContainerStarted","Data":"312a21a79a07987d4e7ffd78dc2f1fd7a2d29fe8b51ad3ad0eadd8518b472693"} Jul 01 20:17:41.423959 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:41.423819 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:41.423959 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:41.423934 2574 scope.go:117] "RemoveContainer" containerID="db866774f3c9245e6e9636c3be825c9c125dd2003809e1bd6608dd0e61312d07" Jul 01 20:17:41.424131 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:41.423961 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:41.424131 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:41.424025 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:41.442625 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:41.442604 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:41.442905 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:41.442888 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:17:42.430675 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:42.430521 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mfbr_7ece6589-3e50-4328-aa47-3a030462201a/ovn-acl-logging/0.log" Jul 01 20:17:42.431111 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:42.431021 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" event={"ID":"7ece6589-3e50-4328-aa47-3a030462201a","Type":"ContainerStarted","Data":"801b180e3f7bd0ba0cf265c61f24d889669bd2faf0f4ba97cd790f01a9d54f08"} Jul 01 20:17:42.462113 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:42.462063 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" podStartSLOduration=7.335731085 podStartE2EDuration="35.462046662s" totalImagesPullingTime="28.126315577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:17:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:42.460978174 +0000 UTC m=+36.681471124" watchObservedRunningTime="2026-07-01 20:17:42.462046662 +0000 UTC m=+36.682539610" Jul 01 20:17:42.589756 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:42.589708 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n8j6z"] Jul 01 20:17:42.589932 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:42.589826 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:42.589995 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:42.589921 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:17:42.593693 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:42.593555 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tw94d"] Jul 01 20:17:42.593693 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:42.593657 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:42.593878 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:42.593757 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-krqwd"] Jul 01 20:17:42.593878 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:42.593852 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:42.593976 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:42.593759 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:17:42.593976 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:42.593945 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:17:44.123393 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:44.123361 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dltf8_43152b18-e982-4ed0-a0b1-bbb43942c9b8/dns-node-resolver/0.log" Jul 01 20:17:44.213220 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:44.213173 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:44.213419 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:44.213187 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:44.213419 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:44.213295 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:17:44.213419 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:44.213349 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:44.213588 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:44.213474 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:17:44.213588 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:44.213553 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:17:45.107995 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:45.107971 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mdknz_3dcbabb0-a6a2-4add-a392-561e8cedc9d2/node-ca/0.log" Jul 01 20:17:45.440622 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:45.440537 2574 generic.go:356] "Generic (PLEG): container finished" podID="7e5e6e70-82d3-4cd0-b589-68fb150c80cc" containerID="8f37066450855e659a1c2a3b241ea6d336f193371deedc4d0cf47c1db0476cd8" exitCode=0 Jul 01 20:17:45.440622 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:45.440580 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dw6kb" event={"ID":"7e5e6e70-82d3-4cd0-b589-68fb150c80cc","Type":"ContainerDied","Data":"8f37066450855e659a1c2a3b241ea6d336f193371deedc4d0cf47c1db0476cd8"} Jul 01 20:17:46.214433 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:46.214399 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:46.214608 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:46.214496 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:46.214608 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:46.214527 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:46.214608 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:46.214544 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:17:46.214608 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:46.214600 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:17:46.214760 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:46.214675 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:17:46.445297 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:46.445265 2574 generic.go:356] "Generic (PLEG): container finished" podID="7e5e6e70-82d3-4cd0-b589-68fb150c80cc" containerID="cb3641329c57bde6701a4b67599668eea747f2213d20f3de9d9172aaa9a69250" exitCode=0 Jul 01 20:17:46.445726 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:46.445336 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dw6kb" event={"ID":"7e5e6e70-82d3-4cd0-b589-68fb150c80cc","Type":"ContainerDied","Data":"cb3641329c57bde6701a4b67599668eea747f2213d20f3de9d9172aaa9a69250"} Jul 01 20:17:47.450422 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:47.450209 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dw6kb" event={"ID":"7e5e6e70-82d3-4cd0-b589-68fb150c80cc","Type":"ContainerStarted","Data":"7ff9763d0329a3d093cef992661c2b4467fe5343da989f4ee8a91f0fd8405e28"} Jul 01 20:17:47.470983 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:47.470942 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dw6kb" podStartSLOduration=7.388446714 podStartE2EDuration="40.470928173s" totalImagesPullingTime="33.082481459s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:17:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:47.470025887 +0000 UTC m=+41.690518835" watchObservedRunningTime="2026-07-01 20:17:47.470928173 +0000 UTC m=+41.691421122" Jul 01 20:17:48.213252 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:48.213222 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:48.213418 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:48.213363 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:17:48.213418 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:48.213386 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:48.213418 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:48.213410 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:48.213568 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:48.213469 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:17:48.213568 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:48.213520 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:17:50.214032 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:50.213993 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:50.214515 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:50.214104 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:17:50.214515 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:50.214005 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:50.214515 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:50.214151 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:50.214515 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:50.214250 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:17:50.214515 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:50.214288 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:17:52.213876 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:52.213846 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:52.213876 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:52.213878 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:52.214437 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:52.213846 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:52.214437 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:52.213949 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:17:52.214437 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:52.214018 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:17:52.214437 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:52.214078 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:17:54.213900 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:54.213865 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:54.213900 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:54.213896 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:54.214305 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:54.213865 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:54.214305 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:54.213972 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:17:54.214305 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:54.214078 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:17:54.214305 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:54.214168 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:17:56.214150 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:56.214121 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:56.214694 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:56.214182 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:56.214694 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:56.214203 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:56.214694 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:56.214225 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:17:56.214694 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:56.214278 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:17:56.214694 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:56.214353 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:17:58.214030 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:58.213999 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:17:58.214544 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:58.213999 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:17:58.214544 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:58.214118 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:17:58.214544 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:17:58.214130 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:17:58.214544 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:58.214207 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:17:58.214544 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:17:58.214287 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:18:00.214178 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:00.214138 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:18:00.214178 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:00.214159 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:18:00.214692 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:00.214138 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:18:00.214692 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:18:00.214253 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:18:00.214692 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:18:00.214310 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:18:00.214692 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:18:00.214436 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:18:02.213535 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:02.213501 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:18:02.213951 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:02.213506 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:18:02.213951 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:18:02.213635 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:18:02.213951 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:02.213506 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:18:02.213951 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:18:02.213692 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:18:02.213951 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:18:02.213798 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:18:04.213850 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:04.213811 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:18:04.213850 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:04.213826 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:18:04.213850 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:04.213812 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:18:04.214539 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:18:04.213923 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:18:04.214539 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:18:04.213966 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:18:04.214539 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:18:04.214041 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:18:06.214196 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:06.214160 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:18:06.214590 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:06.214245 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:18:06.214590 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:06.214275 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:18:06.214590 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:18:06.214337 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8j6z" podUID="c64a3366-7257-45a2-b9e8-1db08d59c81a" Jul 01 20:18:06.214590 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:18:06.214349 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw94d" podUID="722add9e-cb45-46a9-86a3-28786a7afc60" Jul 01 20:18:06.214590 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:18:06.214440 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krqwd" podUID="0077ab1f-92a9-4220-a3bd-cb3af8897040" Jul 01 20:18:07.327663 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.327637 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-231.ec2.internal" event="NodeReady" Jul 01 20:18:07.328099 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.327779 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 20:18:07.412080 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.412044 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5xk96"] Jul 01 20:18:07.433932 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.433899 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qmrmp"] Jul 01 20:18:07.434079 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.434020 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5xk96" Jul 01 20:18:07.436825 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.436595 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 20:18:07.436825 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.436696 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sqmvx\"" Jul 01 20:18:07.436825 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.436721 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 20:18:07.446876 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.446855 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5xk96"] Jul 01 20:18:07.447072 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.447061 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qmrmp"] Jul 01 20:18:07.447318 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.447299 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qmrmp" Jul 01 20:18:07.452404 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.450700 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 20:18:07.452404 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.450923 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 20:18:07.452404 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.451257 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qx7kb"] Jul 01 20:18:07.452404 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.451702 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 20:18:07.452404 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.451924 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7gq8j\"" Jul 01 20:18:07.452404 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.452170 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 20:18:07.464683 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.464658 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qx7kb"] Jul 01 20:18:07.464795 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.464760 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qx7kb" Jul 01 20:18:07.469804 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.469782 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 20:18:07.469913 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.469781 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jdbl8\"" Jul 01 20:18:07.470436 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.470414 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 20:18:07.470503 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.470457 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 20:18:07.525645 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.525609 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz5b8\" (UniqueName: \"kubernetes.io/projected/5f2457d4-e11f-44e6-b5f5-9c64fbc4eb65-kube-api-access-kz5b8\") pod \"ingress-canary-qx7kb\" (UID: \"5f2457d4-e11f-44e6-b5f5-9c64fbc4eb65\") " pod="openshift-ingress-canary/ingress-canary-qx7kb" Jul 01 20:18:07.525645 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.525642 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d03b064c-b018-4fcb-9f99-ce9c2e54105c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qmrmp\" (UID: \"d03b064c-b018-4fcb-9f99-ce9c2e54105c\") " pod="openshift-insights/insights-runtime-extractor-qmrmp" Jul 01 20:18:07.525833 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.525664 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lgsl\" (UniqueName: \"kubernetes.io/projected/d03b064c-b018-4fcb-9f99-ce9c2e54105c-kube-api-access-2lgsl\") pod \"insights-runtime-extractor-qmrmp\" (UID: \"d03b064c-b018-4fcb-9f99-ce9c2e54105c\") " pod="openshift-insights/insights-runtime-extractor-qmrmp" Jul 01 20:18:07.525833 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.525723 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dfcf9070-0230-4b25-ae6d-bf3c6bc51cb8-config-volume\") pod \"dns-default-5xk96\" (UID: \"dfcf9070-0230-4b25-ae6d-bf3c6bc51cb8\") " pod="openshift-dns/dns-default-5xk96" Jul 01 20:18:07.525833 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.525743 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfcf9070-0230-4b25-ae6d-bf3c6bc51cb8-metrics-tls\") pod \"dns-default-5xk96\" (UID: \"dfcf9070-0230-4b25-ae6d-bf3c6bc51cb8\") " pod="openshift-dns/dns-default-5xk96" Jul 01 20:18:07.525833 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.525773 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f2457d4-e11f-44e6-b5f5-9c64fbc4eb65-cert\") pod \"ingress-canary-qx7kb\" (UID: \"5f2457d4-e11f-44e6-b5f5-9c64fbc4eb65\") " pod="openshift-ingress-canary/ingress-canary-qx7kb" Jul 01 20:18:07.525833 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.525818 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzmw4\" (UniqueName: \"kubernetes.io/projected/dfcf9070-0230-4b25-ae6d-bf3c6bc51cb8-kube-api-access-jzmw4\") pod \"dns-default-5xk96\" (UID: \"dfcf9070-0230-4b25-ae6d-bf3c6bc51cb8\") " pod="openshift-dns/dns-default-5xk96" Jul 01 20:18:07.525983 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.525852 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d03b064c-b018-4fcb-9f99-ce9c2e54105c-data-volume\") pod \"insights-runtime-extractor-qmrmp\" (UID: \"d03b064c-b018-4fcb-9f99-ce9c2e54105c\") " pod="openshift-insights/insights-runtime-extractor-qmrmp" Jul 01 20:18:07.525983 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.525868 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfcf9070-0230-4b25-ae6d-bf3c6bc51cb8-tmp-dir\") pod \"dns-default-5xk96\" (UID: \"dfcf9070-0230-4b25-ae6d-bf3c6bc51cb8\") " pod="openshift-dns/dns-default-5xk96" Jul 01 20:18:07.525983 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.525882 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d03b064c-b018-4fcb-9f99-ce9c2e54105c-crio-socket\") pod \"insights-runtime-extractor-qmrmp\" (UID: \"d03b064c-b018-4fcb-9f99-ce9c2e54105c\") " pod="openshift-insights/insights-runtime-extractor-qmrmp" Jul 01 20:18:07.525983 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.525922 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d03b064c-b018-4fcb-9f99-ce9c2e54105c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qmrmp\" (UID: \"d03b064c-b018-4fcb-9f99-ce9c2e54105c\") " pod="openshift-insights/insights-runtime-extractor-qmrmp" Jul 01 20:18:07.626972 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.626881 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzmw4\" (UniqueName: \"kubernetes.io/projected/dfcf9070-0230-4b25-ae6d-bf3c6bc51cb8-kube-api-access-jzmw4\") pod \"dns-default-5xk96\" (UID: \"dfcf9070-0230-4b25-ae6d-bf3c6bc51cb8\") " pod="openshift-dns/dns-default-5xk96" Jul 01 20:18:07.626972 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.626935 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d03b064c-b018-4fcb-9f99-ce9c2e54105c-data-volume\") pod \"insights-runtime-extractor-qmrmp\" (UID: \"d03b064c-b018-4fcb-9f99-ce9c2e54105c\") " pod="openshift-insights/insights-runtime-extractor-qmrmp" Jul 01 20:18:07.626972 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.626962 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfcf9070-0230-4b25-ae6d-bf3c6bc51cb8-tmp-dir\") pod \"dns-default-5xk96\" (UID: \"dfcf9070-0230-4b25-ae6d-bf3c6bc51cb8\") " pod="openshift-dns/dns-default-5xk96" Jul 01 20:18:07.627242 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.626985 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d03b064c-b018-4fcb-9f99-ce9c2e54105c-crio-socket\") pod \"insights-runtime-extractor-qmrmp\" (UID: \"d03b064c-b018-4fcb-9f99-ce9c2e54105c\") " pod="openshift-insights/insights-runtime-extractor-qmrmp" Jul 01 20:18:07.627242 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.627017 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d03b064c-b018-4fcb-9f99-ce9c2e54105c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qmrmp\" (UID: \"d03b064c-b018-4fcb-9f99-ce9c2e54105c\") " pod="openshift-insights/insights-runtime-extractor-qmrmp" Jul 01 20:18:07.627242 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.627122 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d03b064c-b018-4fcb-9f99-ce9c2e54105c-crio-socket\") pod \"insights-runtime-extractor-qmrmp\" (UID: \"d03b064c-b018-4fcb-9f99-ce9c2e54105c\") " pod="openshift-insights/insights-runtime-extractor-qmrmp" Jul 01 20:18:07.627242 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.627196 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz5b8\" (UniqueName: \"kubernetes.io/projected/5f2457d4-e11f-44e6-b5f5-9c64fbc4eb65-kube-api-access-kz5b8\") pod \"ingress-canary-qx7kb\" (UID: \"5f2457d4-e11f-44e6-b5f5-9c64fbc4eb65\") " pod="openshift-ingress-canary/ingress-canary-qx7kb" Jul 01 20:18:07.627242 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.627241 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d03b064c-b018-4fcb-9f99-ce9c2e54105c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qmrmp\" (UID: \"d03b064c-b018-4fcb-9f99-ce9c2e54105c\") " pod="openshift-insights/insights-runtime-extractor-qmrmp" Jul 01 20:18:07.627555 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.627270 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lgsl\" (UniqueName: \"kubernetes.io/projected/d03b064c-b018-4fcb-9f99-ce9c2e54105c-kube-api-access-2lgsl\") pod \"insights-runtime-extractor-qmrmp\" (UID: \"d03b064c-b018-4fcb-9f99-ce9c2e54105c\") " pod="openshift-insights/insights-runtime-extractor-qmrmp" Jul 01 20:18:07.627555 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.627357 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d03b064c-b018-4fcb-9f99-ce9c2e54105c-data-volume\") pod \"insights-runtime-extractor-qmrmp\" (UID: \"d03b064c-b018-4fcb-9f99-ce9c2e54105c\") " pod="openshift-insights/insights-runtime-extractor-qmrmp" Jul 01 20:18:07.627555 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.627369 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dfcf9070-0230-4b25-ae6d-bf3c6bc51cb8-config-volume\") pod \"dns-default-5xk96\" (UID: \"dfcf9070-0230-4b25-ae6d-bf3c6bc51cb8\") " pod="openshift-dns/dns-default-5xk96" Jul 01 20:18:07.627555 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.627400 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfcf9070-0230-4b25-ae6d-bf3c6bc51cb8-metrics-tls\") pod \"dns-default-5xk96\" (UID: \"dfcf9070-0230-4b25-ae6d-bf3c6bc51cb8\") " pod="openshift-dns/dns-default-5xk96" Jul 01 20:18:07.627555 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.627426 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f2457d4-e11f-44e6-b5f5-9c64fbc4eb65-cert\") pod \"ingress-canary-qx7kb\" (UID: \"5f2457d4-e11f-44e6-b5f5-9c64fbc4eb65\") " pod="openshift-ingress-canary/ingress-canary-qx7kb" Jul 01 20:18:07.627555 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.627437 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfcf9070-0230-4b25-ae6d-bf3c6bc51cb8-tmp-dir\") pod \"dns-default-5xk96\" (UID: \"dfcf9070-0230-4b25-ae6d-bf3c6bc51cb8\") " pod="openshift-dns/dns-default-5xk96" Jul 01 20:18:07.627819 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.627746 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d03b064c-b018-4fcb-9f99-ce9c2e54105c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qmrmp\" (UID: \"d03b064c-b018-4fcb-9f99-ce9c2e54105c\") " pod="openshift-insights/insights-runtime-extractor-qmrmp" Jul 01 20:18:07.627921 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.627904 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dfcf9070-0230-4b25-ae6d-bf3c6bc51cb8-config-volume\") pod \"dns-default-5xk96\" (UID: \"dfcf9070-0230-4b25-ae6d-bf3c6bc51cb8\") " pod="openshift-dns/dns-default-5xk96" Jul 01 20:18:07.631296 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.631269 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d03b064c-b018-4fcb-9f99-ce9c2e54105c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qmrmp\" (UID: \"d03b064c-b018-4fcb-9f99-ce9c2e54105c\") " pod="openshift-insights/insights-runtime-extractor-qmrmp" Jul 01 20:18:07.631296 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.631286 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfcf9070-0230-4b25-ae6d-bf3c6bc51cb8-metrics-tls\") pod \"dns-default-5xk96\" (UID: \"dfcf9070-0230-4b25-ae6d-bf3c6bc51cb8\") " pod="openshift-dns/dns-default-5xk96" Jul 01 20:18:07.631450 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.631392 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f2457d4-e11f-44e6-b5f5-9c64fbc4eb65-cert\") pod \"ingress-canary-qx7kb\" (UID: \"5f2457d4-e11f-44e6-b5f5-9c64fbc4eb65\") " pod="openshift-ingress-canary/ingress-canary-qx7kb" Jul 01 20:18:07.635904 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.635862 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz5b8\" (UniqueName: \"kubernetes.io/projected/5f2457d4-e11f-44e6-b5f5-9c64fbc4eb65-kube-api-access-kz5b8\") pod \"ingress-canary-qx7kb\" (UID: \"5f2457d4-e11f-44e6-b5f5-9c64fbc4eb65\") " pod="openshift-ingress-canary/ingress-canary-qx7kb" Jul 01 20:18:07.636055 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.636035 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzmw4\" (UniqueName: \"kubernetes.io/projected/dfcf9070-0230-4b25-ae6d-bf3c6bc51cb8-kube-api-access-jzmw4\") pod \"dns-default-5xk96\" (UID: \"dfcf9070-0230-4b25-ae6d-bf3c6bc51cb8\") " pod="openshift-dns/dns-default-5xk96" Jul 01 20:18:07.636244 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.636221 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lgsl\" (UniqueName: \"kubernetes.io/projected/d03b064c-b018-4fcb-9f99-ce9c2e54105c-kube-api-access-2lgsl\") pod \"insights-runtime-extractor-qmrmp\" (UID: \"d03b064c-b018-4fcb-9f99-ce9c2e54105c\") " pod="openshift-insights/insights-runtime-extractor-qmrmp" Jul 01 20:18:07.766392 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.766358 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5xk96" Jul 01 20:18:07.771438 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.771410 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qmrmp" Jul 01 20:18:07.776541 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.776524 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qx7kb" Jul 01 20:18:07.993076 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:07.993040 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5xk96"] Jul 01 20:18:07.997402 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:18:07.997368 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfcf9070_0230_4b25_ae6d_bf3c6bc51cb8.slice/crio-c5c20066c6d6173453fee44d60e0cc45c1e9191a27e710902eb9c424fb123719 WatchSource:0}: Error finding container c5c20066c6d6173453fee44d60e0cc45c1e9191a27e710902eb9c424fb123719: Status 404 returned error can't find the container with id c5c20066c6d6173453fee44d60e0cc45c1e9191a27e710902eb9c424fb123719 Jul 01 20:18:08.209416 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:08.209338 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qx7kb"] Jul 01 20:18:08.212106 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:18:08.212080 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f2457d4_e11f_44e6_b5f5_9c64fbc4eb65.slice/crio-7b1dc79570be29bbd8a60673f2075b93eb6d580cee07a18486bfdd505573910c WatchSource:0}: Error finding container 7b1dc79570be29bbd8a60673f2075b93eb6d580cee07a18486bfdd505573910c: Status 404 returned error can't find the container with id 7b1dc79570be29bbd8a60673f2075b93eb6d580cee07a18486bfdd505573910c Jul 01 20:18:08.212248 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:08.212226 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qmrmp"] Jul 01 20:18:08.213149 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:08.213130 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:18:08.213250 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:08.213161 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:18:08.213338 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:08.213314 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:18:08.215263 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:08.215243 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 20:18:08.215379 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:08.215319 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f9s48\"" Jul 01 20:18:08.215439 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:08.215414 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 20:18:08.215628 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:08.215612 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 20:18:08.215628 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:08.215624 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zpvfj\"" Jul 01 20:18:08.215880 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:08.215861 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 20:18:08.216415 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:18:08.216343 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd03b064c_b018_4fcb_9f99_ce9c2e54105c.slice/crio-d7d76db76609cdbb134ce460d07da324dcf4dff1b551d32c6a4f462664bb03cf WatchSource:0}: Error finding container d7d76db76609cdbb134ce460d07da324dcf4dff1b551d32c6a4f462664bb03cf: Status 404 returned error can't find the container with id d7d76db76609cdbb134ce460d07da324dcf4dff1b551d32c6a4f462664bb03cf Jul 01 20:18:08.496996 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:08.496913 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5xk96" event={"ID":"dfcf9070-0230-4b25-ae6d-bf3c6bc51cb8","Type":"ContainerStarted","Data":"c5c20066c6d6173453fee44d60e0cc45c1e9191a27e710902eb9c424fb123719"} Jul 01 20:18:08.498299 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:08.498266 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qx7kb" event={"ID":"5f2457d4-e11f-44e6-b5f5-9c64fbc4eb65","Type":"ContainerStarted","Data":"7b1dc79570be29bbd8a60673f2075b93eb6d580cee07a18486bfdd505573910c"} Jul 01 20:18:08.499479 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:08.499441 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qmrmp" event={"ID":"d03b064c-b018-4fcb-9f99-ce9c2e54105c","Type":"ContainerStarted","Data":"d7d76db76609cdbb134ce460d07da324dcf4dff1b551d32c6a4f462664bb03cf"} Jul 01 20:18:10.114191 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:10.114158 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5499b6fb8f-jm497"] Jul 01 20:18:10.128743 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:10.128712 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-jm497"] Jul 01 20:18:10.128897 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:10.128832 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-jm497" Jul 01 20:18:10.131024 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:10.130866 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 01 20:18:10.131024 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:10.130884 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-9w5j9\"" Jul 01 20:18:10.131234 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:10.131172 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 01 20:18:10.247338 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:10.247292 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpttk\" (UniqueName: \"kubernetes.io/projected/ed516f34-b8e5-486f-8da5-c30216e8ab7b-kube-api-access-hpttk\") pod \"downloads-5499b6fb8f-jm497\" (UID: \"ed516f34-b8e5-486f-8da5-c30216e8ab7b\") " pod="openshift-console/downloads-5499b6fb8f-jm497" Jul 01 20:18:10.347920 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:10.347887 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpttk\" (UniqueName: \"kubernetes.io/projected/ed516f34-b8e5-486f-8da5-c30216e8ab7b-kube-api-access-hpttk\") pod \"downloads-5499b6fb8f-jm497\" (UID: \"ed516f34-b8e5-486f-8da5-c30216e8ab7b\") " pod="openshift-console/downloads-5499b6fb8f-jm497" Jul 01 20:18:10.355361 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:10.355339 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpttk\" (UniqueName: \"kubernetes.io/projected/ed516f34-b8e5-486f-8da5-c30216e8ab7b-kube-api-access-hpttk\") pod \"downloads-5499b6fb8f-jm497\" (UID: \"ed516f34-b8e5-486f-8da5-c30216e8ab7b\") " pod="openshift-console/downloads-5499b6fb8f-jm497" Jul 01 20:18:10.442106 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:10.442024 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-jm497" Jul 01 20:18:10.951481 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:10.951442 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c64a3366-7257-45a2-b9e8-1db08d59c81a-original-pull-secret\") pod \"global-pull-secret-syncer-n8j6z\" (UID: \"c64a3366-7257-45a2-b9e8-1db08d59c81a\") " pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:18:10.954118 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:10.954093 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c64a3366-7257-45a2-b9e8-1db08d59c81a-original-pull-secret\") pod \"global-pull-secret-syncer-n8j6z\" (UID: \"c64a3366-7257-45a2-b9e8-1db08d59c81a\") " pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:18:11.052429 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:11.052389 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0077ab1f-92a9-4220-a3bd-cb3af8897040-metrics-certs\") pod \"network-metrics-daemon-krqwd\" (UID: \"0077ab1f-92a9-4220-a3bd-cb3af8897040\") " pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:18:11.055267 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:11.055237 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0077ab1f-92a9-4220-a3bd-cb3af8897040-metrics-certs\") pod \"network-metrics-daemon-krqwd\" (UID: \"0077ab1f-92a9-4220-a3bd-cb3af8897040\") " pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:18:11.152775 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:11.152741 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjcnm\" (UniqueName: \"kubernetes.io/projected/722add9e-cb45-46a9-86a3-28786a7afc60-kube-api-access-bjcnm\") pod \"network-check-target-tw94d\" (UID: \"722add9e-cb45-46a9-86a3-28786a7afc60\") " pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:18:11.154977 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:11.154951 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjcnm\" (UniqueName: \"kubernetes.io/projected/722add9e-cb45-46a9-86a3-28786a7afc60-kube-api-access-bjcnm\") pod \"network-check-target-tw94d\" (UID: \"722add9e-cb45-46a9-86a3-28786a7afc60\") " pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:18:11.227512 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:11.227417 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:18:11.232519 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:11.232495 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krqwd" Jul 01 20:18:11.237770 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:11.237751 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8j6z" Jul 01 20:18:13.446858 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:13.446832 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mfbr" Jul 01 20:18:14.109662 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:14.109630 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tw94d"] Jul 01 20:18:14.113476 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:18:14.113451 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod722add9e_cb45_46a9_86a3_28786a7afc60.slice/crio-dd083aba50912e29518c462e9b0ebdc5e6be58cb1b40a72454944dd95a9fd34e WatchSource:0}: Error finding container dd083aba50912e29518c462e9b0ebdc5e6be58cb1b40a72454944dd95a9fd34e: Status 404 returned error can't find the container with id dd083aba50912e29518c462e9b0ebdc5e6be58cb1b40a72454944dd95a9fd34e Jul 01 20:18:14.339272 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:14.339242 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n8j6z"] Jul 01 20:18:14.343473 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:14.343389 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-jm497"] Jul 01 20:18:14.343825 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:14.343758 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-krqwd"] Jul 01 20:18:14.352083 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:18:14.352059 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0077ab1f_92a9_4220_a3bd_cb3af8897040.slice/crio-0e62d2a808e823d94df988aa4aed8ce77e6b860034b973fb2a1f51e316b5092f WatchSource:0}: Error finding container 0e62d2a808e823d94df988aa4aed8ce77e6b860034b973fb2a1f51e316b5092f: Status 404 returned error can't find the container with id 0e62d2a808e823d94df988aa4aed8ce77e6b860034b973fb2a1f51e316b5092f Jul 01 20:18:14.516534 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:14.516491 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5xk96" event={"ID":"dfcf9070-0230-4b25-ae6d-bf3c6bc51cb8","Type":"ContainerStarted","Data":"7003d2646c1393be86ca97be1d38e2ff7a96b8270651cee2deebe8f98e7726bb"} Jul 01 20:18:14.516983 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:14.516557 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5xk96" event={"ID":"dfcf9070-0230-4b25-ae6d-bf3c6bc51cb8","Type":"ContainerStarted","Data":"ff461f73e6edd20fff979d236ce53f5c792ad27b2eaee559e090d4a5c36968a2"} Jul 01 20:18:14.516983 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:14.516605 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5xk96" Jul 01 20:18:14.517698 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:14.517676 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tw94d" event={"ID":"722add9e-cb45-46a9-86a3-28786a7afc60","Type":"ContainerStarted","Data":"dd083aba50912e29518c462e9b0ebdc5e6be58cb1b40a72454944dd95a9fd34e"} Jul 01 20:18:14.518672 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:14.518652 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-jm497" event={"ID":"ed516f34-b8e5-486f-8da5-c30216e8ab7b","Type":"ContainerStarted","Data":"4c2e45e3ba73d31c278c996ea0fb03def7e2b390b19de86e9095fcdac411fdcb"} Jul 01 20:18:14.519769 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:14.519745 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n8j6z" event={"ID":"c64a3366-7257-45a2-b9e8-1db08d59c81a","Type":"ContainerStarted","Data":"4856ee24fbd56cc0b3b96c3cab32524f67b898f7792fbbc959a89c5f06311f04"} Jul 01 20:18:14.521128 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:14.521111 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qx7kb" event={"ID":"5f2457d4-e11f-44e6-b5f5-9c64fbc4eb65","Type":"ContainerStarted","Data":"4e9c32325bafb4357b68754ce8a3d32f3a4395b2acb836c6377ab6b699cae695"} Jul 01 20:18:14.522474 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:14.522455 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qmrmp" event={"ID":"d03b064c-b018-4fcb-9f99-ce9c2e54105c","Type":"ContainerStarted","Data":"30dd8bc9b2442de1280af4e1550bcea1b094cdf791116060fe39877a3486001c"} Jul 01 20:18:14.523456 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:14.523439 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-krqwd" event={"ID":"0077ab1f-92a9-4220-a3bd-cb3af8897040","Type":"ContainerStarted","Data":"0e62d2a808e823d94df988aa4aed8ce77e6b860034b973fb2a1f51e316b5092f"} Jul 01 20:18:14.536395 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:14.536305 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5xk96" podStartSLOduration=1.987748607 podStartE2EDuration="7.536293067s" totalImagesPullingTime="5.54854446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:18:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:14.535771647 +0000 UTC m=+68.756264597" watchObservedRunningTime="2026-07-01 20:18:14.536293067 +0000 UTC m=+68.756786016" Jul 01 20:18:14.551533 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:14.551493 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qx7kb" podStartSLOduration=1.8167150680000002 podStartE2EDuration="7.551481108s" totalImagesPullingTime="5.73476604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:18:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:14.550694251 +0000 UTC m=+68.771187200" watchObservedRunningTime="2026-07-01 20:18:14.551481108 +0000 UTC m=+68.771974036" Jul 01 20:18:15.620863 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.620826 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85cd6fbb5-mr79t"] Jul 01 20:18:15.638147 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.637243 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85cd6fbb5-mr79t"] Jul 01 20:18:15.638147 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.637415 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85cd6fbb5-mr79t" Jul 01 20:18:15.640303 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.639892 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 01 20:18:15.640303 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.639998 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 01 20:18:15.640303 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.640097 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 01 20:18:15.640303 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.640188 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-48cxh\"" Jul 01 20:18:15.640303 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.640267 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 01 20:18:15.640583 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.640400 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 01 20:18:15.685617 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.685586 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft2vv\" (UniqueName: \"kubernetes.io/projected/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-kube-api-access-ft2vv\") pod \"console-85cd6fbb5-mr79t\" (UID: \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\") " pod="openshift-console/console-85cd6fbb5-mr79t" Jul 01 20:18:15.685786 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.685658 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-console-oauth-config\") pod \"console-85cd6fbb5-mr79t\" (UID: \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\") " pod="openshift-console/console-85cd6fbb5-mr79t" Jul 01 20:18:15.685786 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.685714 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-console-serving-cert\") pod \"console-85cd6fbb5-mr79t\" (UID: \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\") " pod="openshift-console/console-85cd6fbb5-mr79t" Jul 01 20:18:15.685786 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.685740 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-service-ca\") pod \"console-85cd6fbb5-mr79t\" (UID: \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\") " pod="openshift-console/console-85cd6fbb5-mr79t" Jul 01 20:18:15.685786 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.685770 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-console-config\") pod \"console-85cd6fbb5-mr79t\" (UID: \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\") " pod="openshift-console/console-85cd6fbb5-mr79t" Jul 01 20:18:15.686009 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.685792 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-oauth-serving-cert\") pod \"console-85cd6fbb5-mr79t\" (UID: \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\") " pod="openshift-console/console-85cd6fbb5-mr79t" Jul 01 20:18:15.786643 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.786605 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-console-serving-cert\") pod \"console-85cd6fbb5-mr79t\" (UID: \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\") " pod="openshift-console/console-85cd6fbb5-mr79t" Jul 01 20:18:15.786817 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.786655 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-service-ca\") pod \"console-85cd6fbb5-mr79t\" (UID: \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\") " pod="openshift-console/console-85cd6fbb5-mr79t" Jul 01 20:18:15.786817 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.786693 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-console-config\") pod \"console-85cd6fbb5-mr79t\" (UID: \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\") " pod="openshift-console/console-85cd6fbb5-mr79t" Jul 01 20:18:15.786817 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.786718 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-oauth-serving-cert\") pod \"console-85cd6fbb5-mr79t\" (UID: \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\") " pod="openshift-console/console-85cd6fbb5-mr79t" Jul 01 20:18:15.786817 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.786748 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft2vv\" (UniqueName: \"kubernetes.io/projected/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-kube-api-access-ft2vv\") pod \"console-85cd6fbb5-mr79t\" (UID: \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\") " pod="openshift-console/console-85cd6fbb5-mr79t" Jul 01 20:18:15.786817 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.786795 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-console-oauth-config\") pod \"console-85cd6fbb5-mr79t\" (UID: \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\") " pod="openshift-console/console-85cd6fbb5-mr79t" Jul 01 20:18:15.788393 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.787723 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-service-ca\") pod \"console-85cd6fbb5-mr79t\" (UID: \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\") " pod="openshift-console/console-85cd6fbb5-mr79t" Jul 01 20:18:15.788393 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.788295 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-console-config\") pod \"console-85cd6fbb5-mr79t\" (UID: \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\") " pod="openshift-console/console-85cd6fbb5-mr79t" Jul 01 20:18:15.789871 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.789834 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-oauth-serving-cert\") pod \"console-85cd6fbb5-mr79t\" (UID: \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\") " pod="openshift-console/console-85cd6fbb5-mr79t" Jul 01 20:18:15.792405 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.790298 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-console-serving-cert\") pod \"console-85cd6fbb5-mr79t\" (UID: \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\") " pod="openshift-console/console-85cd6fbb5-mr79t" Jul 01 20:18:15.792405 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.791422 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-6zfwj"] Jul 01 20:18:15.793584 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.793542 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-console-oauth-config\") pod \"console-85cd6fbb5-mr79t\" (UID: \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\") " pod="openshift-console/console-85cd6fbb5-mr79t" Jul 01 20:18:15.804261 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.803920 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft2vv\" (UniqueName: \"kubernetes.io/projected/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-kube-api-access-ft2vv\") pod \"console-85cd6fbb5-mr79t\" (UID: \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\") " pod="openshift-console/console-85cd6fbb5-mr79t" Jul 01 20:18:15.811495 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.811470 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-6zfwj"] Jul 01 20:18:15.811627 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.811608 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-6zfwj" Jul 01 20:18:15.814103 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.813995 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 01 20:18:15.814103 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.814000 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 20:18:15.814103 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.814048 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jgvht\"" Jul 01 20:18:15.814103 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.814071 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 20:18:15.814103 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.814085 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 20:18:15.814466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.814421 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 01 20:18:15.887847 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.887749 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9b506aa-a0df-4d96-a5cd-5748a5352df2-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-6zfwj\" (UID: \"f9b506aa-a0df-4d96-a5cd-5748a5352df2\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-6zfwj" Jul 01 20:18:15.887847 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.887794 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9b506aa-a0df-4d96-a5cd-5748a5352df2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-6zfwj\" (UID: \"f9b506aa-a0df-4d96-a5cd-5748a5352df2\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-6zfwj" Jul 01 20:18:15.887847 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.887827 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9b506aa-a0df-4d96-a5cd-5748a5352df2-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-6zfwj\" (UID: \"f9b506aa-a0df-4d96-a5cd-5748a5352df2\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-6zfwj" Jul 01 20:18:15.888100 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.887863 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhh5q\" (UniqueName: \"kubernetes.io/projected/f9b506aa-a0df-4d96-a5cd-5748a5352df2-kube-api-access-nhh5q\") pod \"prometheus-operator-7b7d896497-6zfwj\" (UID: \"f9b506aa-a0df-4d96-a5cd-5748a5352df2\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-6zfwj" Jul 01 20:18:15.952111 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.952083 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85cd6fbb5-mr79t" Jul 01 20:18:15.989274 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.988543 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9b506aa-a0df-4d96-a5cd-5748a5352df2-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-6zfwj\" (UID: \"f9b506aa-a0df-4d96-a5cd-5748a5352df2\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-6zfwj" Jul 01 20:18:15.989274 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.988588 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9b506aa-a0df-4d96-a5cd-5748a5352df2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-6zfwj\" (UID: \"f9b506aa-a0df-4d96-a5cd-5748a5352df2\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-6zfwj" Jul 01 20:18:15.989274 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.988620 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9b506aa-a0df-4d96-a5cd-5748a5352df2-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-6zfwj\" (UID: \"f9b506aa-a0df-4d96-a5cd-5748a5352df2\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-6zfwj" Jul 01 20:18:15.989274 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.988653 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhh5q\" (UniqueName: \"kubernetes.io/projected/f9b506aa-a0df-4d96-a5cd-5748a5352df2-kube-api-access-nhh5q\") pod \"prometheus-operator-7b7d896497-6zfwj\" (UID: \"f9b506aa-a0df-4d96-a5cd-5748a5352df2\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-6zfwj" Jul 01 20:18:15.989578 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.989436 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9b506aa-a0df-4d96-a5cd-5748a5352df2-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-6zfwj\" (UID: \"f9b506aa-a0df-4d96-a5cd-5748a5352df2\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-6zfwj" Jul 01 20:18:15.991762 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.991725 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9b506aa-a0df-4d96-a5cd-5748a5352df2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-6zfwj\" (UID: \"f9b506aa-a0df-4d96-a5cd-5748a5352df2\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-6zfwj" Jul 01 20:18:15.996114 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.996086 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9b506aa-a0df-4d96-a5cd-5748a5352df2-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-6zfwj\" (UID: \"f9b506aa-a0df-4d96-a5cd-5748a5352df2\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-6zfwj" Jul 01 20:18:15.998203 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:15.998158 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhh5q\" (UniqueName: \"kubernetes.io/projected/f9b506aa-a0df-4d96-a5cd-5748a5352df2-kube-api-access-nhh5q\") pod \"prometheus-operator-7b7d896497-6zfwj\" (UID: \"f9b506aa-a0df-4d96-a5cd-5748a5352df2\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-6zfwj" Jul 01 20:18:16.123710 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:16.123620 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-6zfwj" Jul 01 20:18:16.338908 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:16.338880 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-6zfwj"] Jul 01 20:18:16.347059 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:18:16.347028 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9b506aa_a0df_4d96_a5cd_5748a5352df2.slice/crio-03a5311902c0eae241d418c7f357092e3b27fe1f4bb8c2c5bdeb302e94c64016 WatchSource:0}: Error finding container 03a5311902c0eae241d418c7f357092e3b27fe1f4bb8c2c5bdeb302e94c64016: Status 404 returned error can't find the container with id 03a5311902c0eae241d418c7f357092e3b27fe1f4bb8c2c5bdeb302e94c64016 Jul 01 20:18:16.354229 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:16.354201 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85cd6fbb5-mr79t"] Jul 01 20:18:16.359306 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:18:16.359279 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4e1d64b_5c14_4934_80ca_7aaf4a1f757c.slice/crio-0a4b2ba1b1c54ec012f7d7eec2efef23025c1b6ea1b0fc24abebfacb4e5af76b WatchSource:0}: Error finding container 0a4b2ba1b1c54ec012f7d7eec2efef23025c1b6ea1b0fc24abebfacb4e5af76b: Status 404 returned error can't find the container with id 0a4b2ba1b1c54ec012f7d7eec2efef23025c1b6ea1b0fc24abebfacb4e5af76b Jul 01 20:18:16.532832 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:16.532795 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qmrmp" event={"ID":"d03b064c-b018-4fcb-9f99-ce9c2e54105c","Type":"ContainerStarted","Data":"b0cc915569baddf924a98b50459de95f27b3eb0ac7cf033814995ede58a96b43"} Jul 01 20:18:16.534384 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:16.534356 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-krqwd" event={"ID":"0077ab1f-92a9-4220-a3bd-cb3af8897040","Type":"ContainerStarted","Data":"29b3c903801e940cdf81842ad15a8e43c976bd9ad0153b0532e033e2ccbe7798"} Jul 01 20:18:16.535645 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:16.535623 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-6zfwj" event={"ID":"f9b506aa-a0df-4d96-a5cd-5748a5352df2","Type":"ContainerStarted","Data":"03a5311902c0eae241d418c7f357092e3b27fe1f4bb8c2c5bdeb302e94c64016"} Jul 01 20:18:16.536834 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:16.536805 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85cd6fbb5-mr79t" event={"ID":"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c","Type":"ContainerStarted","Data":"0a4b2ba1b1c54ec012f7d7eec2efef23025c1b6ea1b0fc24abebfacb4e5af76b"} Jul 01 20:18:17.543775 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:17.543736 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-krqwd" event={"ID":"0077ab1f-92a9-4220-a3bd-cb3af8897040","Type":"ContainerStarted","Data":"aea07c0033aece7afb3e86464dcdeb137811a2c82e0046991b16f7600099e170"} Jul 01 20:18:17.560164 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:17.560098 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-krqwd" podStartSLOduration=68.755573592 podStartE2EDuration="1m10.560077427s" totalImagesPullingTime="1.804503835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:17:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:17.55980647 +0000 UTC m=+71.780299423" watchObservedRunningTime="2026-07-01 20:18:17.560077427 +0000 UTC m=+71.780570376" Jul 01 20:18:23.223375 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.223077 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-89776bd98-c52dp"] Jul 01 20:18:23.225266 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.225245 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-89776bd98-c52dp" Jul 01 20:18:23.244656 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.244625 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-89776bd98-c52dp"] Jul 01 20:18:23.246211 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.246186 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 01 20:18:23.347871 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.347835 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36304709-2f6a-4a99-aa15-606ce43c0e84-oauth-serving-cert\") pod \"console-89776bd98-c52dp\" (UID: \"36304709-2f6a-4a99-aa15-606ce43c0e84\") " pod="openshift-console/console-89776bd98-c52dp" Jul 01 20:18:23.348036 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.347899 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2qk8\" (UniqueName: \"kubernetes.io/projected/36304709-2f6a-4a99-aa15-606ce43c0e84-kube-api-access-t2qk8\") pod \"console-89776bd98-c52dp\" (UID: \"36304709-2f6a-4a99-aa15-606ce43c0e84\") " pod="openshift-console/console-89776bd98-c52dp" Jul 01 20:18:23.348036 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.347924 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36304709-2f6a-4a99-aa15-606ce43c0e84-console-config\") pod \"console-89776bd98-c52dp\" (UID: \"36304709-2f6a-4a99-aa15-606ce43c0e84\") " pod="openshift-console/console-89776bd98-c52dp" Jul 01 20:18:23.348036 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.347967 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36304709-2f6a-4a99-aa15-606ce43c0e84-console-oauth-config\") pod \"console-89776bd98-c52dp\" (UID: \"36304709-2f6a-4a99-aa15-606ce43c0e84\") " pod="openshift-console/console-89776bd98-c52dp" Jul 01 20:18:23.348036 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.347996 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36304709-2f6a-4a99-aa15-606ce43c0e84-trusted-ca-bundle\") pod \"console-89776bd98-c52dp\" (UID: \"36304709-2f6a-4a99-aa15-606ce43c0e84\") " pod="openshift-console/console-89776bd98-c52dp" Jul 01 20:18:23.348036 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.348016 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36304709-2f6a-4a99-aa15-606ce43c0e84-console-serving-cert\") pod \"console-89776bd98-c52dp\" (UID: \"36304709-2f6a-4a99-aa15-606ce43c0e84\") " pod="openshift-console/console-89776bd98-c52dp" Jul 01 20:18:23.348233 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.348056 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36304709-2f6a-4a99-aa15-606ce43c0e84-service-ca\") pod \"console-89776bd98-c52dp\" (UID: \"36304709-2f6a-4a99-aa15-606ce43c0e84\") " pod="openshift-console/console-89776bd98-c52dp" Jul 01 20:18:23.449190 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.449149 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36304709-2f6a-4a99-aa15-606ce43c0e84-trusted-ca-bundle\") pod \"console-89776bd98-c52dp\" (UID: \"36304709-2f6a-4a99-aa15-606ce43c0e84\") " pod="openshift-console/console-89776bd98-c52dp" Jul 01 20:18:23.449398 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.449199 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36304709-2f6a-4a99-aa15-606ce43c0e84-console-serving-cert\") pod \"console-89776bd98-c52dp\" (UID: \"36304709-2f6a-4a99-aa15-606ce43c0e84\") " pod="openshift-console/console-89776bd98-c52dp" Jul 01 20:18:23.449398 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.449223 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36304709-2f6a-4a99-aa15-606ce43c0e84-service-ca\") pod \"console-89776bd98-c52dp\" (UID: \"36304709-2f6a-4a99-aa15-606ce43c0e84\") " pod="openshift-console/console-89776bd98-c52dp" Jul 01 20:18:23.449398 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.449250 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36304709-2f6a-4a99-aa15-606ce43c0e84-oauth-serving-cert\") pod \"console-89776bd98-c52dp\" (UID: \"36304709-2f6a-4a99-aa15-606ce43c0e84\") " pod="openshift-console/console-89776bd98-c52dp" Jul 01 20:18:23.449398 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.449303 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2qk8\" (UniqueName: \"kubernetes.io/projected/36304709-2f6a-4a99-aa15-606ce43c0e84-kube-api-access-t2qk8\") pod \"console-89776bd98-c52dp\" (UID: \"36304709-2f6a-4a99-aa15-606ce43c0e84\") " pod="openshift-console/console-89776bd98-c52dp" Jul 01 20:18:23.449398 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.449346 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36304709-2f6a-4a99-aa15-606ce43c0e84-console-config\") pod \"console-89776bd98-c52dp\" (UID: \"36304709-2f6a-4a99-aa15-606ce43c0e84\") " pod="openshift-console/console-89776bd98-c52dp" Jul 01 20:18:23.449398 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.449379 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36304709-2f6a-4a99-aa15-606ce43c0e84-console-oauth-config\") pod \"console-89776bd98-c52dp\" (UID: \"36304709-2f6a-4a99-aa15-606ce43c0e84\") " pod="openshift-console/console-89776bd98-c52dp" Jul 01 20:18:23.450147 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.450114 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36304709-2f6a-4a99-aa15-606ce43c0e84-service-ca\") pod \"console-89776bd98-c52dp\" (UID: \"36304709-2f6a-4a99-aa15-606ce43c0e84\") " pod="openshift-console/console-89776bd98-c52dp" Jul 01 20:18:23.450259 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.450179 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36304709-2f6a-4a99-aa15-606ce43c0e84-trusted-ca-bundle\") pod \"console-89776bd98-c52dp\" (UID: \"36304709-2f6a-4a99-aa15-606ce43c0e84\") " pod="openshift-console/console-89776bd98-c52dp" Jul 01 20:18:23.450349 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.450263 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36304709-2f6a-4a99-aa15-606ce43c0e84-console-config\") pod \"console-89776bd98-c52dp\" (UID: \"36304709-2f6a-4a99-aa15-606ce43c0e84\") " pod="openshift-console/console-89776bd98-c52dp" Jul 01 20:18:23.450349 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.450263 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36304709-2f6a-4a99-aa15-606ce43c0e84-oauth-serving-cert\") pod \"console-89776bd98-c52dp\" (UID: \"36304709-2f6a-4a99-aa15-606ce43c0e84\") " pod="openshift-console/console-89776bd98-c52dp" Jul 01 20:18:23.451975 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.451947 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36304709-2f6a-4a99-aa15-606ce43c0e84-console-oauth-config\") pod \"console-89776bd98-c52dp\" (UID: \"36304709-2f6a-4a99-aa15-606ce43c0e84\") " pod="openshift-console/console-89776bd98-c52dp" Jul 01 20:18:23.452073 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.452025 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36304709-2f6a-4a99-aa15-606ce43c0e84-console-serving-cert\") pod \"console-89776bd98-c52dp\" (UID: \"36304709-2f6a-4a99-aa15-606ce43c0e84\") " pod="openshift-console/console-89776bd98-c52dp" Jul 01 20:18:23.458230 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.458208 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2qk8\" (UniqueName: \"kubernetes.io/projected/36304709-2f6a-4a99-aa15-606ce43c0e84-kube-api-access-t2qk8\") pod \"console-89776bd98-c52dp\" (UID: \"36304709-2f6a-4a99-aa15-606ce43c0e84\") " pod="openshift-console/console-89776bd98-c52dp" Jul 01 20:18:23.548216 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.548133 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-89776bd98-c52dp" Jul 01 20:18:23.570840 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.570796 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qmrmp" event={"ID":"d03b064c-b018-4fcb-9f99-ce9c2e54105c","Type":"ContainerStarted","Data":"081087a43b99e41b302fd741e95887c06dc70f8da963090197c28019a8521324"} Jul 01 20:18:23.572678 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.572651 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tw94d" event={"ID":"722add9e-cb45-46a9-86a3-28786a7afc60","Type":"ContainerStarted","Data":"12eb2b00355d6af0d98c75d2aa874d6cf86eb6dedb534daf7e828cdf868c7b13"} Jul 01 20:18:23.572821 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.572714 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:18:23.574929 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.574903 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-6zfwj" event={"ID":"f9b506aa-a0df-4d96-a5cd-5748a5352df2","Type":"ContainerStarted","Data":"74a921701112f33c3568951292200e8f85bb082720fb5b26acf741f145ebd23e"} Jul 01 20:18:23.575030 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.574951 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-6zfwj" event={"ID":"f9b506aa-a0df-4d96-a5cd-5748a5352df2","Type":"ContainerStarted","Data":"8661128b34f365da344aa6626e04eba22967089f83c065f9097168129cf6a187"} Jul 01 20:18:23.577183 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.577160 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85cd6fbb5-mr79t" event={"ID":"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c","Type":"ContainerStarted","Data":"5953146e9081f88ca77d7f01db07051c6c2a52d8576a7143edd5ca088daf6029"} Jul 01 20:18:23.578804 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.578778 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n8j6z" event={"ID":"c64a3366-7257-45a2-b9e8-1db08d59c81a","Type":"ContainerStarted","Data":"d8ef70628d10c7d87ec34403b1e4aaa50027448c22bc8504b133fc7dc58de34d"} Jul 01 20:18:23.589615 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.589564 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qmrmp" podStartSLOduration=2.237217754 podStartE2EDuration="16.58954563s" totalImagesPullingTime="14.352327876s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:18:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:23.588797712 +0000 UTC m=+77.809290698" watchObservedRunningTime="2026-07-01 20:18:23.58954563 +0000 UTC m=+77.810038582" Jul 01 20:18:23.608191 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.607568 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7b7d896497-6zfwj" podStartSLOduration=2.047952585 podStartE2EDuration="8.607546772s" totalImagesPullingTime="6.559594187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:18:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:23.6063957 +0000 UTC m=+77.826888650" watchObservedRunningTime="2026-07-01 20:18:23.607546772 +0000 UTC m=+77.828039719" Jul 01 20:18:23.626302 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.626237 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85cd6fbb5-mr79t" podStartSLOduration=2.064995199 podStartE2EDuration="8.626216051s" totalImagesPullingTime="6.561220852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:18:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:23.625527229 +0000 UTC m=+77.846020179" watchObservedRunningTime="2026-07-01 20:18:23.626216051 +0000 UTC m=+77.846709001" Jul 01 20:18:23.644666 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.644600 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-n8j6z" podStartSLOduration=68.081804881 podStartE2EDuration="1m16.644490612s" totalImagesPullingTime="8.562685731s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:17:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:23.644012571 +0000 UTC m=+77.864505522" watchObservedRunningTime="2026-07-01 20:18:23.644490612 +0000 UTC m=+77.864983560" Jul 01 20:18:23.670465 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.670414 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tw94d" podStartSLOduration=67.884131084 podStartE2EDuration="1m16.670396793s" totalImagesPullingTime="8.786265709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:17:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:23.669556915 +0000 UTC m=+77.890049865" watchObservedRunningTime="2026-07-01 20:18:23.670396793 +0000 UTC m=+77.890889742" Jul 01 20:18:23.696601 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:23.696564 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-89776bd98-c52dp"] Jul 01 20:18:23.700899 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:18:23.700865 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36304709_2f6a_4a99_aa15_606ce43c0e84.slice/crio-38609a384161f33930788f5469e6aa4aa4843a7ad13ce98678da80362ba3ae55 WatchSource:0}: Error finding container 38609a384161f33930788f5469e6aa4aa4843a7ad13ce98678da80362ba3ae55: Status 404 returned error can't find the container with id 38609a384161f33930788f5469e6aa4aa4843a7ad13ce98678da80362ba3ae55 Jul 01 20:18:24.529127 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:24.529099 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5xk96" Jul 01 20:18:24.585033 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:24.584952 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-89776bd98-c52dp" event={"ID":"36304709-2f6a-4a99-aa15-606ce43c0e84","Type":"ContainerStarted","Data":"a459ce71567d1beedd619fa4e61b1ad4ac41277403d191809e39b3eb3f2c2696"} Jul 01 20:18:24.585033 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:24.585020 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-89776bd98-c52dp" event={"ID":"36304709-2f6a-4a99-aa15-606ce43c0e84","Type":"ContainerStarted","Data":"38609a384161f33930788f5469e6aa4aa4843a7ad13ce98678da80362ba3ae55"} Jul 01 20:18:24.602592 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:24.602540 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-89776bd98-c52dp" podStartSLOduration=1.602523565 podStartE2EDuration="1.602523565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:18:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:24.601003446 +0000 UTC m=+78.821496396" watchObservedRunningTime="2026-07-01 20:18:24.602523565 +0000 UTC m=+78.823016505" Jul 01 20:18:25.123525 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.123488 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-8wrjj"] Jul 01 20:18:25.125790 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.125774 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-8wrjj" Jul 01 20:18:25.127890 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.127862 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 01 20:18:25.128170 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.128153 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 01 20:18:25.131075 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.130900 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-hc6xz\"" Jul 01 20:18:25.133244 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.133227 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-2brj6"] Jul 01 20:18:25.135386 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.135367 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-2brj6" Jul 01 20:18:25.137800 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.137781 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 01 20:18:25.137978 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.137956 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 01 20:18:25.138507 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.138275 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 01 20:18:25.138507 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.138304 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-q6m6w\"" Jul 01 20:18:25.143374 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.143353 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-8wrjj"] Jul 01 20:18:25.164411 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.148922 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-2brj6"] Jul 01 20:18:25.164411 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.163053 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5k7vc"] Jul 01 20:18:25.172344 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.165848 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5k7vc" Jul 01 20:18:25.173350 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.173311 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-x9pq4\"" Jul 01 20:18:25.173609 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.173591 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 20:18:25.173798 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.173780 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 20:18:25.174163 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.174000 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 20:18:25.268912 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.268876 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6f7e9e75-3c51-4903-a19b-2003b141a539-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-2brj6\" (UID: \"6f7e9e75-3c51-4903-a19b-2003b141a539\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2brj6" Jul 01 20:18:25.268912 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.268913 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5c59fd4-21b1-454d-8c4e-32f9316a2976-sys\") pod \"node-exporter-5k7vc\" (UID: \"b5c59fd4-21b1-454d-8c4e-32f9316a2976\") " pod="openshift-monitoring/node-exporter-5k7vc" Jul 01 20:18:25.269134 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.268936 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsnd6\" (UniqueName: \"kubernetes.io/projected/b5c59fd4-21b1-454d-8c4e-32f9316a2976-kube-api-access-vsnd6\") pod \"node-exporter-5k7vc\" (UID: \"b5c59fd4-21b1-454d-8c4e-32f9316a2976\") " pod="openshift-monitoring/node-exporter-5k7vc" Jul 01 20:18:25.269134 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.269011 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f7e9e75-3c51-4903-a19b-2003b141a539-metrics-client-ca\") pod \"kube-state-metrics-845b954455-2brj6\" (UID: \"6f7e9e75-3c51-4903-a19b-2003b141a539\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2brj6" Jul 01 20:18:25.269134 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.269055 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b5c59fd4-21b1-454d-8c4e-32f9316a2976-node-exporter-wtmp\") pod \"node-exporter-5k7vc\" (UID: \"b5c59fd4-21b1-454d-8c4e-32f9316a2976\") " pod="openshift-monitoring/node-exporter-5k7vc" Jul 01 20:18:25.269134 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.269111 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/591ce368-d097-4cea-85b8-f93d96f66878-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-8wrjj\" (UID: \"591ce368-d097-4cea-85b8-f93d96f66878\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-8wrjj" Jul 01 20:18:25.269285 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.269143 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b5c59fd4-21b1-454d-8c4e-32f9316a2976-node-exporter-textfile\") pod \"node-exporter-5k7vc\" (UID: \"b5c59fd4-21b1-454d-8c4e-32f9316a2976\") " pod="openshift-monitoring/node-exporter-5k7vc" Jul 01 20:18:25.269285 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.269162 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5c59fd4-21b1-454d-8c4e-32f9316a2976-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5k7vc\" (UID: \"b5c59fd4-21b1-454d-8c4e-32f9316a2976\") " pod="openshift-monitoring/node-exporter-5k7vc" Jul 01 20:18:25.269285 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.269200 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnwzc\" (UniqueName: \"kubernetes.io/projected/591ce368-d097-4cea-85b8-f93d96f66878-kube-api-access-xnwzc\") pod \"openshift-state-metrics-57f99c8b49-8wrjj\" (UID: \"591ce368-d097-4cea-85b8-f93d96f66878\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-8wrjj" Jul 01 20:18:25.269285 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.269228 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz9t5\" (UniqueName: \"kubernetes.io/projected/6f7e9e75-3c51-4903-a19b-2003b141a539-kube-api-access-cz9t5\") pod \"kube-state-metrics-845b954455-2brj6\" (UID: \"6f7e9e75-3c51-4903-a19b-2003b141a539\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2brj6" Jul 01 20:18:25.269285 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.269254 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b5c59fd4-21b1-454d-8c4e-32f9316a2976-node-exporter-tls\") pod \"node-exporter-5k7vc\" (UID: \"b5c59fd4-21b1-454d-8c4e-32f9316a2976\") " pod="openshift-monitoring/node-exporter-5k7vc" Jul 01 20:18:25.269509 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.269287 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f7e9e75-3c51-4903-a19b-2003b141a539-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-2brj6\" (UID: \"6f7e9e75-3c51-4903-a19b-2003b141a539\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2brj6" Jul 01 20:18:25.269509 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.269365 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/591ce368-d097-4cea-85b8-f93d96f66878-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-8wrjj\" (UID: \"591ce368-d097-4cea-85b8-f93d96f66878\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-8wrjj" Jul 01 20:18:25.269509 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.269431 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/591ce368-d097-4cea-85b8-f93d96f66878-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-8wrjj\" (UID: \"591ce368-d097-4cea-85b8-f93d96f66878\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-8wrjj" Jul 01 20:18:25.269509 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.269460 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f7e9e75-3c51-4903-a19b-2003b141a539-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-2brj6\" (UID: \"6f7e9e75-3c51-4903-a19b-2003b141a539\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2brj6" Jul 01 20:18:25.269509 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.269493 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b5c59fd4-21b1-454d-8c4e-32f9316a2976-root\") pod \"node-exporter-5k7vc\" (UID: \"b5c59fd4-21b1-454d-8c4e-32f9316a2976\") " pod="openshift-monitoring/node-exporter-5k7vc" Jul 01 20:18:25.269755 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.269575 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6f7e9e75-3c51-4903-a19b-2003b141a539-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-2brj6\" (UID: \"6f7e9e75-3c51-4903-a19b-2003b141a539\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2brj6" Jul 01 20:18:25.269755 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.269616 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5c59fd4-21b1-454d-8c4e-32f9316a2976-metrics-client-ca\") pod \"node-exporter-5k7vc\" (UID: \"b5c59fd4-21b1-454d-8c4e-32f9316a2976\") " pod="openshift-monitoring/node-exporter-5k7vc" Jul 01 20:18:25.269755 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.269644 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b5c59fd4-21b1-454d-8c4e-32f9316a2976-node-exporter-accelerators-collector-config\") pod \"node-exporter-5k7vc\" (UID: \"b5c59fd4-21b1-454d-8c4e-32f9316a2976\") " pod="openshift-monitoring/node-exporter-5k7vc" Jul 01 20:18:25.370578 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.370545 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnwzc\" (UniqueName: \"kubernetes.io/projected/591ce368-d097-4cea-85b8-f93d96f66878-kube-api-access-xnwzc\") pod \"openshift-state-metrics-57f99c8b49-8wrjj\" (UID: \"591ce368-d097-4cea-85b8-f93d96f66878\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-8wrjj" Jul 01 20:18:25.370730 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.370588 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz9t5\" (UniqueName: \"kubernetes.io/projected/6f7e9e75-3c51-4903-a19b-2003b141a539-kube-api-access-cz9t5\") pod \"kube-state-metrics-845b954455-2brj6\" (UID: \"6f7e9e75-3c51-4903-a19b-2003b141a539\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2brj6" Jul 01 20:18:25.370810 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.370786 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b5c59fd4-21b1-454d-8c4e-32f9316a2976-node-exporter-tls\") pod \"node-exporter-5k7vc\" (UID: \"b5c59fd4-21b1-454d-8c4e-32f9316a2976\") " pod="openshift-monitoring/node-exporter-5k7vc" Jul 01 20:18:25.370873 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.370841 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f7e9e75-3c51-4903-a19b-2003b141a539-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-2brj6\" (UID: \"6f7e9e75-3c51-4903-a19b-2003b141a539\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2brj6" Jul 01 20:18:25.370924 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.370872 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/591ce368-d097-4cea-85b8-f93d96f66878-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-8wrjj\" (UID: \"591ce368-d097-4cea-85b8-f93d96f66878\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-8wrjj" Jul 01 20:18:25.370924 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.370907 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/591ce368-d097-4cea-85b8-f93d96f66878-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-8wrjj\" (UID: \"591ce368-d097-4cea-85b8-f93d96f66878\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-8wrjj" Jul 01 20:18:25.371023 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.370949 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f7e9e75-3c51-4903-a19b-2003b141a539-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-2brj6\" (UID: \"6f7e9e75-3c51-4903-a19b-2003b141a539\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2brj6" Jul 01 20:18:25.371023 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.370989 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b5c59fd4-21b1-454d-8c4e-32f9316a2976-root\") pod \"node-exporter-5k7vc\" (UID: \"b5c59fd4-21b1-454d-8c4e-32f9316a2976\") " pod="openshift-monitoring/node-exporter-5k7vc" Jul 01 20:18:25.371133 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.371021 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6f7e9e75-3c51-4903-a19b-2003b141a539-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-2brj6\" (UID: \"6f7e9e75-3c51-4903-a19b-2003b141a539\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2brj6" Jul 01 20:18:25.371133 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.371048 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5c59fd4-21b1-454d-8c4e-32f9316a2976-metrics-client-ca\") pod \"node-exporter-5k7vc\" (UID: \"b5c59fd4-21b1-454d-8c4e-32f9316a2976\") " pod="openshift-monitoring/node-exporter-5k7vc" Jul 01 20:18:25.371133 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.371073 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b5c59fd4-21b1-454d-8c4e-32f9316a2976-node-exporter-accelerators-collector-config\") pod \"node-exporter-5k7vc\" (UID: \"b5c59fd4-21b1-454d-8c4e-32f9316a2976\") " pod="openshift-monitoring/node-exporter-5k7vc" Jul 01 20:18:25.371133 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.371121 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6f7e9e75-3c51-4903-a19b-2003b141a539-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-2brj6\" (UID: \"6f7e9e75-3c51-4903-a19b-2003b141a539\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2brj6" Jul 01 20:18:25.371350 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.371146 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5c59fd4-21b1-454d-8c4e-32f9316a2976-sys\") pod \"node-exporter-5k7vc\" (UID: \"b5c59fd4-21b1-454d-8c4e-32f9316a2976\") " pod="openshift-monitoring/node-exporter-5k7vc" Jul 01 20:18:25.371350 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.371174 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsnd6\" (UniqueName: \"kubernetes.io/projected/b5c59fd4-21b1-454d-8c4e-32f9316a2976-kube-api-access-vsnd6\") pod \"node-exporter-5k7vc\" (UID: \"b5c59fd4-21b1-454d-8c4e-32f9316a2976\") " pod="openshift-monitoring/node-exporter-5k7vc" Jul 01 20:18:25.371350 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.371204 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f7e9e75-3c51-4903-a19b-2003b141a539-metrics-client-ca\") pod \"kube-state-metrics-845b954455-2brj6\" (UID: \"6f7e9e75-3c51-4903-a19b-2003b141a539\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2brj6" Jul 01 20:18:25.371350 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.371230 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b5c59fd4-21b1-454d-8c4e-32f9316a2976-node-exporter-wtmp\") pod \"node-exporter-5k7vc\" (UID: \"b5c59fd4-21b1-454d-8c4e-32f9316a2976\") " pod="openshift-monitoring/node-exporter-5k7vc" Jul 01 20:18:25.371350 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.371288 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/591ce368-d097-4cea-85b8-f93d96f66878-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-8wrjj\" (UID: \"591ce368-d097-4cea-85b8-f93d96f66878\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-8wrjj" Jul 01 20:18:25.371350 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.371345 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b5c59fd4-21b1-454d-8c4e-32f9316a2976-node-exporter-textfile\") pod \"node-exporter-5k7vc\" (UID: \"b5c59fd4-21b1-454d-8c4e-32f9316a2976\") " pod="openshift-monitoring/node-exporter-5k7vc" Jul 01 20:18:25.371582 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.371373 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5c59fd4-21b1-454d-8c4e-32f9316a2976-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5k7vc\" (UID: \"b5c59fd4-21b1-454d-8c4e-32f9316a2976\") " pod="openshift-monitoring/node-exporter-5k7vc" Jul 01 20:18:25.371582 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.371508 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6f7e9e75-3c51-4903-a19b-2003b141a539-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-2brj6\" (UID: \"6f7e9e75-3c51-4903-a19b-2003b141a539\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2brj6" Jul 01 20:18:25.371672 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:18:25.371607 2574 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 01 20:18:25.371672 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:18:25.371667 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f7e9e75-3c51-4903-a19b-2003b141a539-kube-state-metrics-tls podName:6f7e9e75-3c51-4903-a19b-2003b141a539 nodeName:}" failed. No retries permitted until 2026-07-01 20:18:25.871649299 +0000 UTC m=+80.092142237 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6f7e9e75-3c51-4903-a19b-2003b141a539-kube-state-metrics-tls") pod "kube-state-metrics-845b954455-2brj6" (UID: "6f7e9e75-3c51-4903-a19b-2003b141a539") : secret "kube-state-metrics-tls" not found Jul 01 20:18:25.371784 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.371663 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/591ce368-d097-4cea-85b8-f93d96f66878-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-8wrjj\" (UID: \"591ce368-d097-4cea-85b8-f93d96f66878\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-8wrjj" Jul 01 20:18:25.371784 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.371718 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b5c59fd4-21b1-454d-8c4e-32f9316a2976-root\") pod \"node-exporter-5k7vc\" (UID: \"b5c59fd4-21b1-454d-8c4e-32f9316a2976\") " pod="openshift-monitoring/node-exporter-5k7vc" Jul 01 20:18:25.372042 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.372017 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5c59fd4-21b1-454d-8c4e-32f9316a2976-sys\") pod \"node-exporter-5k7vc\" (UID: \"b5c59fd4-21b1-454d-8c4e-32f9316a2976\") " pod="openshift-monitoring/node-exporter-5k7vc" Jul 01 20:18:25.372195 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.372162 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b5c59fd4-21b1-454d-8c4e-32f9316a2976-node-exporter-wtmp\") pod \"node-exporter-5k7vc\" (UID: \"b5c59fd4-21b1-454d-8c4e-32f9316a2976\") " pod="openshift-monitoring/node-exporter-5k7vc" Jul 01 20:18:25.372261 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:18:25.372210 2574 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 01 20:18:25.372319 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:18:25.372274 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/591ce368-d097-4cea-85b8-f93d96f66878-openshift-state-metrics-tls podName:591ce368-d097-4cea-85b8-f93d96f66878 nodeName:}" failed. No retries permitted until 2026-07-01 20:18:25.8722555 +0000 UTC m=+80.092748444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/591ce368-d097-4cea-85b8-f93d96f66878-openshift-state-metrics-tls") pod "openshift-state-metrics-57f99c8b49-8wrjj" (UID: "591ce368-d097-4cea-85b8-f93d96f66878") : secret "openshift-state-metrics-tls" not found Jul 01 20:18:25.372464 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.372397 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5c59fd4-21b1-454d-8c4e-32f9316a2976-metrics-client-ca\") pod \"node-exporter-5k7vc\" (UID: \"b5c59fd4-21b1-454d-8c4e-32f9316a2976\") " pod="openshift-monitoring/node-exporter-5k7vc" Jul 01 20:18:25.372586 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.372467 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b5c59fd4-21b1-454d-8c4e-32f9316a2976-node-exporter-textfile\") pod \"node-exporter-5k7vc\" (UID: \"b5c59fd4-21b1-454d-8c4e-32f9316a2976\") " pod="openshift-monitoring/node-exporter-5k7vc" Jul 01 20:18:25.372657 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.372640 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6f7e9e75-3c51-4903-a19b-2003b141a539-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-2brj6\" (UID: \"6f7e9e75-3c51-4903-a19b-2003b141a539\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2brj6" Jul 01 20:18:25.372807 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.372778 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b5c59fd4-21b1-454d-8c4e-32f9316a2976-node-exporter-accelerators-collector-config\") pod \"node-exporter-5k7vc\" (UID: \"b5c59fd4-21b1-454d-8c4e-32f9316a2976\") " pod="openshift-monitoring/node-exporter-5k7vc" Jul 01 20:18:25.373394 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.373370 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f7e9e75-3c51-4903-a19b-2003b141a539-metrics-client-ca\") pod \"kube-state-metrics-845b954455-2brj6\" (UID: \"6f7e9e75-3c51-4903-a19b-2003b141a539\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2brj6" Jul 01 20:18:25.373912 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.373854 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f7e9e75-3c51-4903-a19b-2003b141a539-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-2brj6\" (UID: \"6f7e9e75-3c51-4903-a19b-2003b141a539\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2brj6" Jul 01 20:18:25.374847 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.374805 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b5c59fd4-21b1-454d-8c4e-32f9316a2976-node-exporter-tls\") pod \"node-exporter-5k7vc\" (UID: \"b5c59fd4-21b1-454d-8c4e-32f9316a2976\") " pod="openshift-monitoring/node-exporter-5k7vc" Jul 01 20:18:25.374847 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.374816 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5c59fd4-21b1-454d-8c4e-32f9316a2976-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5k7vc\" (UID: \"b5c59fd4-21b1-454d-8c4e-32f9316a2976\") " pod="openshift-monitoring/node-exporter-5k7vc" Jul 01 20:18:25.374993 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.374918 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/591ce368-d097-4cea-85b8-f93d96f66878-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-8wrjj\" (UID: \"591ce368-d097-4cea-85b8-f93d96f66878\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-8wrjj" Jul 01 20:18:25.381928 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.381885 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsnd6\" (UniqueName: \"kubernetes.io/projected/b5c59fd4-21b1-454d-8c4e-32f9316a2976-kube-api-access-vsnd6\") pod \"node-exporter-5k7vc\" (UID: \"b5c59fd4-21b1-454d-8c4e-32f9316a2976\") " pod="openshift-monitoring/node-exporter-5k7vc" Jul 01 20:18:25.382063 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.382022 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz9t5\" (UniqueName: \"kubernetes.io/projected/6f7e9e75-3c51-4903-a19b-2003b141a539-kube-api-access-cz9t5\") pod \"kube-state-metrics-845b954455-2brj6\" (UID: \"6f7e9e75-3c51-4903-a19b-2003b141a539\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2brj6" Jul 01 20:18:25.382492 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.382451 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnwzc\" (UniqueName: \"kubernetes.io/projected/591ce368-d097-4cea-85b8-f93d96f66878-kube-api-access-xnwzc\") pod \"openshift-state-metrics-57f99c8b49-8wrjj\" (UID: \"591ce368-d097-4cea-85b8-f93d96f66878\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-8wrjj" Jul 01 20:18:25.482805 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.482747 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5k7vc" Jul 01 20:18:25.493989 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:18:25.493963 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5c59fd4_21b1_454d_8c4e_32f9316a2976.slice/crio-895328da076a1182899fbd45cd0fdd3e606a7f7e946256566f075f0f174b1b07 WatchSource:0}: Error finding container 895328da076a1182899fbd45cd0fdd3e606a7f7e946256566f075f0f174b1b07: Status 404 returned error can't find the container with id 895328da076a1182899fbd45cd0fdd3e606a7f7e946256566f075f0f174b1b07 Jul 01 20:18:25.592794 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.592754 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5k7vc" event={"ID":"b5c59fd4-21b1-454d-8c4e-32f9316a2976","Type":"ContainerStarted","Data":"895328da076a1182899fbd45cd0fdd3e606a7f7e946256566f075f0f174b1b07"} Jul 01 20:18:25.875875 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.875824 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f7e9e75-3c51-4903-a19b-2003b141a539-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-2brj6\" (UID: \"6f7e9e75-3c51-4903-a19b-2003b141a539\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2brj6" Jul 01 20:18:25.876048 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.875944 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/591ce368-d097-4cea-85b8-f93d96f66878-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-8wrjj\" (UID: \"591ce368-d097-4cea-85b8-f93d96f66878\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-8wrjj" Jul 01 20:18:25.878618 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.878568 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f7e9e75-3c51-4903-a19b-2003b141a539-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-2brj6\" (UID: \"6f7e9e75-3c51-4903-a19b-2003b141a539\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2brj6" Jul 01 20:18:25.879179 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.879148 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/591ce368-d097-4cea-85b8-f93d96f66878-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-8wrjj\" (UID: \"591ce368-d097-4cea-85b8-f93d96f66878\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-8wrjj" Jul 01 20:18:25.952995 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.952955 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85cd6fbb5-mr79t" Jul 01 20:18:25.953161 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.953017 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85cd6fbb5-mr79t" Jul 01 20:18:25.958390 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:25.958367 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85cd6fbb5-mr79t" Jul 01 20:18:26.043132 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:26.043082 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-8wrjj" Jul 01 20:18:26.073441 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:26.072986 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-2brj6" Jul 01 20:18:26.220271 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:26.220197 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-8wrjj"] Jul 01 20:18:26.250051 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:26.250018 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-2brj6"] Jul 01 20:18:26.254287 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:18:26.254246 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f7e9e75_3c51_4903_a19b_2003b141a539.slice/crio-f42e87933a4bbafbbfc290e693187d7ad5d083e44193c4c0decb457957b7d4d5 WatchSource:0}: Error finding container f42e87933a4bbafbbfc290e693187d7ad5d083e44193c4c0decb457957b7d4d5: Status 404 returned error can't find the container with id f42e87933a4bbafbbfc290e693187d7ad5d083e44193c4c0decb457957b7d4d5 Jul 01 20:18:26.598845 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:26.598812 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-8wrjj" event={"ID":"591ce368-d097-4cea-85b8-f93d96f66878","Type":"ContainerStarted","Data":"0a0f056d97bcd98c495359c3548f3eef4cd86ce5b30b1f172bc7a933d9fecf91"} Jul 01 20:18:26.599280 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:26.598879 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-8wrjj" event={"ID":"591ce368-d097-4cea-85b8-f93d96f66878","Type":"ContainerStarted","Data":"eb02e49829015b31c688c40a6ab3e3d51801ffa2fbfaf8085f38370e80786ff7"} Jul 01 20:18:26.599280 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:26.598910 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-8wrjj" event={"ID":"591ce368-d097-4cea-85b8-f93d96f66878","Type":"ContainerStarted","Data":"622c0fa4caf9136fca1974ffdc51030fff88183a2c968745c905ce47187f6dcc"} Jul 01 20:18:26.600425 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:26.600382 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-2brj6" event={"ID":"6f7e9e75-3c51-4903-a19b-2003b141a539","Type":"ContainerStarted","Data":"f42e87933a4bbafbbfc290e693187d7ad5d083e44193c4c0decb457957b7d4d5"} Jul 01 20:18:26.605300 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:26.605281 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85cd6fbb5-mr79t" Jul 01 20:18:27.606253 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:27.606217 2574 generic.go:356] "Generic (PLEG): container finished" podID="b5c59fd4-21b1-454d-8c4e-32f9316a2976" containerID="1d84afed6d3a1c5c591c60f0ab5caf642c04d1f32637651e5fc5e5d1e56f1cee" exitCode=0 Jul 01 20:18:27.606702 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:27.606312 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5k7vc" event={"ID":"b5c59fd4-21b1-454d-8c4e-32f9316a2976","Type":"ContainerDied","Data":"1d84afed6d3a1c5c591c60f0ab5caf642c04d1f32637651e5fc5e5d1e56f1cee"} Jul 01 20:18:28.612857 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:28.612800 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-2brj6" event={"ID":"6f7e9e75-3c51-4903-a19b-2003b141a539","Type":"ContainerStarted","Data":"cbd704ad541d2ad4b0a8f0422209b0b530c32cf213454fd35bb78738211b606d"} Jul 01 20:18:28.613292 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:28.612914 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-2brj6" event={"ID":"6f7e9e75-3c51-4903-a19b-2003b141a539","Type":"ContainerStarted","Data":"5a81c02293454da214520438ac10056512372e360a19c29cb696a9ca2d80403f"} Jul 01 20:18:28.615237 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:28.615204 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-8wrjj" event={"ID":"591ce368-d097-4cea-85b8-f93d96f66878","Type":"ContainerStarted","Data":"9df20f1e14b415335704fb70d562f714156c5a52176fb04dbf4d02195c9a4e2b"} Jul 01 20:18:28.617431 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:28.617402 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5k7vc" event={"ID":"b5c59fd4-21b1-454d-8c4e-32f9316a2976","Type":"ContainerStarted","Data":"674f93f6443b063092486eccb065ef9357c20800c7f7814f5289ab941c31e42f"} Jul 01 20:18:28.617510 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:28.617451 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5k7vc" event={"ID":"b5c59fd4-21b1-454d-8c4e-32f9316a2976","Type":"ContainerStarted","Data":"7195d8a8c2e19bcf3075503918e1e28d65f476dab5f9a84ff730792760d68b2a"} Jul 01 20:18:28.634749 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:28.634705 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-8wrjj" podStartSLOduration=2.102071027 podStartE2EDuration="3.634686563s" totalImagesPullingTime="1.532615536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:18:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:28.634064389 +0000 UTC m=+82.854557342" watchObservedRunningTime="2026-07-01 20:18:28.634686563 +0000 UTC m=+82.855179513" Jul 01 20:18:28.652808 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:28.652752 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5k7vc" podStartSLOduration=2.468926407 podStartE2EDuration="3.652738308s" totalImagesPullingTime="1.109653628s" totalInitContainerRuntime="74.158273ms" isStatefulPod=true podCreationTimestamp="2026-07-01 20:18:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:28.651263863 +0000 UTC m=+82.871756833" watchObservedRunningTime="2026-07-01 20:18:28.652738308 +0000 UTC m=+82.873231235" Jul 01 20:18:30.445042 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:30.445007 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-89776bd98-c52dp"] Jul 01 20:18:31.337398 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.337360 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 20:18:31.346315 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.346279 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.349097 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.348838 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 01 20:18:31.349097 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.349058 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 01 20:18:31.350891 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.350872 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 01 20:18:31.351007 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.350941 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 01 20:18:31.351007 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.350963 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 01 20:18:31.351886 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.351755 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-af330e49ktup2\"" Jul 01 20:18:31.351886 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.351770 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 01 20:18:31.351886 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.351777 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 01 20:18:31.351886 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.351793 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7djpx\"" Jul 01 20:18:31.352375 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.352154 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 01 20:18:31.352375 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.352345 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 01 20:18:31.352375 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.352371 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 01 20:18:31.352567 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.352397 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 01 20:18:31.352763 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.352747 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 01 20:18:31.357891 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.357864 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 01 20:18:31.360414 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.360387 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 01 20:18:31.367697 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.365029 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 01 20:18:31.367697 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.365940 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 20:18:31.429705 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.429669 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.429861 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.429720 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-config\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.429861 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.429753 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.429861 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.429779 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmw6d\" (UniqueName: \"kubernetes.io/projected/a79f6b45-701e-4ed1-b515-b26d1a3908b7-kube-api-access-xmw6d\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.429861 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.429810 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a79f6b45-701e-4ed1-b515-b26d1a3908b7-config-out\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.429861 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.429834 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.430178 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.429864 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.430178 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.429898 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.430178 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.429930 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.430178 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.429959 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-web-config\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.430178 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.430002 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.430178 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.430040 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.430178 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.430084 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.430178 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.430110 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a79f6b45-701e-4ed1-b515-b26d1a3908b7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.430178 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.430157 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.430611 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.430182 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.430611 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.430206 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.430611 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.430229 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.430611 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.430259 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.430611 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.430288 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.531404 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.531352 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.531404 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.531406 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-web-config\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.531908 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.531448 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.531908 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.531484 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.531908 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.531520 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.531908 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.531548 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a79f6b45-701e-4ed1-b515-b26d1a3908b7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.531908 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.531588 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.531908 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.531611 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.531908 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.531634 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.531908 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.531657 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.531908 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.531684 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.531908 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.531713 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.531908 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.531746 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.531908 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.531769 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-config\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.531908 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.531794 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.531908 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.531817 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmw6d\" (UniqueName: \"kubernetes.io/projected/a79f6b45-701e-4ed1-b515-b26d1a3908b7-kube-api-access-xmw6d\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.531908 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.531846 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a79f6b45-701e-4ed1-b515-b26d1a3908b7-config-out\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.531908 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.531872 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.531908 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.531900 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.532704 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.531936 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.533285 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.532945 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.533433 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.533300 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.533749 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.533727 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.534924 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.534897 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.535927 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.535652 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.536014 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.535951 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.536455 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.536429 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.536844 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.536820 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a79f6b45-701e-4ed1-b515-b26d1a3908b7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.536924 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.536859 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.537523 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.537445 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.541215 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.541189 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.541315 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.541190 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.541792 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.541697 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.542038 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.541997 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.542610 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.542567 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a79f6b45-701e-4ed1-b515-b26d1a3908b7-config-out\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.542694 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.542659 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-web-config\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.542751 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.542659 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-config\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.543298 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.543272 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.544402 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.544369 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmw6d\" (UniqueName: \"kubernetes.io/projected/a79f6b45-701e-4ed1-b515-b26d1a3908b7-kube-api-access-xmw6d\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.544736 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.544693 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:31.668022 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:31.667931 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:33.548714 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:33.548679 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-89776bd98-c52dp" Jul 01 20:18:35.583029 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:35.582997 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 20:18:35.584080 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:18:35.584046 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda79f6b45_701e_4ed1_b515_b26d1a3908b7.slice/crio-456b95af0e25cc30542e607dae1211df3aed3ae0c27d4ad2c2255e2d5e2145cb WatchSource:0}: Error finding container 456b95af0e25cc30542e607dae1211df3aed3ae0c27d4ad2c2255e2d5e2145cb: Status 404 returned error can't find the container with id 456b95af0e25cc30542e607dae1211df3aed3ae0c27d4ad2c2255e2d5e2145cb Jul 01 20:18:35.651394 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:35.651351 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-2brj6" event={"ID":"6f7e9e75-3c51-4903-a19b-2003b141a539","Type":"ContainerStarted","Data":"393f7026adbc845efbaf00e238b3f5e8b8ede3d4d1dfab36899eeba698efaa29"} Jul 01 20:18:35.652665 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:35.652634 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a79f6b45-701e-4ed1-b515-b26d1a3908b7","Type":"ContainerStarted","Data":"456b95af0e25cc30542e607dae1211df3aed3ae0c27d4ad2c2255e2d5e2145cb"} Jul 01 20:18:35.679608 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:35.679561 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-845b954455-2brj6" podStartSLOduration=9.049300325 podStartE2EDuration="10.679541427s" totalImagesPullingTime="1.630241102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:18:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:35.678580089 +0000 UTC m=+89.899073040" watchObservedRunningTime="2026-07-01 20:18:35.679541427 +0000 UTC m=+89.900034379" Jul 01 20:18:36.659523 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:36.659476 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-jm497" event={"ID":"ed516f34-b8e5-486f-8da5-c30216e8ab7b","Type":"ContainerStarted","Data":"f3d556559209602762920fa94852a3270055ac0c1f2abff34c50f30ced2ccde1"} Jul 01 20:18:36.688145 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:36.687259 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5499b6fb8f-jm497" podStartSLOduration=5.222546136 podStartE2EDuration="26.687238468s" totalImagesPullingTime="21.464692332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:18:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:36.687099675 +0000 UTC m=+90.907592626" watchObservedRunningTime="2026-07-01 20:18:36.687238468 +0000 UTC m=+90.907731420" Jul 01 20:18:37.663360 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:37.663280 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5499b6fb8f-jm497" Jul 01 20:18:37.677009 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:37.676985 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5499b6fb8f-jm497" Jul 01 20:18:38.669645 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:38.669611 2574 generic.go:356] "Generic (PLEG): container finished" podID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerID="beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6" exitCode=0 Jul 01 20:18:38.670109 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:38.669698 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a79f6b45-701e-4ed1-b515-b26d1a3908b7","Type":"ContainerDied","Data":"beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6"} Jul 01 20:18:44.705058 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:44.704911 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a79f6b45-701e-4ed1-b515-b26d1a3908b7","Type":"ContainerStarted","Data":"043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b"} Jul 01 20:18:44.705058 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:44.705003 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a79f6b45-701e-4ed1-b515-b26d1a3908b7","Type":"ContainerStarted","Data":"ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb"} Jul 01 20:18:46.715302 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:46.715272 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a79f6b45-701e-4ed1-b515-b26d1a3908b7","Type":"ContainerStarted","Data":"5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432"} Jul 01 20:18:46.715634 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:46.715398 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a79f6b45-701e-4ed1-b515-b26d1a3908b7","Type":"ContainerStarted","Data":"ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2"} Jul 01 20:18:47.722680 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:47.722644 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a79f6b45-701e-4ed1-b515-b26d1a3908b7","Type":"ContainerStarted","Data":"0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b"} Jul 01 20:18:47.723073 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:47.722705 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a79f6b45-701e-4ed1-b515-b26d1a3908b7","Type":"ContainerStarted","Data":"28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062"} Jul 01 20:18:47.756310 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:47.756255 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=7.408820644 podStartE2EDuration="16.756236529s" totalImagesPullingTime="9.325583004s" totalInitContainerRuntime="21.832881ms" isStatefulPod=false podCreationTimestamp="2026-07-01 20:18:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:47.75476117 +0000 UTC m=+101.975254131" watchObservedRunningTime="2026-07-01 20:18:47.756236529 +0000 UTC m=+101.976729477" Jul 01 20:18:47.835915 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:47.835872 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85cd6fbb5-mr79t"] Jul 01 20:18:51.668321 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:51.668286 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:18:54.588056 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:54.588021 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tw94d" Jul 01 20:18:55.467410 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.467351 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-89776bd98-c52dp" podUID="36304709-2f6a-4a99-aa15-606ce43c0e84" containerName="console" containerID="cri-o://a459ce71567d1beedd619fa4e61b1ad4ac41277403d191809e39b3eb3f2c2696" gracePeriod=15 Jul 01 20:18:55.740936 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.740854 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-89776bd98-c52dp" Jul 01 20:18:55.752234 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.752200 2574 generic.go:356] "Generic (PLEG): container finished" podID="36304709-2f6a-4a99-aa15-606ce43c0e84" containerID="a459ce71567d1beedd619fa4e61b1ad4ac41277403d191809e39b3eb3f2c2696" exitCode=0 Jul 01 20:18:55.752390 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.752253 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-89776bd98-c52dp" Jul 01 20:18:55.752390 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.752270 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-89776bd98-c52dp" event={"ID":"36304709-2f6a-4a99-aa15-606ce43c0e84","Type":"ContainerDied","Data":"a459ce71567d1beedd619fa4e61b1ad4ac41277403d191809e39b3eb3f2c2696"} Jul 01 20:18:55.752390 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.752317 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-89776bd98-c52dp" event={"ID":"36304709-2f6a-4a99-aa15-606ce43c0e84","Type":"ContainerDied","Data":"38609a384161f33930788f5469e6aa4aa4843a7ad13ce98678da80362ba3ae55"} Jul 01 20:18:55.752390 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.752359 2574 scope.go:117] "RemoveContainer" containerID="a459ce71567d1beedd619fa4e61b1ad4ac41277403d191809e39b3eb3f2c2696" Jul 01 20:18:55.761681 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.761660 2574 scope.go:117] "RemoveContainer" containerID="a459ce71567d1beedd619fa4e61b1ad4ac41277403d191809e39b3eb3f2c2696" Jul 01 20:18:55.761979 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:18:55.761954 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a459ce71567d1beedd619fa4e61b1ad4ac41277403d191809e39b3eb3f2c2696\": container with ID starting with a459ce71567d1beedd619fa4e61b1ad4ac41277403d191809e39b3eb3f2c2696 not found: ID does not exist" containerID="a459ce71567d1beedd619fa4e61b1ad4ac41277403d191809e39b3eb3f2c2696" Jul 01 20:18:55.762077 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.761989 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a459ce71567d1beedd619fa4e61b1ad4ac41277403d191809e39b3eb3f2c2696"} err="failed to get container status \"a459ce71567d1beedd619fa4e61b1ad4ac41277403d191809e39b3eb3f2c2696\": rpc error: code = NotFound desc = could not find container \"a459ce71567d1beedd619fa4e61b1ad4ac41277403d191809e39b3eb3f2c2696\": container with ID starting with a459ce71567d1beedd619fa4e61b1ad4ac41277403d191809e39b3eb3f2c2696 not found: ID does not exist" Jul 01 20:18:55.860246 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.860210 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2qk8\" (UniqueName: \"kubernetes.io/projected/36304709-2f6a-4a99-aa15-606ce43c0e84-kube-api-access-t2qk8\") pod \"36304709-2f6a-4a99-aa15-606ce43c0e84\" (UID: \"36304709-2f6a-4a99-aa15-606ce43c0e84\") " Jul 01 20:18:55.860246 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.860253 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36304709-2f6a-4a99-aa15-606ce43c0e84-oauth-serving-cert\") pod \"36304709-2f6a-4a99-aa15-606ce43c0e84\" (UID: \"36304709-2f6a-4a99-aa15-606ce43c0e84\") " Jul 01 20:18:55.860475 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.860272 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36304709-2f6a-4a99-aa15-606ce43c0e84-console-serving-cert\") pod \"36304709-2f6a-4a99-aa15-606ce43c0e84\" (UID: \"36304709-2f6a-4a99-aa15-606ce43c0e84\") " Jul 01 20:18:55.860475 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.860371 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36304709-2f6a-4a99-aa15-606ce43c0e84-service-ca\") pod \"36304709-2f6a-4a99-aa15-606ce43c0e84\" (UID: \"36304709-2f6a-4a99-aa15-606ce43c0e84\") " Jul 01 20:18:55.860475 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.860400 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36304709-2f6a-4a99-aa15-606ce43c0e84-console-oauth-config\") pod \"36304709-2f6a-4a99-aa15-606ce43c0e84\" (UID: \"36304709-2f6a-4a99-aa15-606ce43c0e84\") " Jul 01 20:18:55.860475 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.860430 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36304709-2f6a-4a99-aa15-606ce43c0e84-console-config\") pod \"36304709-2f6a-4a99-aa15-606ce43c0e84\" (UID: \"36304709-2f6a-4a99-aa15-606ce43c0e84\") " Jul 01 20:18:55.860475 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.860452 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36304709-2f6a-4a99-aa15-606ce43c0e84-trusted-ca-bundle\") pod \"36304709-2f6a-4a99-aa15-606ce43c0e84\" (UID: \"36304709-2f6a-4a99-aa15-606ce43c0e84\") " Jul 01 20:18:55.860924 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.860858 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36304709-2f6a-4a99-aa15-606ce43c0e84-service-ca" (OuterVolumeSpecName: "service-ca") pod "36304709-2f6a-4a99-aa15-606ce43c0e84" (UID: "36304709-2f6a-4a99-aa15-606ce43c0e84"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:18:55.860924 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.860905 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36304709-2f6a-4a99-aa15-606ce43c0e84-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "36304709-2f6a-4a99-aa15-606ce43c0e84" (UID: "36304709-2f6a-4a99-aa15-606ce43c0e84"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:18:55.861064 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.860909 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36304709-2f6a-4a99-aa15-606ce43c0e84-console-config" (OuterVolumeSpecName: "console-config") pod "36304709-2f6a-4a99-aa15-606ce43c0e84" (UID: "36304709-2f6a-4a99-aa15-606ce43c0e84"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:18:55.861064 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.860933 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36304709-2f6a-4a99-aa15-606ce43c0e84-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "36304709-2f6a-4a99-aa15-606ce43c0e84" (UID: "36304709-2f6a-4a99-aa15-606ce43c0e84"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:18:55.862654 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.862631 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36304709-2f6a-4a99-aa15-606ce43c0e84-kube-api-access-t2qk8" (OuterVolumeSpecName: "kube-api-access-t2qk8") pod "36304709-2f6a-4a99-aa15-606ce43c0e84" (UID: "36304709-2f6a-4a99-aa15-606ce43c0e84"). InnerVolumeSpecName "kube-api-access-t2qk8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:18:55.862889 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.862865 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36304709-2f6a-4a99-aa15-606ce43c0e84-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "36304709-2f6a-4a99-aa15-606ce43c0e84" (UID: "36304709-2f6a-4a99-aa15-606ce43c0e84"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:18:55.862889 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.862879 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36304709-2f6a-4a99-aa15-606ce43c0e84-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "36304709-2f6a-4a99-aa15-606ce43c0e84" (UID: "36304709-2f6a-4a99-aa15-606ce43c0e84"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:18:55.961471 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.961431 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36304709-2f6a-4a99-aa15-606ce43c0e84-service-ca\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:18:55.961471 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.961465 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36304709-2f6a-4a99-aa15-606ce43c0e84-console-oauth-config\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:18:55.961471 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.961478 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36304709-2f6a-4a99-aa15-606ce43c0e84-console-config\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:18:55.961721 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.961491 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36304709-2f6a-4a99-aa15-606ce43c0e84-trusted-ca-bundle\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:18:55.961721 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.961502 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2qk8\" (UniqueName: \"kubernetes.io/projected/36304709-2f6a-4a99-aa15-606ce43c0e84-kube-api-access-t2qk8\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:18:55.961721 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.961514 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36304709-2f6a-4a99-aa15-606ce43c0e84-oauth-serving-cert\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:18:55.961721 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:55.961526 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36304709-2f6a-4a99-aa15-606ce43c0e84-console-serving-cert\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:18:56.073159 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:56.073118 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-89776bd98-c52dp"] Jul 01 20:18:56.079507 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:56.079472 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-89776bd98-c52dp"] Jul 01 20:18:56.222783 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:18:56.222743 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36304709-2f6a-4a99-aa15-606ce43c0e84" path="/var/lib/kubelet/pods/36304709-2f6a-4a99-aa15-606ce43c0e84/volumes" Jul 01 20:19:12.861204 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:12.861161 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-85cd6fbb5-mr79t" podUID="e4e1d64b-5c14-4934-80ca-7aaf4a1f757c" containerName="console" containerID="cri-o://5953146e9081f88ca77d7f01db07051c6c2a52d8576a7143edd5ca088daf6029" gracePeriod=15 Jul 01 20:19:13.121087 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:13.121028 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85cd6fbb5-mr79t" Jul 01 20:19:13.304885 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:13.304851 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-service-ca\") pod \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\" (UID: \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\") " Jul 01 20:19:13.304885 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:13.304883 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-oauth-serving-cert\") pod \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\" (UID: \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\") " Jul 01 20:19:13.305104 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:13.304904 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-console-serving-cert\") pod \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\" (UID: \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\") " Jul 01 20:19:13.305104 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:13.304930 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ft2vv\" (UniqueName: \"kubernetes.io/projected/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-kube-api-access-ft2vv\") pod \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\" (UID: \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\") " Jul 01 20:19:13.305104 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:13.304952 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-console-oauth-config\") pod \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\" (UID: \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\") " Jul 01 20:19:13.305104 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:13.305001 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-console-config\") pod \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\" (UID: \"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c\") " Jul 01 20:19:13.305377 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:13.305348 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-service-ca" (OuterVolumeSpecName: "service-ca") pod "e4e1d64b-5c14-4934-80ca-7aaf4a1f757c" (UID: "e4e1d64b-5c14-4934-80ca-7aaf4a1f757c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:19:13.305377 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:13.305358 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e4e1d64b-5c14-4934-80ca-7aaf4a1f757c" (UID: "e4e1d64b-5c14-4934-80ca-7aaf4a1f757c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:19:13.305485 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:13.305401 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-console-config" (OuterVolumeSpecName: "console-config") pod "e4e1d64b-5c14-4934-80ca-7aaf4a1f757c" (UID: "e4e1d64b-5c14-4934-80ca-7aaf4a1f757c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:19:13.307161 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:13.307131 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e4e1d64b-5c14-4934-80ca-7aaf4a1f757c" (UID: "e4e1d64b-5c14-4934-80ca-7aaf4a1f757c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:19:13.307268 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:13.307150 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-kube-api-access-ft2vv" (OuterVolumeSpecName: "kube-api-access-ft2vv") pod "e4e1d64b-5c14-4934-80ca-7aaf4a1f757c" (UID: "e4e1d64b-5c14-4934-80ca-7aaf4a1f757c"). InnerVolumeSpecName "kube-api-access-ft2vv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:19:13.307268 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:13.307197 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e4e1d64b-5c14-4934-80ca-7aaf4a1f757c" (UID: "e4e1d64b-5c14-4934-80ca-7aaf4a1f757c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:19:13.406073 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:13.406005 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-console-config\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:19:13.406073 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:13.406032 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-service-ca\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:19:13.406073 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:13.406040 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-oauth-serving-cert\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:19:13.406073 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:13.406051 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-console-serving-cert\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:19:13.406073 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:13.406060 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ft2vv\" (UniqueName: \"kubernetes.io/projected/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-kube-api-access-ft2vv\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:19:13.406073 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:13.406069 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c-console-oauth-config\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:19:13.818182 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:13.818088 2574 generic.go:356] "Generic (PLEG): container finished" podID="e4e1d64b-5c14-4934-80ca-7aaf4a1f757c" containerID="5953146e9081f88ca77d7f01db07051c6c2a52d8576a7143edd5ca088daf6029" exitCode=0 Jul 01 20:19:13.818372 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:13.818179 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85cd6fbb5-mr79t" event={"ID":"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c","Type":"ContainerDied","Data":"5953146e9081f88ca77d7f01db07051c6c2a52d8576a7143edd5ca088daf6029"} Jul 01 20:19:13.818372 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:13.818227 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85cd6fbb5-mr79t" event={"ID":"e4e1d64b-5c14-4934-80ca-7aaf4a1f757c","Type":"ContainerDied","Data":"0a4b2ba1b1c54ec012f7d7eec2efef23025c1b6ea1b0fc24abebfacb4e5af76b"} Jul 01 20:19:13.818372 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:13.818252 2574 scope.go:117] "RemoveContainer" containerID="5953146e9081f88ca77d7f01db07051c6c2a52d8576a7143edd5ca088daf6029" Jul 01 20:19:13.818540 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:13.818442 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85cd6fbb5-mr79t" Jul 01 20:19:13.827529 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:13.827509 2574 scope.go:117] "RemoveContainer" containerID="5953146e9081f88ca77d7f01db07051c6c2a52d8576a7143edd5ca088daf6029" Jul 01 20:19:13.827773 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:19:13.827753 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5953146e9081f88ca77d7f01db07051c6c2a52d8576a7143edd5ca088daf6029\": container with ID starting with 5953146e9081f88ca77d7f01db07051c6c2a52d8576a7143edd5ca088daf6029 not found: ID does not exist" containerID="5953146e9081f88ca77d7f01db07051c6c2a52d8576a7143edd5ca088daf6029" Jul 01 20:19:13.827819 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:13.827781 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5953146e9081f88ca77d7f01db07051c6c2a52d8576a7143edd5ca088daf6029"} err="failed to get container status \"5953146e9081f88ca77d7f01db07051c6c2a52d8576a7143edd5ca088daf6029\": rpc error: code = NotFound desc = could not find container \"5953146e9081f88ca77d7f01db07051c6c2a52d8576a7143edd5ca088daf6029\": container with ID starting with 5953146e9081f88ca77d7f01db07051c6c2a52d8576a7143edd5ca088daf6029 not found: ID does not exist" Jul 01 20:19:13.838980 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:13.838958 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85cd6fbb5-mr79t"] Jul 01 20:19:13.843654 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:13.843625 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85cd6fbb5-mr79t"] Jul 01 20:19:14.217621 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:14.217593 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4e1d64b-5c14-4934-80ca-7aaf4a1f757c" path="/var/lib/kubelet/pods/e4e1d64b-5c14-4934-80ca-7aaf4a1f757c/volumes" Jul 01 20:19:31.668783 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:31.668738 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:31.687788 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:31.687754 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:31.900820 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:31.900794 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:49.650351 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.650297 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 20:19:49.650942 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.650629 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerName="kube-rbac-proxy" containerID="cri-o://28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062" gracePeriod=600 Jul 01 20:19:49.650942 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.650632 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerName="kube-rbac-proxy-web" containerID="cri-o://5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432" gracePeriod=600 Jul 01 20:19:49.650942 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.650697 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerName="thanos-sidecar" containerID="cri-o://ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2" gracePeriod=600 Jul 01 20:19:49.650942 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.650756 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerName="config-reloader" containerID="cri-o://043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b" gracePeriod=600 Jul 01 20:19:49.650942 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.650691 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerName="kube-rbac-proxy-thanos" containerID="cri-o://0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b" gracePeriod=600 Jul 01 20:19:49.650942 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.650755 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerName="prometheus" containerID="cri-o://ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb" gracePeriod=600 Jul 01 20:19:49.914710 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.914686 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:49.956225 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.956195 2574 generic.go:356] "Generic (PLEG): container finished" podID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerID="0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b" exitCode=0 Jul 01 20:19:49.956225 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.956219 2574 generic.go:356] "Generic (PLEG): container finished" podID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerID="28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062" exitCode=0 Jul 01 20:19:49.956225 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.956227 2574 generic.go:356] "Generic (PLEG): container finished" podID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerID="5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432" exitCode=0 Jul 01 20:19:49.956225 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.956234 2574 generic.go:356] "Generic (PLEG): container finished" podID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerID="ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2" exitCode=0 Jul 01 20:19:49.956598 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.956241 2574 generic.go:356] "Generic (PLEG): container finished" podID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerID="043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b" exitCode=0 Jul 01 20:19:49.956598 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.956249 2574 generic.go:356] "Generic (PLEG): container finished" podID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerID="ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb" exitCode=0 Jul 01 20:19:49.956598 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.956273 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a79f6b45-701e-4ed1-b515-b26d1a3908b7","Type":"ContainerDied","Data":"0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b"} Jul 01 20:19:49.956598 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.956280 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:49.956598 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.956354 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a79f6b45-701e-4ed1-b515-b26d1a3908b7","Type":"ContainerDied","Data":"28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062"} Jul 01 20:19:49.956598 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.956398 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a79f6b45-701e-4ed1-b515-b26d1a3908b7","Type":"ContainerDied","Data":"5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432"} Jul 01 20:19:49.956598 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.956433 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a79f6b45-701e-4ed1-b515-b26d1a3908b7","Type":"ContainerDied","Data":"ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2"} Jul 01 20:19:49.956598 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.956471 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a79f6b45-701e-4ed1-b515-b26d1a3908b7","Type":"ContainerDied","Data":"043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b"} Jul 01 20:19:49.956598 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.956515 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a79f6b45-701e-4ed1-b515-b26d1a3908b7","Type":"ContainerDied","Data":"ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb"} Jul 01 20:19:49.956598 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.956555 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a79f6b45-701e-4ed1-b515-b26d1a3908b7","Type":"ContainerDied","Data":"456b95af0e25cc30542e607dae1211df3aed3ae0c27d4ad2c2255e2d5e2145cb"} Jul 01 20:19:49.957039 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.956603 2574 scope.go:117] "RemoveContainer" containerID="0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b" Jul 01 20:19:49.965640 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.965608 2574 scope.go:117] "RemoveContainer" containerID="28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062" Jul 01 20:19:49.974748 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.974653 2574 scope.go:117] "RemoveContainer" containerID="5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432" Jul 01 20:19:49.983832 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.983802 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a79f6b45-701e-4ed1-b515-b26d1a3908b7-tls-assets\") pod \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " Jul 01 20:19:49.983960 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.983859 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-k8s-rulefiles-0\") pod \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " Jul 01 20:19:49.983960 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.983889 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-k8s-rulefiles-1\") pod \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " Jul 01 20:19:49.983960 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.983944 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-web-config\") pod \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " Jul 01 20:19:49.984117 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.983972 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-k8s-db\") pod \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " Jul 01 20:19:49.984117 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.984007 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-configmap-kubelet-serving-ca-bundle\") pod \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " Jul 01 20:19:49.984117 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.984043 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a79f6b45-701e-4ed1-b515-b26d1a3908b7-config-out\") pod \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " Jul 01 20:19:49.984117 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.984071 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " Jul 01 20:19:49.984117 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.984104 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-kube-rbac-proxy\") pod \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " Jul 01 20:19:49.984408 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.984132 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-configmap-serving-certs-ca-bundle\") pod \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " Jul 01 20:19:49.984408 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.984159 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmw6d\" (UniqueName: \"kubernetes.io/projected/a79f6b45-701e-4ed1-b515-b26d1a3908b7-kube-api-access-xmw6d\") pod \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " Jul 01 20:19:49.984408 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.984184 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-prometheus-k8s-tls\") pod \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " Jul 01 20:19:49.984408 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.984212 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " Jul 01 20:19:49.984408 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.984293 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-metrics-client-certs\") pod \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " Jul 01 20:19:49.984408 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.984360 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-k8s-rulefiles-2\") pod \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " Jul 01 20:19:49.984408 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.984396 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-trusted-ca-bundle\") pod \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " Jul 01 20:19:49.984740 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.984434 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-thanos-prometheus-http-client-file\") pod \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " Jul 01 20:19:49.984740 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.984466 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-config\") pod \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " Jul 01 20:19:49.984740 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.984497 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-grpc-tls\") pod \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " Jul 01 20:19:49.984740 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.984523 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-configmap-metrics-client-ca\") pod \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\" (UID: \"a79f6b45-701e-4ed1-b515-b26d1a3908b7\") " Jul 01 20:19:49.986227 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.985095 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a79f6b45-701e-4ed1-b515-b26d1a3908b7" (UID: "a79f6b45-701e-4ed1-b515-b26d1a3908b7"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:19:49.986227 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.985161 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a79f6b45-701e-4ed1-b515-b26d1a3908b7" (UID: "a79f6b45-701e-4ed1-b515-b26d1a3908b7"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 20:19:49.986227 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.985739 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a79f6b45-701e-4ed1-b515-b26d1a3908b7" (UID: "a79f6b45-701e-4ed1-b515-b26d1a3908b7"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:19:49.986227 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.985838 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a79f6b45-701e-4ed1-b515-b26d1a3908b7" (UID: "a79f6b45-701e-4ed1-b515-b26d1a3908b7"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:19:49.986227 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.986141 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a79f6b45-701e-4ed1-b515-b26d1a3908b7" (UID: "a79f6b45-701e-4ed1-b515-b26d1a3908b7"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:19:49.986570 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.986515 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "a79f6b45-701e-4ed1-b515-b26d1a3908b7" (UID: "a79f6b45-701e-4ed1-b515-b26d1a3908b7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:19:49.986933 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.986907 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a79f6b45-701e-4ed1-b515-b26d1a3908b7" (UID: "a79f6b45-701e-4ed1-b515-b26d1a3908b7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:19:49.987498 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.987476 2574 scope.go:117] "RemoveContainer" containerID="ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2" Jul 01 20:19:49.988126 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.988095 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "a79f6b45-701e-4ed1-b515-b26d1a3908b7" (UID: "a79f6b45-701e-4ed1-b515-b26d1a3908b7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:19:49.990180 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.988622 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a79f6b45-701e-4ed1-b515-b26d1a3908b7" (UID: "a79f6b45-701e-4ed1-b515-b26d1a3908b7"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:19:49.990180 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.988892 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a79f6b45-701e-4ed1-b515-b26d1a3908b7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a79f6b45-701e-4ed1-b515-b26d1a3908b7" (UID: "a79f6b45-701e-4ed1-b515-b26d1a3908b7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:19:49.990783 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.990754 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a79f6b45-701e-4ed1-b515-b26d1a3908b7-config-out" (OuterVolumeSpecName: "config-out") pod "a79f6b45-701e-4ed1-b515-b26d1a3908b7" (UID: "a79f6b45-701e-4ed1-b515-b26d1a3908b7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 20:19:49.990889 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.990801 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a79f6b45-701e-4ed1-b515-b26d1a3908b7" (UID: "a79f6b45-701e-4ed1-b515-b26d1a3908b7"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:19:49.990889 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.990845 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a79f6b45-701e-4ed1-b515-b26d1a3908b7" (UID: "a79f6b45-701e-4ed1-b515-b26d1a3908b7"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:19:49.991013 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.990908 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a79f6b45-701e-4ed1-b515-b26d1a3908b7" (UID: "a79f6b45-701e-4ed1-b515-b26d1a3908b7"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:19:49.991013 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.990985 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a79f6b45-701e-4ed1-b515-b26d1a3908b7-kube-api-access-xmw6d" (OuterVolumeSpecName: "kube-api-access-xmw6d") pod "a79f6b45-701e-4ed1-b515-b26d1a3908b7" (UID: "a79f6b45-701e-4ed1-b515-b26d1a3908b7"). InnerVolumeSpecName "kube-api-access-xmw6d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:19:49.991290 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.991264 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a79f6b45-701e-4ed1-b515-b26d1a3908b7" (UID: "a79f6b45-701e-4ed1-b515-b26d1a3908b7"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:19:49.991401 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.991321 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a79f6b45-701e-4ed1-b515-b26d1a3908b7" (UID: "a79f6b45-701e-4ed1-b515-b26d1a3908b7"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:19:49.991845 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.991826 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-config" (OuterVolumeSpecName: "config") pod "a79f6b45-701e-4ed1-b515-b26d1a3908b7" (UID: "a79f6b45-701e-4ed1-b515-b26d1a3908b7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:19:49.992222 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.992201 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a79f6b45-701e-4ed1-b515-b26d1a3908b7" (UID: "a79f6b45-701e-4ed1-b515-b26d1a3908b7"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:19:49.998566 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:49.998549 2574 scope.go:117] "RemoveContainer" containerID="043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b" Jul 01 20:19:50.000563 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.000542 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-web-config" (OuterVolumeSpecName: "web-config") pod "a79f6b45-701e-4ed1-b515-b26d1a3908b7" (UID: "a79f6b45-701e-4ed1-b515-b26d1a3908b7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:19:50.005514 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.005496 2574 scope.go:117] "RemoveContainer" containerID="ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb" Jul 01 20:19:50.013673 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.013654 2574 scope.go:117] "RemoveContainer" containerID="beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6" Jul 01 20:19:50.019988 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.019961 2574 scope.go:117] "RemoveContainer" containerID="0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b" Jul 01 20:19:50.020260 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:19:50.020243 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b\": container with ID starting with 0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b not found: ID does not exist" containerID="0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b" Jul 01 20:19:50.020314 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.020269 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b"} err="failed to get container status \"0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b\": rpc error: code = NotFound desc = could not find container \"0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b\": container with ID starting with 0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b not found: ID does not exist" Jul 01 20:19:50.020314 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.020289 2574 scope.go:117] "RemoveContainer" containerID="28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062" Jul 01 20:19:50.020555 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:19:50.020536 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062\": container with ID starting with 28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062 not found: ID does not exist" containerID="28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062" Jul 01 20:19:50.020612 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.020563 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062"} err="failed to get container status \"28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062\": rpc error: code = NotFound desc = could not find container \"28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062\": container with ID starting with 28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062 not found: ID does not exist" Jul 01 20:19:50.020612 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.020580 2574 scope.go:117] "RemoveContainer" containerID="5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432" Jul 01 20:19:50.020817 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:19:50.020803 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432\": container with ID starting with 5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432 not found: ID does not exist" containerID="5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432" Jul 01 20:19:50.020852 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.020820 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432"} err="failed to get container status \"5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432\": rpc error: code = NotFound desc = could not find container \"5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432\": container with ID starting with 5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432 not found: ID does not exist" Jul 01 20:19:50.020852 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.020835 2574 scope.go:117] "RemoveContainer" containerID="ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2" Jul 01 20:19:50.021052 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:19:50.021037 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2\": container with ID starting with ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2 not found: ID does not exist" containerID="ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2" Jul 01 20:19:50.021099 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.021056 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2"} err="failed to get container status \"ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2\": rpc error: code = NotFound desc = could not find container \"ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2\": container with ID starting with ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2 not found: ID does not exist" Jul 01 20:19:50.021099 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.021078 2574 scope.go:117] "RemoveContainer" containerID="043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b" Jul 01 20:19:50.021301 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:19:50.021285 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b\": container with ID starting with 043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b not found: ID does not exist" containerID="043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b" Jul 01 20:19:50.021359 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.021312 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b"} err="failed to get container status \"043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b\": rpc error: code = NotFound desc = could not find container \"043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b\": container with ID starting with 043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b not found: ID does not exist" Jul 01 20:19:50.021359 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.021347 2574 scope.go:117] "RemoveContainer" containerID="ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb" Jul 01 20:19:50.021570 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:19:50.021556 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb\": container with ID starting with ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb not found: ID does not exist" containerID="ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb" Jul 01 20:19:50.021628 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.021573 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb"} err="failed to get container status \"ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb\": rpc error: code = NotFound desc = could not find container \"ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb\": container with ID starting with ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb not found: ID does not exist" Jul 01 20:19:50.021628 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.021585 2574 scope.go:117] "RemoveContainer" containerID="beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6" Jul 01 20:19:50.021822 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:19:50.021802 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6\": container with ID starting with beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6 not found: ID does not exist" containerID="beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6" Jul 01 20:19:50.021858 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.021831 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6"} err="failed to get container status \"beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6\": rpc error: code = NotFound desc = could not find container \"beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6\": container with ID starting with beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6 not found: ID does not exist" Jul 01 20:19:50.021858 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.021851 2574 scope.go:117] "RemoveContainer" containerID="0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b" Jul 01 20:19:50.022082 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.022060 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b"} err="failed to get container status \"0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b\": rpc error: code = NotFound desc = could not find container \"0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b\": container with ID starting with 0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b not found: ID does not exist" Jul 01 20:19:50.022145 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.022084 2574 scope.go:117] "RemoveContainer" containerID="28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062" Jul 01 20:19:50.022359 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.022338 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062"} err="failed to get container status \"28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062\": rpc error: code = NotFound desc = could not find container \"28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062\": container with ID starting with 28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062 not found: ID does not exist" Jul 01 20:19:50.022440 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.022362 2574 scope.go:117] "RemoveContainer" containerID="5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432" Jul 01 20:19:50.022632 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.022612 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432"} err="failed to get container status \"5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432\": rpc error: code = NotFound desc = could not find container \"5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432\": container with ID starting with 5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432 not found: ID does not exist" Jul 01 20:19:50.022680 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.022633 2574 scope.go:117] "RemoveContainer" containerID="ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2" Jul 01 20:19:50.022839 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.022824 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2"} err="failed to get container status \"ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2\": rpc error: code = NotFound desc = could not find container \"ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2\": container with ID starting with ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2 not found: ID does not exist" Jul 01 20:19:50.022889 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.022840 2574 scope.go:117] "RemoveContainer" containerID="043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b" Jul 01 20:19:50.023056 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.023033 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b"} err="failed to get container status \"043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b\": rpc error: code = NotFound desc = could not find container \"043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b\": container with ID starting with 043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b not found: ID does not exist" Jul 01 20:19:50.023109 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.023060 2574 scope.go:117] "RemoveContainer" containerID="ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb" Jul 01 20:19:50.023270 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.023249 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb"} err="failed to get container status \"ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb\": rpc error: code = NotFound desc = could not find container \"ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb\": container with ID starting with ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb not found: ID does not exist" Jul 01 20:19:50.023360 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.023273 2574 scope.go:117] "RemoveContainer" containerID="beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6" Jul 01 20:19:50.023560 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.023539 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6"} err="failed to get container status \"beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6\": rpc error: code = NotFound desc = could not find container \"beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6\": container with ID starting with beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6 not found: ID does not exist" Jul 01 20:19:50.023614 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.023561 2574 scope.go:117] "RemoveContainer" containerID="0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b" Jul 01 20:19:50.023791 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.023772 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b"} err="failed to get container status \"0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b\": rpc error: code = NotFound desc = could not find container \"0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b\": container with ID starting with 0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b not found: ID does not exist" Jul 01 20:19:50.023880 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.023793 2574 scope.go:117] "RemoveContainer" containerID="28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062" Jul 01 20:19:50.024044 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.024026 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062"} err="failed to get container status \"28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062\": rpc error: code = NotFound desc = could not find container \"28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062\": container with ID starting with 28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062 not found: ID does not exist" Jul 01 20:19:50.024103 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.024045 2574 scope.go:117] "RemoveContainer" containerID="5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432" Jul 01 20:19:50.024294 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.024277 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432"} err="failed to get container status \"5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432\": rpc error: code = NotFound desc = could not find container \"5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432\": container with ID starting with 5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432 not found: ID does not exist" Jul 01 20:19:50.024353 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.024295 2574 scope.go:117] "RemoveContainer" containerID="ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2" Jul 01 20:19:50.024522 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.024503 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2"} err="failed to get container status \"ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2\": rpc error: code = NotFound desc = could not find container \"ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2\": container with ID starting with ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2 not found: ID does not exist" Jul 01 20:19:50.024588 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.024523 2574 scope.go:117] "RemoveContainer" containerID="043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b" Jul 01 20:19:50.024733 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.024718 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b"} err="failed to get container status \"043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b\": rpc error: code = NotFound desc = could not find container \"043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b\": container with ID starting with 043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b not found: ID does not exist" Jul 01 20:19:50.024800 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.024734 2574 scope.go:117] "RemoveContainer" containerID="ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb" Jul 01 20:19:50.024940 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.024924 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb"} err="failed to get container status \"ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb\": rpc error: code = NotFound desc = could not find container \"ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb\": container with ID starting with ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb not found: ID does not exist" Jul 01 20:19:50.025002 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.024940 2574 scope.go:117] "RemoveContainer" containerID="beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6" Jul 01 20:19:50.025142 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.025124 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6"} err="failed to get container status \"beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6\": rpc error: code = NotFound desc = could not find container \"beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6\": container with ID starting with beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6 not found: ID does not exist" Jul 01 20:19:50.025226 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.025144 2574 scope.go:117] "RemoveContainer" containerID="0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b" Jul 01 20:19:50.025392 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.025373 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b"} err="failed to get container status \"0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b\": rpc error: code = NotFound desc = could not find container \"0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b\": container with ID starting with 0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b not found: ID does not exist" Jul 01 20:19:50.025454 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.025392 2574 scope.go:117] "RemoveContainer" containerID="28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062" Jul 01 20:19:50.025665 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.025647 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062"} err="failed to get container status \"28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062\": rpc error: code = NotFound desc = could not find container \"28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062\": container with ID starting with 28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062 not found: ID does not exist" Jul 01 20:19:50.025732 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.025668 2574 scope.go:117] "RemoveContainer" containerID="5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432" Jul 01 20:19:50.025887 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.025871 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432"} err="failed to get container status \"5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432\": rpc error: code = NotFound desc = could not find container \"5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432\": container with ID starting with 5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432 not found: ID does not exist" Jul 01 20:19:50.025887 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.025887 2574 scope.go:117] "RemoveContainer" containerID="ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2" Jul 01 20:19:50.026149 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.026128 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2"} err="failed to get container status \"ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2\": rpc error: code = NotFound desc = could not find container \"ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2\": container with ID starting with ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2 not found: ID does not exist" Jul 01 20:19:50.026149 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.026148 2574 scope.go:117] "RemoveContainer" containerID="043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b" Jul 01 20:19:50.026405 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.026382 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b"} err="failed to get container status \"043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b\": rpc error: code = NotFound desc = could not find container \"043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b\": container with ID starting with 043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b not found: ID does not exist" Jul 01 20:19:50.026463 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.026408 2574 scope.go:117] "RemoveContainer" containerID="ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb" Jul 01 20:19:50.026618 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.026602 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb"} err="failed to get container status \"ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb\": rpc error: code = NotFound desc = could not find container \"ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb\": container with ID starting with ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb not found: ID does not exist" Jul 01 20:19:50.026618 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.026618 2574 scope.go:117] "RemoveContainer" containerID="beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6" Jul 01 20:19:50.026849 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.026835 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6"} err="failed to get container status \"beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6\": rpc error: code = NotFound desc = could not find container \"beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6\": container with ID starting with beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6 not found: ID does not exist" Jul 01 20:19:50.026849 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.026849 2574 scope.go:117] "RemoveContainer" containerID="0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b" Jul 01 20:19:50.027059 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.027039 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b"} err="failed to get container status \"0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b\": rpc error: code = NotFound desc = could not find container \"0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b\": container with ID starting with 0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b not found: ID does not exist" Jul 01 20:19:50.027124 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.027059 2574 scope.go:117] "RemoveContainer" containerID="28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062" Jul 01 20:19:50.027354 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.027308 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062"} err="failed to get container status \"28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062\": rpc error: code = NotFound desc = could not find container \"28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062\": container with ID starting with 28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062 not found: ID does not exist" Jul 01 20:19:50.027438 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.027355 2574 scope.go:117] "RemoveContainer" containerID="5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432" Jul 01 20:19:50.027632 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.027608 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432"} err="failed to get container status \"5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432\": rpc error: code = NotFound desc = could not find container \"5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432\": container with ID starting with 5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432 not found: ID does not exist" Jul 01 20:19:50.027709 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.027634 2574 scope.go:117] "RemoveContainer" containerID="ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2" Jul 01 20:19:50.029783 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.027968 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2"} err="failed to get container status \"ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2\": rpc error: code = NotFound desc = could not find container \"ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2\": container with ID starting with ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2 not found: ID does not exist" Jul 01 20:19:50.029783 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.027991 2574 scope.go:117] "RemoveContainer" containerID="043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b" Jul 01 20:19:50.029783 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.028220 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b"} err="failed to get container status \"043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b\": rpc error: code = NotFound desc = could not find container \"043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b\": container with ID starting with 043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b not found: ID does not exist" Jul 01 20:19:50.029783 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.028247 2574 scope.go:117] "RemoveContainer" containerID="ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb" Jul 01 20:19:50.029783 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.028567 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb"} err="failed to get container status \"ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb\": rpc error: code = NotFound desc = could not find container \"ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb\": container with ID starting with ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb not found: ID does not exist" Jul 01 20:19:50.029783 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.028596 2574 scope.go:117] "RemoveContainer" containerID="beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6" Jul 01 20:19:50.029783 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.028809 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6"} err="failed to get container status \"beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6\": rpc error: code = NotFound desc = could not find container \"beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6\": container with ID starting with beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6 not found: ID does not exist" Jul 01 20:19:50.029783 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.028836 2574 scope.go:117] "RemoveContainer" containerID="0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b" Jul 01 20:19:50.029783 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.029047 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b"} err="failed to get container status \"0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b\": rpc error: code = NotFound desc = could not find container \"0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b\": container with ID starting with 0b7b5e12bf591ea3ac486e8e7bda7b12892d23fbe9eb950caa6677b643f2ef4b not found: ID does not exist" Jul 01 20:19:50.029783 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.029075 2574 scope.go:117] "RemoveContainer" containerID="28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062" Jul 01 20:19:50.029783 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.029285 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062"} err="failed to get container status \"28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062\": rpc error: code = NotFound desc = could not find container \"28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062\": container with ID starting with 28a752a23537465bcdb4aea75ba2e30f34ad07bab848a090594484a351f71062 not found: ID does not exist" Jul 01 20:19:50.029783 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.029302 2574 scope.go:117] "RemoveContainer" containerID="5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432" Jul 01 20:19:50.029783 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.029530 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432"} err="failed to get container status \"5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432\": rpc error: code = NotFound desc = could not find container \"5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432\": container with ID starting with 5bb58a3770fbb31211071c1a5551004fca18294ec2033f454c610c8cde2f5432 not found: ID does not exist" Jul 01 20:19:50.029783 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.029548 2574 scope.go:117] "RemoveContainer" containerID="ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2" Jul 01 20:19:50.029783 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.029760 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2"} err="failed to get container status \"ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2\": rpc error: code = NotFound desc = could not find container \"ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2\": container with ID starting with ecf677537b72d79ec6e18f452e0fd939323897aea3711e9173fda0096507aea2 not found: ID does not exist" Jul 01 20:19:50.029783 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.029791 2574 scope.go:117] "RemoveContainer" containerID="043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b" Jul 01 20:19:50.030509 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.030011 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b"} err="failed to get container status \"043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b\": rpc error: code = NotFound desc = could not find container \"043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b\": container with ID starting with 043b19b906873cfc31c16d129665c182e2bbc2086e185bfb374b98ab3f108e5b not found: ID does not exist" Jul 01 20:19:50.030509 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.030032 2574 scope.go:117] "RemoveContainer" containerID="ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb" Jul 01 20:19:50.030509 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.030278 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb"} err="failed to get container status \"ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb\": rpc error: code = NotFound desc = could not find container \"ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb\": container with ID starting with ba480ab957db231f0d1079c1b56799cec527a05185908ad9dba761e87c38b3cb not found: ID does not exist" Jul 01 20:19:50.030509 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.030303 2574 scope.go:117] "RemoveContainer" containerID="beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6" Jul 01 20:19:50.030650 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.030550 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6"} err="failed to get container status \"beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6\": rpc error: code = NotFound desc = could not find container \"beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6\": container with ID starting with beac7c9e8aea9215fc24eb31f622063363cb89508831b42957fa2d48f7def2e6 not found: ID does not exist" Jul 01 20:19:50.086083 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.086047 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:19:50.086083 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.086079 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:19:50.086083 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.086091 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-web-config\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:19:50.086242 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.086101 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-k8s-db\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:19:50.086242 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.086110 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:19:50.086242 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.086119 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a79f6b45-701e-4ed1-b515-b26d1a3908b7-config-out\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:19:50.086242 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.086127 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:19:50.086242 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.086135 2574 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-kube-rbac-proxy\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:19:50.086242 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.086143 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:19:50.086242 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.086152 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmw6d\" (UniqueName: \"kubernetes.io/projected/a79f6b45-701e-4ed1-b515-b26d1a3908b7-kube-api-access-xmw6d\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:19:50.086242 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.086160 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:19:50.086242 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.086169 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:19:50.086242 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.086176 2574 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-metrics-client-certs\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:19:50.086242 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.086185 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:19:50.086242 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.086193 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:19:50.086242 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.086202 2574 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:19:50.086242 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.086209 2574 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-config\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:19:50.086242 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.086217 2574 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a79f6b45-701e-4ed1-b515-b26d1a3908b7-secret-grpc-tls\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:19:50.086242 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.086226 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a79f6b45-701e-4ed1-b515-b26d1a3908b7-configmap-metrics-client-ca\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:19:50.086242 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.086234 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a79f6b45-701e-4ed1-b515-b26d1a3908b7-tls-assets\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:19:50.276961 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.276928 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 20:19:50.281789 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.281763 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 20:19:50.311078 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.311052 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 20:19:50.311366 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.311349 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerName="prometheus" Jul 01 20:19:50.311447 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.311368 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerName="prometheus" Jul 01 20:19:50.311447 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.311389 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerName="config-reloader" Jul 01 20:19:50.311447 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.311398 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerName="config-reloader" Jul 01 20:19:50.311447 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.311414 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4e1d64b-5c14-4934-80ca-7aaf4a1f757c" containerName="console" Jul 01 20:19:50.311447 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.311423 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4e1d64b-5c14-4934-80ca-7aaf4a1f757c" containerName="console" Jul 01 20:19:50.311447 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.311435 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36304709-2f6a-4a99-aa15-606ce43c0e84" containerName="console" Jul 01 20:19:50.311447 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.311443 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="36304709-2f6a-4a99-aa15-606ce43c0e84" containerName="console" Jul 01 20:19:50.311762 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.311454 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerName="kube-rbac-proxy-web" Jul 01 20:19:50.311762 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.311463 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerName="kube-rbac-proxy-web" Jul 01 20:19:50.311762 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.311474 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerName="kube-rbac-proxy" Jul 01 20:19:50.311762 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.311482 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerName="kube-rbac-proxy" Jul 01 20:19:50.311762 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.311493 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerName="kube-rbac-proxy-thanos" Jul 01 20:19:50.311762 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.311501 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerName="kube-rbac-proxy-thanos" Jul 01 20:19:50.311762 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.311514 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerName="init-config-reloader" Jul 01 20:19:50.311762 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.311522 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerName="init-config-reloader" Jul 01 20:19:50.311762 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.311531 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerName="thanos-sidecar" Jul 01 20:19:50.311762 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.311540 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerName="thanos-sidecar" Jul 01 20:19:50.311762 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.311606 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="36304709-2f6a-4a99-aa15-606ce43c0e84" containerName="console" Jul 01 20:19:50.311762 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.311619 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerName="thanos-sidecar" Jul 01 20:19:50.311762 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.311629 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerName="kube-rbac-proxy-thanos" Jul 01 20:19:50.311762 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.311638 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4e1d64b-5c14-4934-80ca-7aaf4a1f757c" containerName="console" Jul 01 20:19:50.311762 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.311648 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerName="config-reloader" Jul 01 20:19:50.311762 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.311656 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerName="kube-rbac-proxy" Jul 01 20:19:50.311762 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.311667 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerName="prometheus" Jul 01 20:19:50.311762 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.311675 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" containerName="kube-rbac-proxy-web" Jul 01 20:19:50.317474 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.317452 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.319531 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.319510 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 01 20:19:50.319658 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.319575 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 01 20:19:50.319781 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.319769 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 01 20:19:50.320244 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.320228 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 01 20:19:50.320306 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.320229 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 01 20:19:50.321551 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.321535 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 01 20:19:50.321635 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.321577 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 01 20:19:50.321635 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.321580 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 01 20:19:50.321635 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.321617 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 01 20:19:50.321635 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.321623 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 01 20:19:50.321635 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.321630 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 01 20:19:50.321929 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.321910 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 01 20:19:50.322026 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.322011 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 01 20:19:50.322870 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.322670 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-af330e49ktup2\"" Jul 01 20:19:50.327466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.326776 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7djpx\"" Jul 01 20:19:50.328515 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.328493 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 01 20:19:50.331191 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.331170 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 20:19:50.331270 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.331255 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 01 20:19:50.388148 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.388102 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cd552fdd-e599-47bf-8e81-a207df8e63ac-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.388148 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.388152 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cd552fdd-e599-47bf-8e81-a207df8e63ac-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.388371 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.388171 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cd552fdd-e599-47bf-8e81-a207df8e63ac-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.388371 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.388189 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cd552fdd-e599-47bf-8e81-a207df8e63ac-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.388371 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.388245 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cd552fdd-e599-47bf-8e81-a207df8e63ac-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.388371 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.388295 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cd552fdd-e599-47bf-8e81-a207df8e63ac-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.388371 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.388352 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cd552fdd-e599-47bf-8e81-a207df8e63ac-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.388527 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.388376 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd552fdd-e599-47bf-8e81-a207df8e63ac-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.388527 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.388420 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd552fdd-e599-47bf-8e81-a207df8e63ac-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.388527 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.388437 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cd552fdd-e599-47bf-8e81-a207df8e63ac-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.388527 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.388452 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cd552fdd-e599-47bf-8e81-a207df8e63ac-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.388527 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.388468 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cd552fdd-e599-47bf-8e81-a207df8e63ac-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.388527 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.388498 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cd552fdd-e599-47bf-8e81-a207df8e63ac-config-out\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.388527 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.388519 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cd552fdd-e599-47bf-8e81-a207df8e63ac-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.388725 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.388541 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd552fdd-e599-47bf-8e81-a207df8e63ac-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.388725 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.388561 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd552fdd-e599-47bf-8e81-a207df8e63ac-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.388725 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.388577 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cd552fdd-e599-47bf-8e81-a207df8e63ac-web-config\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.388725 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.388591 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cd552fdd-e599-47bf-8e81-a207df8e63ac-config\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.388725 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.388620 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cd552fdd-e599-47bf-8e81-a207df8e63ac-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.388725 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.388637 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqw4x\" (UniqueName: \"kubernetes.io/projected/cd552fdd-e599-47bf-8e81-a207df8e63ac-kube-api-access-wqw4x\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.489644 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.489553 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cd552fdd-e599-47bf-8e81-a207df8e63ac-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.489644 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.489597 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cd552fdd-e599-47bf-8e81-a207df8e63ac-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.489644 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.489613 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cd552fdd-e599-47bf-8e81-a207df8e63ac-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.489644 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.489630 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cd552fdd-e599-47bf-8e81-a207df8e63ac-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.489945 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.489774 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cd552fdd-e599-47bf-8e81-a207df8e63ac-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.489945 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.489840 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cd552fdd-e599-47bf-8e81-a207df8e63ac-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.489945 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.489870 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd552fdd-e599-47bf-8e81-a207df8e63ac-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.489945 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.489902 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd552fdd-e599-47bf-8e81-a207df8e63ac-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.489945 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.489931 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cd552fdd-e599-47bf-8e81-a207df8e63ac-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.490243 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.489960 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cd552fdd-e599-47bf-8e81-a207df8e63ac-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.490243 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.489979 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cd552fdd-e599-47bf-8e81-a207df8e63ac-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.490243 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.489986 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cd552fdd-e599-47bf-8e81-a207df8e63ac-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.490243 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.490027 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cd552fdd-e599-47bf-8e81-a207df8e63ac-config-out\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.490243 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.490063 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cd552fdd-e599-47bf-8e81-a207df8e63ac-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.490243 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.490093 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd552fdd-e599-47bf-8e81-a207df8e63ac-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.490243 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.490123 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd552fdd-e599-47bf-8e81-a207df8e63ac-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.490622 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.490309 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cd552fdd-e599-47bf-8e81-a207df8e63ac-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.490861 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.490838 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cd552fdd-e599-47bf-8e81-a207df8e63ac-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.490936 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.490911 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd552fdd-e599-47bf-8e81-a207df8e63ac-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.490999 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.490950 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cd552fdd-e599-47bf-8e81-a207df8e63ac-web-config\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.490999 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.490982 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cd552fdd-e599-47bf-8e81-a207df8e63ac-config\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.491110 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.491019 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cd552fdd-e599-47bf-8e81-a207df8e63ac-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.491110 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.491050 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqw4x\" (UniqueName: \"kubernetes.io/projected/cd552fdd-e599-47bf-8e81-a207df8e63ac-kube-api-access-wqw4x\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.491110 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.491080 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cd552fdd-e599-47bf-8e81-a207df8e63ac-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.492956 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.492019 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd552fdd-e599-47bf-8e81-a207df8e63ac-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.492956 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.492686 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd552fdd-e599-47bf-8e81-a207df8e63ac-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.492956 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.492785 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cd552fdd-e599-47bf-8e81-a207df8e63ac-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.492956 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.492811 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cd552fdd-e599-47bf-8e81-a207df8e63ac-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.492956 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.492819 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cd552fdd-e599-47bf-8e81-a207df8e63ac-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.492956 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.492841 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cd552fdd-e599-47bf-8e81-a207df8e63ac-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.493567 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.493228 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cd552fdd-e599-47bf-8e81-a207df8e63ac-config-out\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.493567 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.493495 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd552fdd-e599-47bf-8e81-a207df8e63ac-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.493780 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.493729 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cd552fdd-e599-47bf-8e81-a207df8e63ac-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.493865 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.493785 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cd552fdd-e599-47bf-8e81-a207df8e63ac-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.495232 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.495205 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cd552fdd-e599-47bf-8e81-a207df8e63ac-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.495363 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.495349 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cd552fdd-e599-47bf-8e81-a207df8e63ac-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.495442 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.495426 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/cd552fdd-e599-47bf-8e81-a207df8e63ac-config\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.495442 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.495433 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cd552fdd-e599-47bf-8e81-a207df8e63ac-web-config\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.495687 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.495674 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cd552fdd-e599-47bf-8e81-a207df8e63ac-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.501018 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.500996 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqw4x\" (UniqueName: \"kubernetes.io/projected/cd552fdd-e599-47bf-8e81-a207df8e63ac-kube-api-access-wqw4x\") pod \"prometheus-k8s-0\" (UID: \"cd552fdd-e599-47bf-8e81-a207df8e63ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.631681 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.631650 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:19:50.767532 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.767506 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 20:19:50.768980 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:19:50.768957 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd552fdd_e599_47bf_8e81_a207df8e63ac.slice/crio-38fc25b518c3d43fb59b8ea7b3789d8e0ec80540e7236d8419399a50626b05da WatchSource:0}: Error finding container 38fc25b518c3d43fb59b8ea7b3789d8e0ec80540e7236d8419399a50626b05da: Status 404 returned error can't find the container with id 38fc25b518c3d43fb59b8ea7b3789d8e0ec80540e7236d8419399a50626b05da Jul 01 20:19:50.960757 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.960725 2574 generic.go:356] "Generic (PLEG): container finished" podID="cd552fdd-e599-47bf-8e81-a207df8e63ac" containerID="f48ba8d417c0d33a7290f3430fa5d155bf4a46db63fa66937fa46ff7714cd018" exitCode=0 Jul 01 20:19:50.960939 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.960825 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd552fdd-e599-47bf-8e81-a207df8e63ac","Type":"ContainerDied","Data":"f48ba8d417c0d33a7290f3430fa5d155bf4a46db63fa66937fa46ff7714cd018"} Jul 01 20:19:50.960939 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:50.960920 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd552fdd-e599-47bf-8e81-a207df8e63ac","Type":"ContainerStarted","Data":"38fc25b518c3d43fb59b8ea7b3789d8e0ec80540e7236d8419399a50626b05da"} Jul 01 20:19:51.975667 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:51.975581 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd552fdd-e599-47bf-8e81-a207df8e63ac","Type":"ContainerStarted","Data":"399b4f7e10dd5244eaa8a8c55565fa874c6cc3bde86002bb6bf6afbd9238b4c6"} Jul 01 20:19:51.975667 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:51.975662 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd552fdd-e599-47bf-8e81-a207df8e63ac","Type":"ContainerStarted","Data":"41cef4520324fc96c389ac73e120f1527bb9b0c2f50ed2eec077f48d4135d149"} Jul 01 20:19:51.976043 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:51.975687 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd552fdd-e599-47bf-8e81-a207df8e63ac","Type":"ContainerStarted","Data":"fc80ff09bb0091456316a1661f3bd1da32eda009659975d3d2515a3296135100"} Jul 01 20:19:51.976043 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:51.975712 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd552fdd-e599-47bf-8e81-a207df8e63ac","Type":"ContainerStarted","Data":"0ddee1e5fa3dadc853c3b5d18123e7d936c49ac3463beda1c463a176a8addf84"} Jul 01 20:19:51.976043 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:51.975734 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd552fdd-e599-47bf-8e81-a207df8e63ac","Type":"ContainerStarted","Data":"69788f713acd2c5073de58f418492200d85a9176270d869fa1cdecc71ab98445"} Jul 01 20:19:51.976043 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:51.975756 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd552fdd-e599-47bf-8e81-a207df8e63ac","Type":"ContainerStarted","Data":"ecc60135003b4a0dd8deedf570b0a92c22600807b8af0234c8b0d2308a4a1b5e"} Jul 01 20:19:52.011619 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:52.011571 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.989205502 podStartE2EDuration="2.01155535s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.349848ms" isStatefulPod=false podCreationTimestamp="2026-07-01 20:19:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:19:52.010830017 +0000 UTC m=+166.231322988" watchObservedRunningTime="2026-07-01 20:19:52.01155535 +0000 UTC m=+166.232048299" Jul 01 20:19:52.217671 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:52.217639 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a79f6b45-701e-4ed1-b515-b26d1a3908b7" path="/var/lib/kubelet/pods/a79f6b45-701e-4ed1-b515-b26d1a3908b7/volumes" Jul 01 20:19:55.632467 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:19:55.632423 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:20:50.632792 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:20:50.632754 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:20:50.647748 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:20:50.647724 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:20:51.197763 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:20:51.197735 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 20:21:17.222221 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:17.222187 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-g62kf"] Jul 01 20:21:17.224265 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:17.224250 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-g62kf" Jul 01 20:21:17.226455 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:17.226429 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-6pwd9\"" Jul 01 20:21:17.226455 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:17.226445 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 01 20:21:17.226671 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:17.226658 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 01 20:21:17.236658 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:17.236636 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-g62kf"] Jul 01 20:21:17.342148 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:17.342111 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rdd6\" (UniqueName: \"kubernetes.io/projected/e7f97ebd-76da-4f24-b6a8-12e3ccec1e34-kube-api-access-9rdd6\") pod \"cert-manager-webhook-7dc76cbb94-g62kf\" (UID: \"e7f97ebd-76da-4f24-b6a8-12e3ccec1e34\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-g62kf" Jul 01 20:21:17.342351 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:17.342170 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7f97ebd-76da-4f24-b6a8-12e3ccec1e34-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-g62kf\" (UID: \"e7f97ebd-76da-4f24-b6a8-12e3ccec1e34\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-g62kf" Jul 01 20:21:17.443372 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:17.443319 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7f97ebd-76da-4f24-b6a8-12e3ccec1e34-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-g62kf\" (UID: \"e7f97ebd-76da-4f24-b6a8-12e3ccec1e34\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-g62kf" Jul 01 20:21:17.443555 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:17.443417 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rdd6\" (UniqueName: \"kubernetes.io/projected/e7f97ebd-76da-4f24-b6a8-12e3ccec1e34-kube-api-access-9rdd6\") pod \"cert-manager-webhook-7dc76cbb94-g62kf\" (UID: \"e7f97ebd-76da-4f24-b6a8-12e3ccec1e34\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-g62kf" Jul 01 20:21:17.452725 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:17.452702 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rdd6\" (UniqueName: \"kubernetes.io/projected/e7f97ebd-76da-4f24-b6a8-12e3ccec1e34-kube-api-access-9rdd6\") pod \"cert-manager-webhook-7dc76cbb94-g62kf\" (UID: \"e7f97ebd-76da-4f24-b6a8-12e3ccec1e34\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-g62kf" Jul 01 20:21:17.452836 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:17.452741 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7f97ebd-76da-4f24-b6a8-12e3ccec1e34-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-g62kf\" (UID: \"e7f97ebd-76da-4f24-b6a8-12e3ccec1e34\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-g62kf" Jul 01 20:21:17.543858 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:17.543763 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-g62kf" Jul 01 20:21:17.665616 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:17.665592 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-g62kf"] Jul 01 20:21:17.667838 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:21:17.667813 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7f97ebd_76da_4f24_b6a8_12e3ccec1e34.slice/crio-c246e0e67e51d1214723f70073db2a51f9f4f1c023130e0be29ccf814448313a WatchSource:0}: Error finding container c246e0e67e51d1214723f70073db2a51f9f4f1c023130e0be29ccf814448313a: Status 404 returned error can't find the container with id c246e0e67e51d1214723f70073db2a51f9f4f1c023130e0be29ccf814448313a Jul 01 20:21:18.279888 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:18.279849 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-g62kf" event={"ID":"e7f97ebd-76da-4f24-b6a8-12e3ccec1e34","Type":"ContainerStarted","Data":"c246e0e67e51d1214723f70073db2a51f9f4f1c023130e0be29ccf814448313a"} Jul 01 20:21:21.291614 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:21.291579 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-g62kf" event={"ID":"e7f97ebd-76da-4f24-b6a8-12e3ccec1e34","Type":"ContainerStarted","Data":"6d4888d54b3ae676489281e2493e8101c2c044962ade0f41657fcd7a5033593c"} Jul 01 20:21:21.291983 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:21.291637 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-g62kf" Jul 01 20:21:21.309017 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:21.308972 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-g62kf" podStartSLOduration=1.417272889 podStartE2EDuration="4.308957042s" totalImagesPullingTime="2.891684153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:21:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:21:21.308519339 +0000 UTC m=+255.529012288" watchObservedRunningTime="2026-07-01 20:21:21.308957042 +0000 UTC m=+255.529449991" Jul 01 20:21:27.297258 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:27.297181 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-g62kf" Jul 01 20:21:47.761624 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:47.761588 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-gkvwb"] Jul 01 20:21:47.765755 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:47.765735 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-gkvwb" Jul 01 20:21:47.768572 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:47.768542 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 01 20:21:47.768711 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:47.768693 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 01 20:21:47.768754 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:47.768734 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 01 20:21:47.768961 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:47.768948 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 01 20:21:47.769823 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:47.769808 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bmcqh\"" Jul 01 20:21:47.808889 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:47.808860 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-gkvwb"] Jul 01 20:21:47.893891 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:47.893853 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3f91853-6619-4132-b6fe-26ee72c926d8-webhook-cert\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-gkvwb\" (UID: \"a3f91853-6619-4132-b6fe-26ee72c926d8\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-gkvwb" Jul 01 20:21:47.894168 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:47.894148 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a3f91853-6619-4132-b6fe-26ee72c926d8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-gkvwb\" (UID: \"a3f91853-6619-4132-b6fe-26ee72c926d8\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-gkvwb" Jul 01 20:21:47.894379 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:47.894359 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc7bd\" (UniqueName: \"kubernetes.io/projected/a3f91853-6619-4132-b6fe-26ee72c926d8-kube-api-access-kc7bd\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-gkvwb\" (UID: \"a3f91853-6619-4132-b6fe-26ee72c926d8\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-gkvwb" Jul 01 20:21:47.894505 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:47.894491 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a3f91853-6619-4132-b6fe-26ee72c926d8-manifests\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-gkvwb\" (UID: \"a3f91853-6619-4132-b6fe-26ee72c926d8\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-gkvwb" Jul 01 20:21:47.894606 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:47.894591 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3f91853-6619-4132-b6fe-26ee72c926d8-tmp\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-gkvwb\" (UID: \"a3f91853-6619-4132-b6fe-26ee72c926d8\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-gkvwb" Jul 01 20:21:47.995025 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:47.994987 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc7bd\" (UniqueName: \"kubernetes.io/projected/a3f91853-6619-4132-b6fe-26ee72c926d8-kube-api-access-kc7bd\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-gkvwb\" (UID: \"a3f91853-6619-4132-b6fe-26ee72c926d8\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-gkvwb" Jul 01 20:21:47.995025 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:47.995025 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a3f91853-6619-4132-b6fe-26ee72c926d8-manifests\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-gkvwb\" (UID: \"a3f91853-6619-4132-b6fe-26ee72c926d8\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-gkvwb" Jul 01 20:21:47.995221 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:47.995051 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3f91853-6619-4132-b6fe-26ee72c926d8-tmp\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-gkvwb\" (UID: \"a3f91853-6619-4132-b6fe-26ee72c926d8\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-gkvwb" Jul 01 20:21:47.995221 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:47.995089 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3f91853-6619-4132-b6fe-26ee72c926d8-webhook-cert\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-gkvwb\" (UID: \"a3f91853-6619-4132-b6fe-26ee72c926d8\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-gkvwb" Jul 01 20:21:47.995221 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:47.995123 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a3f91853-6619-4132-b6fe-26ee72c926d8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-gkvwb\" (UID: \"a3f91853-6619-4132-b6fe-26ee72c926d8\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-gkvwb" Jul 01 20:21:47.995494 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:47.995469 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a3f91853-6619-4132-b6fe-26ee72c926d8-manifests\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-gkvwb\" (UID: \"a3f91853-6619-4132-b6fe-26ee72c926d8\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-gkvwb" Jul 01 20:21:47.997424 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:47.997396 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3f91853-6619-4132-b6fe-26ee72c926d8-tmp\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-gkvwb\" (UID: \"a3f91853-6619-4132-b6fe-26ee72c926d8\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-gkvwb" Jul 01 20:21:47.997546 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:47.997520 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a3f91853-6619-4132-b6fe-26ee72c926d8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-gkvwb\" (UID: \"a3f91853-6619-4132-b6fe-26ee72c926d8\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-gkvwb" Jul 01 20:21:47.997650 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:47.997631 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3f91853-6619-4132-b6fe-26ee72c926d8-webhook-cert\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-gkvwb\" (UID: \"a3f91853-6619-4132-b6fe-26ee72c926d8\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-gkvwb" Jul 01 20:21:48.002888 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:48.002865 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc7bd\" (UniqueName: \"kubernetes.io/projected/a3f91853-6619-4132-b6fe-26ee72c926d8-kube-api-access-kc7bd\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-gkvwb\" (UID: \"a3f91853-6619-4132-b6fe-26ee72c926d8\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-gkvwb" Jul 01 20:21:48.076462 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:48.076377 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-gkvwb" Jul 01 20:21:48.204209 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:48.204187 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-gkvwb"] Jul 01 20:21:48.206909 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:21:48.206877 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3f91853_6619_4132_b6fe_26ee72c926d8.slice/crio-caff2586676d4bd0798086cc128d64f208111db78262b13d62656b439096859b WatchSource:0}: Error finding container caff2586676d4bd0798086cc128d64f208111db78262b13d62656b439096859b: Status 404 returned error can't find the container with id caff2586676d4bd0798086cc128d64f208111db78262b13d62656b439096859b Jul 01 20:21:48.388722 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:48.388689 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-gkvwb" event={"ID":"a3f91853-6619-4132-b6fe-26ee72c926d8","Type":"ContainerStarted","Data":"caff2586676d4bd0798086cc128d64f208111db78262b13d62656b439096859b"} Jul 01 20:21:51.402174 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:51.402137 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-gkvwb" event={"ID":"a3f91853-6619-4132-b6fe-26ee72c926d8","Type":"ContainerStarted","Data":"adb41f5b8fe99deba8e3d8044572cca139d1e537d07065fb96d35747d176db97"} Jul 01 20:21:52.406870 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:52.406776 2574 generic.go:356] "Generic (PLEG): container finished" podID="a3f91853-6619-4132-b6fe-26ee72c926d8" containerID="adb41f5b8fe99deba8e3d8044572cca139d1e537d07065fb96d35747d176db97" exitCode=0 Jul 01 20:21:52.406870 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:52.406827 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-gkvwb" event={"ID":"a3f91853-6619-4132-b6fe-26ee72c926d8","Type":"ContainerDied","Data":"adb41f5b8fe99deba8e3d8044572cca139d1e537d07065fb96d35747d176db97"} Jul 01 20:21:53.412907 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:53.412868 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-gkvwb" event={"ID":"a3f91853-6619-4132-b6fe-26ee72c926d8","Type":"ContainerStarted","Data":"fcf6337db80412c59ac1cc85911d9fec387617136e7e241631bc4c0bb6a329db"} Jul 01 20:21:53.413404 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:53.413010 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-gkvwb" Jul 01 20:21:53.448986 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:21:53.448926 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-gkvwb" podStartSLOduration=2.112781603 podStartE2EDuration="6.448907249s" totalImagesPullingTime="3.340530586s" totalInitContainerRuntime="995.59506ms" isStatefulPod=false podCreationTimestamp="2026-07-01 20:21:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:21:53.447213052 +0000 UTC m=+287.667706017" watchObservedRunningTime="2026-07-01 20:21:53.448907249 +0000 UTC m=+287.669400268" Jul 01 20:22:04.418610 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:04.418568 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-gkvwb" Jul 01 20:22:06.164004 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:06.163977 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mfbr_7ece6589-3e50-4328-aa47-3a030462201a/ovn-acl-logging/0.log" Jul 01 20:22:06.166310 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:06.166279 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mfbr_7ece6589-3e50-4328-aa47-3a030462201a/ovn-acl-logging/0.log" Jul 01 20:22:06.177769 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:06.177746 2574 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 20:22:08.905491 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:08.905461 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7565f6b689-8pcz9"] Jul 01 20:22:08.908701 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:08.908686 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7565f6b689-8pcz9" Jul 01 20:22:08.910741 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:08.910725 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 01 20:22:08.910829 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:08.910819 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 01 20:22:08.911737 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:08.911717 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 01 20:22:08.911844 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:08.911718 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 01 20:22:08.912132 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:08.912116 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-dl79l\"" Jul 01 20:22:08.912215 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:08.912158 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 01 20:22:08.919114 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:08.919085 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7565f6b689-8pcz9"] Jul 01 20:22:08.947037 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:08.947012 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkgpb\" (UniqueName: \"kubernetes.io/projected/0154266f-4153-4f06-9bac-da3f628b2d23-kube-api-access-hkgpb\") pod \"lws-controller-manager-7565f6b689-8pcz9\" (UID: \"0154266f-4153-4f06-9bac-da3f628b2d23\") " pod="openshift-lws-operator/lws-controller-manager-7565f6b689-8pcz9" Jul 01 20:22:08.947170 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:08.947067 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0154266f-4153-4f06-9bac-da3f628b2d23-manager-config\") pod \"lws-controller-manager-7565f6b689-8pcz9\" (UID: \"0154266f-4153-4f06-9bac-da3f628b2d23\") " pod="openshift-lws-operator/lws-controller-manager-7565f6b689-8pcz9" Jul 01 20:22:08.947170 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:08.947094 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0154266f-4153-4f06-9bac-da3f628b2d23-metrics-cert\") pod \"lws-controller-manager-7565f6b689-8pcz9\" (UID: \"0154266f-4153-4f06-9bac-da3f628b2d23\") " pod="openshift-lws-operator/lws-controller-manager-7565f6b689-8pcz9" Jul 01 20:22:08.947246 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:08.947176 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0154266f-4153-4f06-9bac-da3f628b2d23-cert\") pod \"lws-controller-manager-7565f6b689-8pcz9\" (UID: \"0154266f-4153-4f06-9bac-da3f628b2d23\") " pod="openshift-lws-operator/lws-controller-manager-7565f6b689-8pcz9" Jul 01 20:22:09.048410 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:09.048372 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0154266f-4153-4f06-9bac-da3f628b2d23-manager-config\") pod \"lws-controller-manager-7565f6b689-8pcz9\" (UID: \"0154266f-4153-4f06-9bac-da3f628b2d23\") " pod="openshift-lws-operator/lws-controller-manager-7565f6b689-8pcz9" Jul 01 20:22:09.048410 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:09.048413 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0154266f-4153-4f06-9bac-da3f628b2d23-metrics-cert\") pod \"lws-controller-manager-7565f6b689-8pcz9\" (UID: \"0154266f-4153-4f06-9bac-da3f628b2d23\") " pod="openshift-lws-operator/lws-controller-manager-7565f6b689-8pcz9" Jul 01 20:22:09.048651 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:09.048431 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0154266f-4153-4f06-9bac-da3f628b2d23-cert\") pod \"lws-controller-manager-7565f6b689-8pcz9\" (UID: \"0154266f-4153-4f06-9bac-da3f628b2d23\") " pod="openshift-lws-operator/lws-controller-manager-7565f6b689-8pcz9" Jul 01 20:22:09.048651 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:09.048469 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkgpb\" (UniqueName: \"kubernetes.io/projected/0154266f-4153-4f06-9bac-da3f628b2d23-kube-api-access-hkgpb\") pod \"lws-controller-manager-7565f6b689-8pcz9\" (UID: \"0154266f-4153-4f06-9bac-da3f628b2d23\") " pod="openshift-lws-operator/lws-controller-manager-7565f6b689-8pcz9" Jul 01 20:22:09.049016 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:09.048995 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0154266f-4153-4f06-9bac-da3f628b2d23-manager-config\") pod \"lws-controller-manager-7565f6b689-8pcz9\" (UID: \"0154266f-4153-4f06-9bac-da3f628b2d23\") " pod="openshift-lws-operator/lws-controller-manager-7565f6b689-8pcz9" Jul 01 20:22:09.050879 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:09.050860 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0154266f-4153-4f06-9bac-da3f628b2d23-metrics-cert\") pod \"lws-controller-manager-7565f6b689-8pcz9\" (UID: \"0154266f-4153-4f06-9bac-da3f628b2d23\") " pod="openshift-lws-operator/lws-controller-manager-7565f6b689-8pcz9" Jul 01 20:22:09.050936 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:09.050906 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0154266f-4153-4f06-9bac-da3f628b2d23-cert\") pod \"lws-controller-manager-7565f6b689-8pcz9\" (UID: \"0154266f-4153-4f06-9bac-da3f628b2d23\") " pod="openshift-lws-operator/lws-controller-manager-7565f6b689-8pcz9" Jul 01 20:22:09.062258 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:09.062236 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkgpb\" (UniqueName: \"kubernetes.io/projected/0154266f-4153-4f06-9bac-da3f628b2d23-kube-api-access-hkgpb\") pod \"lws-controller-manager-7565f6b689-8pcz9\" (UID: \"0154266f-4153-4f06-9bac-da3f628b2d23\") " pod="openshift-lws-operator/lws-controller-manager-7565f6b689-8pcz9" Jul 01 20:22:09.217925 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:09.217831 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7565f6b689-8pcz9" Jul 01 20:22:09.354044 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:09.354010 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7565f6b689-8pcz9"] Jul 01 20:22:09.359301 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:22:09.359274 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0154266f_4153_4f06_9bac_da3f628b2d23.slice/crio-ec461c2bea91c415f6ca5937c6138d763715e9b38978a8fc6af046e2223c67bc WatchSource:0}: Error finding container ec461c2bea91c415f6ca5937c6138d763715e9b38978a8fc6af046e2223c67bc: Status 404 returned error can't find the container with id ec461c2bea91c415f6ca5937c6138d763715e9b38978a8fc6af046e2223c67bc Jul 01 20:22:09.361223 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:09.361209 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 20:22:09.471709 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:09.471633 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7565f6b689-8pcz9" event={"ID":"0154266f-4153-4f06-9bac-da3f628b2d23","Type":"ContainerStarted","Data":"ec461c2bea91c415f6ca5937c6138d763715e9b38978a8fc6af046e2223c67bc"} Jul 01 20:22:13.487732 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:13.487694 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7565f6b689-8pcz9" event={"ID":"0154266f-4153-4f06-9bac-da3f628b2d23","Type":"ContainerStarted","Data":"5270b68abd34e69fccb96d0cd3c36db071b9a4c189ed051239f46ccd551d2b8b"} Jul 01 20:22:13.488147 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:13.487889 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7565f6b689-8pcz9" Jul 01 20:22:13.506214 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:13.506170 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7565f6b689-8pcz9" podStartSLOduration=2.197297579 podStartE2EDuration="5.506155331s" totalImagesPullingTime="3.308857752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:22:13.505353103 +0000 UTC m=+307.725846054" watchObservedRunningTime="2026-07-01 20:22:13.506155331 +0000 UTC m=+307.726648280" Jul 01 20:22:18.205858 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:18.205822 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5f97fd55b7-bscqb"] Jul 01 20:22:18.209413 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:18.209392 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f97fd55b7-bscqb" Jul 01 20:22:18.216538 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:18.216511 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 01 20:22:18.216688 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:18.216661 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 20:22:18.217493 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:18.217470 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 20:22:18.217493 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:18.217483 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 01 20:22:18.217656 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:18.217493 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dfdcm\"" Jul 01 20:22:18.236737 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:18.236714 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f97fd55b7-bscqb"] Jul 01 20:22:18.327244 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:18.327213 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7107a7c-acf7-460f-9efb-ad355eb04091-tmp\") pod \"kube-auth-proxy-5f97fd55b7-bscqb\" (UID: \"e7107a7c-acf7-460f-9efb-ad355eb04091\") " pod="openshift-ingress/kube-auth-proxy-5f97fd55b7-bscqb" Jul 01 20:22:18.327439 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:18.327271 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7107a7c-acf7-460f-9efb-ad355eb04091-tls-certs\") pod \"kube-auth-proxy-5f97fd55b7-bscqb\" (UID: \"e7107a7c-acf7-460f-9efb-ad355eb04091\") " pod="openshift-ingress/kube-auth-proxy-5f97fd55b7-bscqb" Jul 01 20:22:18.327439 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:18.327317 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhkmz\" (UniqueName: \"kubernetes.io/projected/e7107a7c-acf7-460f-9efb-ad355eb04091-kube-api-access-rhkmz\") pod \"kube-auth-proxy-5f97fd55b7-bscqb\" (UID: \"e7107a7c-acf7-460f-9efb-ad355eb04091\") " pod="openshift-ingress/kube-auth-proxy-5f97fd55b7-bscqb" Jul 01 20:22:18.427754 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:18.427711 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7107a7c-acf7-460f-9efb-ad355eb04091-tmp\") pod \"kube-auth-proxy-5f97fd55b7-bscqb\" (UID: \"e7107a7c-acf7-460f-9efb-ad355eb04091\") " pod="openshift-ingress/kube-auth-proxy-5f97fd55b7-bscqb" Jul 01 20:22:18.427950 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:18.427772 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7107a7c-acf7-460f-9efb-ad355eb04091-tls-certs\") pod \"kube-auth-proxy-5f97fd55b7-bscqb\" (UID: \"e7107a7c-acf7-460f-9efb-ad355eb04091\") " pod="openshift-ingress/kube-auth-proxy-5f97fd55b7-bscqb" Jul 01 20:22:18.427950 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:18.427803 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhkmz\" (UniqueName: \"kubernetes.io/projected/e7107a7c-acf7-460f-9efb-ad355eb04091-kube-api-access-rhkmz\") pod \"kube-auth-proxy-5f97fd55b7-bscqb\" (UID: \"e7107a7c-acf7-460f-9efb-ad355eb04091\") " pod="openshift-ingress/kube-auth-proxy-5f97fd55b7-bscqb" Jul 01 20:22:18.430059 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:18.430028 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7107a7c-acf7-460f-9efb-ad355eb04091-tmp\") pod \"kube-auth-proxy-5f97fd55b7-bscqb\" (UID: \"e7107a7c-acf7-460f-9efb-ad355eb04091\") " pod="openshift-ingress/kube-auth-proxy-5f97fd55b7-bscqb" Jul 01 20:22:18.430257 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:18.430236 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7107a7c-acf7-460f-9efb-ad355eb04091-tls-certs\") pod \"kube-auth-proxy-5f97fd55b7-bscqb\" (UID: \"e7107a7c-acf7-460f-9efb-ad355eb04091\") " pod="openshift-ingress/kube-auth-proxy-5f97fd55b7-bscqb" Jul 01 20:22:18.437319 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:18.437295 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhkmz\" (UniqueName: \"kubernetes.io/projected/e7107a7c-acf7-460f-9efb-ad355eb04091-kube-api-access-rhkmz\") pod \"kube-auth-proxy-5f97fd55b7-bscqb\" (UID: \"e7107a7c-acf7-460f-9efb-ad355eb04091\") " pod="openshift-ingress/kube-auth-proxy-5f97fd55b7-bscqb" Jul 01 20:22:18.519178 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:18.519090 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f97fd55b7-bscqb" Jul 01 20:22:18.652823 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:18.652798 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f97fd55b7-bscqb"] Jul 01 20:22:18.655351 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:22:18.655312 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7107a7c_acf7_460f_9efb_ad355eb04091.slice/crio-bb012fe18c836cdbcd830aa39b29e246e915fede188168f0fc9b6f6c90a37bc5 WatchSource:0}: Error finding container bb012fe18c836cdbcd830aa39b29e246e915fede188168f0fc9b6f6c90a37bc5: Status 404 returned error can't find the container with id bb012fe18c836cdbcd830aa39b29e246e915fede188168f0fc9b6f6c90a37bc5 Jul 01 20:22:19.515245 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:19.515209 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f97fd55b7-bscqb" event={"ID":"e7107a7c-acf7-460f-9efb-ad355eb04091","Type":"ContainerStarted","Data":"bb012fe18c836cdbcd830aa39b29e246e915fede188168f0fc9b6f6c90a37bc5"} Jul 01 20:22:22.527629 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:22.527589 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f97fd55b7-bscqb" event={"ID":"e7107a7c-acf7-460f-9efb-ad355eb04091","Type":"ContainerStarted","Data":"9b91c1b12715497c005193a30cd754b236b79786da5123b22b16fc66777706df"} Jul 01 20:22:22.547746 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:22.547688 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5f97fd55b7-bscqb" podStartSLOduration=1.5179738600000001 podStartE2EDuration="4.547672602s" totalImagesPullingTime="3.029698742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:22:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:22:22.546246088 +0000 UTC m=+316.766739037" watchObservedRunningTime="2026-07-01 20:22:22.547672602 +0000 UTC m=+316.768165550" Jul 01 20:22:24.494447 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:24.494412 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7565f6b689-8pcz9" Jul 01 20:22:26.951562 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:26.951527 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-74c9cf85ff-gsrv8"] Jul 01 20:22:26.955500 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:26.955479 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-74c9cf85ff-gsrv8" Jul 01 20:22:26.957822 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:26.957803 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jul 01 20:22:26.958024 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:26.958007 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mjpcn\"" Jul 01 20:22:26.967720 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:26.967698 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-74c9cf85ff-gsrv8"] Jul 01 20:22:27.109142 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:27.109101 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95x6x\" (UniqueName: \"kubernetes.io/projected/41da8e9e-0a80-43f9-b211-e500442c26df-kube-api-access-95x6x\") pod \"dashboard-redirect-74c9cf85ff-gsrv8\" (UID: \"41da8e9e-0a80-43f9-b211-e500442c26df\") " pod="opendatahub/dashboard-redirect-74c9cf85ff-gsrv8" Jul 01 20:22:27.109142 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:27.109142 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/41da8e9e-0a80-43f9-b211-e500442c26df-redirect-config\") pod \"dashboard-redirect-74c9cf85ff-gsrv8\" (UID: \"41da8e9e-0a80-43f9-b211-e500442c26df\") " pod="opendatahub/dashboard-redirect-74c9cf85ff-gsrv8" Jul 01 20:22:27.210586 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:27.210500 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95x6x\" (UniqueName: \"kubernetes.io/projected/41da8e9e-0a80-43f9-b211-e500442c26df-kube-api-access-95x6x\") pod \"dashboard-redirect-74c9cf85ff-gsrv8\" (UID: \"41da8e9e-0a80-43f9-b211-e500442c26df\") " pod="opendatahub/dashboard-redirect-74c9cf85ff-gsrv8" Jul 01 20:22:27.210586 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:27.210539 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/41da8e9e-0a80-43f9-b211-e500442c26df-redirect-config\") pod \"dashboard-redirect-74c9cf85ff-gsrv8\" (UID: \"41da8e9e-0a80-43f9-b211-e500442c26df\") " pod="opendatahub/dashboard-redirect-74c9cf85ff-gsrv8" Jul 01 20:22:27.211230 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:27.211208 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/41da8e9e-0a80-43f9-b211-e500442c26df-redirect-config\") pod \"dashboard-redirect-74c9cf85ff-gsrv8\" (UID: \"41da8e9e-0a80-43f9-b211-e500442c26df\") " pod="opendatahub/dashboard-redirect-74c9cf85ff-gsrv8" Jul 01 20:22:27.218334 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:27.218304 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95x6x\" (UniqueName: \"kubernetes.io/projected/41da8e9e-0a80-43f9-b211-e500442c26df-kube-api-access-95x6x\") pod \"dashboard-redirect-74c9cf85ff-gsrv8\" (UID: \"41da8e9e-0a80-43f9-b211-e500442c26df\") " pod="opendatahub/dashboard-redirect-74c9cf85ff-gsrv8" Jul 01 20:22:27.265847 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:27.265825 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-74c9cf85ff-gsrv8" Jul 01 20:22:27.396804 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:27.396778 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-74c9cf85ff-gsrv8"] Jul 01 20:22:27.398991 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:22:27.398965 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41da8e9e_0a80_43f9_b211_e500442c26df.slice/crio-df1f308bca7cb476b5b9e891a330cbd03941ce3ee5d06a87b4058331530b6ff2 WatchSource:0}: Error finding container df1f308bca7cb476b5b9e891a330cbd03941ce3ee5d06a87b4058331530b6ff2: Status 404 returned error can't find the container with id df1f308bca7cb476b5b9e891a330cbd03941ce3ee5d06a87b4058331530b6ff2 Jul 01 20:22:27.547782 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:27.547697 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-74c9cf85ff-gsrv8" event={"ID":"41da8e9e-0a80-43f9-b211-e500442c26df","Type":"ContainerStarted","Data":"df1f308bca7cb476b5b9e891a330cbd03941ce3ee5d06a87b4058331530b6ff2"} Jul 01 20:22:32.571001 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:32.570969 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-74c9cf85ff-gsrv8" event={"ID":"41da8e9e-0a80-43f9-b211-e500442c26df","Type":"ContainerStarted","Data":"755191a2c7cc22f69e773b1f5ff9ed6385ebe98d630c5d4a62e975d1f25e8b5b"} Jul 01 20:22:32.587064 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:22:32.587019 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-74c9cf85ff-gsrv8" podStartSLOduration=1.594168569 podStartE2EDuration="6.587004485s" totalImagesPullingTime="4.992835916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:22:32.585077235 +0000 UTC m=+326.805570184" watchObservedRunningTime="2026-07-01 20:22:32.587004485 +0000 UTC m=+326.807497434" Jul 01 20:23:48.194609 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:23:48.194567 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5lpxj"] Jul 01 20:23:48.197954 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:23:48.197931 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5lpxj" Jul 01 20:23:48.200220 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:23:48.200197 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 01 20:23:48.200321 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:23:48.200251 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 20:23:48.200563 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:23:48.200544 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 20:23:48.200669 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:23:48.200626 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-zjrh4\"" Jul 01 20:23:48.208788 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:23:48.208764 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5lpxj"] Jul 01 20:23:48.356438 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:23:48.356403 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw4s7\" (UniqueName: \"kubernetes.io/projected/b2d9a773-5b86-41f7-8746-072310180c12-kube-api-access-hw4s7\") pod \"dns-operator-controller-manager-864dd78c4c-5lpxj\" (UID: \"b2d9a773-5b86-41f7-8746-072310180c12\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5lpxj" Jul 01 20:23:48.457021 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:23:48.456931 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw4s7\" (UniqueName: \"kubernetes.io/projected/b2d9a773-5b86-41f7-8746-072310180c12-kube-api-access-hw4s7\") pod \"dns-operator-controller-manager-864dd78c4c-5lpxj\" (UID: \"b2d9a773-5b86-41f7-8746-072310180c12\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5lpxj" Jul 01 20:23:48.465943 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:23:48.465918 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw4s7\" (UniqueName: \"kubernetes.io/projected/b2d9a773-5b86-41f7-8746-072310180c12-kube-api-access-hw4s7\") pod \"dns-operator-controller-manager-864dd78c4c-5lpxj\" (UID: \"b2d9a773-5b86-41f7-8746-072310180c12\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5lpxj" Jul 01 20:23:48.508477 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:23:48.508438 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5lpxj" Jul 01 20:23:48.639241 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:23:48.639217 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5lpxj"] Jul 01 20:23:48.642025 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:23:48.641999 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2d9a773_5b86_41f7_8746_072310180c12.slice/crio-01f8d59fe6e8b825ec52f5666c9fdd85b17488f13eca1880b306d9d6086a8d25 WatchSource:0}: Error finding container 01f8d59fe6e8b825ec52f5666c9fdd85b17488f13eca1880b306d9d6086a8d25: Status 404 returned error can't find the container with id 01f8d59fe6e8b825ec52f5666c9fdd85b17488f13eca1880b306d9d6086a8d25 Jul 01 20:23:48.884745 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:23:48.884709 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5lpxj" event={"ID":"b2d9a773-5b86-41f7-8746-072310180c12","Type":"ContainerStarted","Data":"01f8d59fe6e8b825ec52f5666c9fdd85b17488f13eca1880b306d9d6086a8d25"} Jul 01 20:23:50.895762 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:23:50.895727 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5lpxj" event={"ID":"b2d9a773-5b86-41f7-8746-072310180c12","Type":"ContainerStarted","Data":"32d9ab87c08a15f5b2b6b6ef12236f8ddd9a3abafc9f7738327af6fe7cf4dc50"} Jul 01 20:23:50.896145 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:23:50.895860 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5lpxj" Jul 01 20:23:53.526626 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:23:53.526577 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5lpxj" podStartSLOduration=3.417056959 podStartE2EDuration="5.526560446s" totalImagesPullingTime="2.109503487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:23:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:23:50.912399352 +0000 UTC m=+405.132892304" watchObservedRunningTime="2026-07-01 20:23:53.526560446 +0000 UTC m=+407.747053395" Jul 01 20:23:53.527171 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:23:53.527153 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j"] Jul 01 20:23:53.530445 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:23:53.530429 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j" Jul 01 20:23:53.534143 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:23:53.534125 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9sjc5\"" Jul 01 20:23:53.552569 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:23:53.552544 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j"] Jul 01 20:23:53.596603 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:23:53.596566 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84c41595-e732-4aec-a828-ada56ca64d59-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r495j\" (UID: \"84c41595-e732-4aec-a828-ada56ca64d59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j" Jul 01 20:23:53.596763 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:23:53.596637 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56mhw\" (UniqueName: \"kubernetes.io/projected/84c41595-e732-4aec-a828-ada56ca64d59-kube-api-access-56mhw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r495j\" (UID: \"84c41595-e732-4aec-a828-ada56ca64d59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j" Jul 01 20:23:53.697926 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:23:53.697890 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56mhw\" (UniqueName: \"kubernetes.io/projected/84c41595-e732-4aec-a828-ada56ca64d59-kube-api-access-56mhw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r495j\" (UID: \"84c41595-e732-4aec-a828-ada56ca64d59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j" Jul 01 20:23:53.698087 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:23:53.697942 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84c41595-e732-4aec-a828-ada56ca64d59-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r495j\" (UID: \"84c41595-e732-4aec-a828-ada56ca64d59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j" Jul 01 20:23:53.698398 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:23:53.698378 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84c41595-e732-4aec-a828-ada56ca64d59-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r495j\" (UID: \"84c41595-e732-4aec-a828-ada56ca64d59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j" Jul 01 20:23:53.706153 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:23:53.706130 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56mhw\" (UniqueName: \"kubernetes.io/projected/84c41595-e732-4aec-a828-ada56ca64d59-kube-api-access-56mhw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r495j\" (UID: \"84c41595-e732-4aec-a828-ada56ca64d59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j" Jul 01 20:23:53.840212 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:23:53.840176 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j" Jul 01 20:23:53.983477 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:23:53.983453 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j"] Jul 01 20:23:53.985824 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:23:53.985801 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84c41595_e732_4aec_a828_ada56ca64d59.slice/crio-ffd6a527c53d7384fff98cbd8a987f19c491b6fe242b783593d94eaa419b4b10 WatchSource:0}: Error finding container ffd6a527c53d7384fff98cbd8a987f19c491b6fe242b783593d94eaa419b4b10: Status 404 returned error can't find the container with id ffd6a527c53d7384fff98cbd8a987f19c491b6fe242b783593d94eaa419b4b10 Jul 01 20:23:54.916529 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:23:54.916499 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j" event={"ID":"84c41595-e732-4aec-a828-ada56ca64d59","Type":"ContainerStarted","Data":"ffd6a527c53d7384fff98cbd8a987f19c491b6fe242b783593d94eaa419b4b10"} Jul 01 20:24:01.903179 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:01.903139 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5lpxj" Jul 01 20:24:01.949399 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:01.949362 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j" event={"ID":"84c41595-e732-4aec-a828-ada56ca64d59","Type":"ContainerStarted","Data":"488fe513cefd634baf91cf7608d1b02a180e63cfb4fcb2b9b2f5e3570e08d007"} Jul 01 20:24:01.949608 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:01.949587 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j" Jul 01 20:24:01.970876 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:01.970790 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j" podStartSLOduration=1.94403347 podStartE2EDuration="8.970768226s" totalImagesPullingTime="7.026734756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:24:01.970451793 +0000 UTC m=+416.190944742" watchObservedRunningTime="2026-07-01 20:24:01.970768226 +0000 UTC m=+416.191261178" Jul 01 20:24:12.956015 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:12.955978 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j" Jul 01 20:24:13.992707 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:13.992669 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-plgmg"] Jul 01 20:24:13.996608 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:13.996587 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-plgmg" Jul 01 20:24:14.009592 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.009567 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-plgmg"] Jul 01 20:24:14.070489 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.070453 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct9qv\" (UniqueName: \"kubernetes.io/projected/13b9f731-1dd8-42ab-b83c-585bf771bf87-kube-api-access-ct9qv\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-plgmg\" (UID: \"13b9f731-1dd8-42ab-b83c-585bf771bf87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-plgmg" Jul 01 20:24:14.070669 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.070531 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/13b9f731-1dd8-42ab-b83c-585bf771bf87-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-plgmg\" (UID: \"13b9f731-1dd8-42ab-b83c-585bf771bf87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-plgmg" Jul 01 20:24:14.170907 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.170871 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct9qv\" (UniqueName: \"kubernetes.io/projected/13b9f731-1dd8-42ab-b83c-585bf771bf87-kube-api-access-ct9qv\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-plgmg\" (UID: \"13b9f731-1dd8-42ab-b83c-585bf771bf87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-plgmg" Jul 01 20:24:14.171107 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.170939 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/13b9f731-1dd8-42ab-b83c-585bf771bf87-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-plgmg\" (UID: \"13b9f731-1dd8-42ab-b83c-585bf771bf87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-plgmg" Jul 01 20:24:14.171275 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.171257 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/13b9f731-1dd8-42ab-b83c-585bf771bf87-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-plgmg\" (UID: \"13b9f731-1dd8-42ab-b83c-585bf771bf87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-plgmg" Jul 01 20:24:14.179481 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.179447 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct9qv\" (UniqueName: \"kubernetes.io/projected/13b9f731-1dd8-42ab-b83c-585bf771bf87-kube-api-access-ct9qv\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-plgmg\" (UID: \"13b9f731-1dd8-42ab-b83c-585bf771bf87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-plgmg" Jul 01 20:24:14.306979 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.306899 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-plgmg" Jul 01 20:24:14.454278 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.454245 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-plgmg"] Jul 01 20:24:14.458105 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:24:14.458070 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13b9f731_1dd8_42ab_b83c_585bf771bf87.slice/crio-6dabc747cca0b6a3f6dcf386378707194977a9b9a6957aaa4beef40df240ede4 WatchSource:0}: Error finding container 6dabc747cca0b6a3f6dcf386378707194977a9b9a6957aaa4beef40df240ede4: Status 404 returned error can't find the container with id 6dabc747cca0b6a3f6dcf386378707194977a9b9a6957aaa4beef40df240ede4 Jul 01 20:24:14.668969 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.668932 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-plgmg"] Jul 01 20:24:14.672007 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.671978 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-plgmg"] Jul 01 20:24:14.686649 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.686617 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j"] Jul 01 20:24:14.686823 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.686799 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j" podUID="84c41595-e732-4aec-a828-ada56ca64d59" containerName="manager" containerID="cri-o://488fe513cefd634baf91cf7608d1b02a180e63cfb4fcb2b9b2f5e3570e08d007" gracePeriod=2 Jul 01 20:24:14.691783 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.691727 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j"] Jul 01 20:24:14.701934 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.701908 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k7fbm"] Jul 01 20:24:14.702502 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.702482 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84c41595-e732-4aec-a828-ada56ca64d59" containerName="manager" Jul 01 20:24:14.702588 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.702504 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="84c41595-e732-4aec-a828-ada56ca64d59" containerName="manager" Jul 01 20:24:14.702588 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.702530 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13b9f731-1dd8-42ab-b83c-585bf771bf87" containerName="manager" Jul 01 20:24:14.702588 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.702538 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="13b9f731-1dd8-42ab-b83c-585bf771bf87" containerName="manager" Jul 01 20:24:14.702682 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.702622 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="13b9f731-1dd8-42ab-b83c-585bf771bf87" containerName="manager" Jul 01 20:24:14.702682 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.702635 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="84c41595-e732-4aec-a828-ada56ca64d59" containerName="manager" Jul 01 20:24:14.706197 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.706179 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k7fbm" Jul 01 20:24:14.710130 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:24:14.710094 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r495j\" is forbidden: User \"system:node:ip-10-0-141-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-231.ec2.internal' and this object" podUID="84c41595-e732-4aec-a828-ada56ca64d59" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j" Jul 01 20:24:14.717622 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.717594 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd8dg"] Jul 01 20:24:14.720912 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.720888 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k7fbm"] Jul 01 20:24:14.721030 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.721009 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd8dg" Jul 01 20:24:14.740765 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.740734 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd8dg"] Jul 01 20:24:14.746051 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:24:14.746021 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r495j\" is forbidden: User \"system:node:ip-10-0-141-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-231.ec2.internal' and this object" podUID="84c41595-e732-4aec-a828-ada56ca64d59" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j" Jul 01 20:24:14.776133 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.776109 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/19fde1ec-e1d2-445c-b79d-527f0b5aa7ee-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k7fbm\" (UID: \"19fde1ec-e1d2-445c-b79d-527f0b5aa7ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k7fbm" Jul 01 20:24:14.776257 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.776152 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pckjm\" (UniqueName: \"kubernetes.io/projected/19fde1ec-e1d2-445c-b79d-527f0b5aa7ee-kube-api-access-pckjm\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k7fbm\" (UID: \"19fde1ec-e1d2-445c-b79d-527f0b5aa7ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k7fbm" Jul 01 20:24:14.776257 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.776183 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe30090d-72f2-48ae-9b6d-e7c63553a54e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jd8dg\" (UID: \"fe30090d-72f2-48ae-9b6d-e7c63553a54e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd8dg" Jul 01 20:24:14.776257 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.776200 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks9c6\" (UniqueName: \"kubernetes.io/projected/fe30090d-72f2-48ae-9b6d-e7c63553a54e-kube-api-access-ks9c6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jd8dg\" (UID: \"fe30090d-72f2-48ae-9b6d-e7c63553a54e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd8dg" Jul 01 20:24:14.876825 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.876796 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe30090d-72f2-48ae-9b6d-e7c63553a54e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jd8dg\" (UID: \"fe30090d-72f2-48ae-9b6d-e7c63553a54e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd8dg" Jul 01 20:24:14.877001 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.876829 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks9c6\" (UniqueName: \"kubernetes.io/projected/fe30090d-72f2-48ae-9b6d-e7c63553a54e-kube-api-access-ks9c6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jd8dg\" (UID: \"fe30090d-72f2-48ae-9b6d-e7c63553a54e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd8dg" Jul 01 20:24:14.877001 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.876893 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/19fde1ec-e1d2-445c-b79d-527f0b5aa7ee-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k7fbm\" (UID: \"19fde1ec-e1d2-445c-b79d-527f0b5aa7ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k7fbm" Jul 01 20:24:14.877001 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.876943 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pckjm\" (UniqueName: \"kubernetes.io/projected/19fde1ec-e1d2-445c-b79d-527f0b5aa7ee-kube-api-access-pckjm\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k7fbm\" (UID: \"19fde1ec-e1d2-445c-b79d-527f0b5aa7ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k7fbm" Jul 01 20:24:14.877239 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.877218 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe30090d-72f2-48ae-9b6d-e7c63553a54e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jd8dg\" (UID: \"fe30090d-72f2-48ae-9b6d-e7c63553a54e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd8dg" Jul 01 20:24:14.877497 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.877269 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/19fde1ec-e1d2-445c-b79d-527f0b5aa7ee-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k7fbm\" (UID: \"19fde1ec-e1d2-445c-b79d-527f0b5aa7ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k7fbm" Jul 01 20:24:14.885397 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.885369 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks9c6\" (UniqueName: \"kubernetes.io/projected/fe30090d-72f2-48ae-9b6d-e7c63553a54e-kube-api-access-ks9c6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jd8dg\" (UID: \"fe30090d-72f2-48ae-9b6d-e7c63553a54e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd8dg" Jul 01 20:24:14.887854 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.887836 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pckjm\" (UniqueName: \"kubernetes.io/projected/19fde1ec-e1d2-445c-b79d-527f0b5aa7ee-kube-api-access-pckjm\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k7fbm\" (UID: \"19fde1ec-e1d2-445c-b79d-527f0b5aa7ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k7fbm" Jul 01 20:24:14.913291 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.913267 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j" Jul 01 20:24:14.915011 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:24:14.914983 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r495j\" is forbidden: User \"system:node:ip-10-0-141-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-231.ec2.internal' and this object" podUID="84c41595-e732-4aec-a828-ada56ca64d59" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j" Jul 01 20:24:14.977620 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.977532 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84c41595-e732-4aec-a828-ada56ca64d59-extensions-socket-volume\") pod \"84c41595-e732-4aec-a828-ada56ca64d59\" (UID: \"84c41595-e732-4aec-a828-ada56ca64d59\") " Jul 01 20:24:14.977620 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.977582 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56mhw\" (UniqueName: \"kubernetes.io/projected/84c41595-e732-4aec-a828-ada56ca64d59-kube-api-access-56mhw\") pod \"84c41595-e732-4aec-a828-ada56ca64d59\" (UID: \"84c41595-e732-4aec-a828-ada56ca64d59\") " Jul 01 20:24:14.977916 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.977875 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84c41595-e732-4aec-a828-ada56ca64d59-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "84c41595-e732-4aec-a828-ada56ca64d59" (UID: "84c41595-e732-4aec-a828-ada56ca64d59"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 20:24:14.979766 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:14.979738 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84c41595-e732-4aec-a828-ada56ca64d59-kube-api-access-56mhw" (OuterVolumeSpecName: "kube-api-access-56mhw") pod "84c41595-e732-4aec-a828-ada56ca64d59" (UID: "84c41595-e732-4aec-a828-ada56ca64d59"). InnerVolumeSpecName "kube-api-access-56mhw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:24:15.006268 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:24:15.006221 2574 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-plgmg" container="manager" Jul 01 20:24:15.007507 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:15.007470 2574 generic.go:356] "Generic (PLEG): container finished" podID="84c41595-e732-4aec-a828-ada56ca64d59" containerID="488fe513cefd634baf91cf7608d1b02a180e63cfb4fcb2b9b2f5e3570e08d007" exitCode=0 Jul 01 20:24:15.007507 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:15.007501 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j" Jul 01 20:24:15.007651 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:15.007542 2574 scope.go:117] "RemoveContainer" containerID="488fe513cefd634baf91cf7608d1b02a180e63cfb4fcb2b9b2f5e3570e08d007" Jul 01 20:24:15.007786 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:24:15.007759 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r495j\" is forbidden: User \"system:node:ip-10-0-141-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-231.ec2.internal' and this object" podUID="84c41595-e732-4aec-a828-ada56ca64d59" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j" Jul 01 20:24:15.009128 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:24:15.009097 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-plgmg\" is forbidden: User \"system:node:ip-10-0-141-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-231.ec2.internal' and this object" podUID="13b9f731-1dd8-42ab-b83c-585bf771bf87" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-plgmg" Jul 01 20:24:15.010446 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:24:15.010419 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-plgmg\" is forbidden: User \"system:node:ip-10-0-141-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-231.ec2.internal' and this object" podUID="13b9f731-1dd8-42ab-b83c-585bf771bf87" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-plgmg" Jul 01 20:24:15.011539 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:24:15.011517 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r495j\" is forbidden: User \"system:node:ip-10-0-141-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-231.ec2.internal' and this object" podUID="84c41595-e732-4aec-a828-ada56ca64d59" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j" Jul 01 20:24:15.017013 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:15.016996 2574 scope.go:117] "RemoveContainer" containerID="488fe513cefd634baf91cf7608d1b02a180e63cfb4fcb2b9b2f5e3570e08d007" Jul 01 20:24:15.017281 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:24:15.017262 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"488fe513cefd634baf91cf7608d1b02a180e63cfb4fcb2b9b2f5e3570e08d007\": container with ID starting with 488fe513cefd634baf91cf7608d1b02a180e63cfb4fcb2b9b2f5e3570e08d007 not found: ID does not exist" containerID="488fe513cefd634baf91cf7608d1b02a180e63cfb4fcb2b9b2f5e3570e08d007" Jul 01 20:24:15.017361 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:15.017291 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"488fe513cefd634baf91cf7608d1b02a180e63cfb4fcb2b9b2f5e3570e08d007"} err="failed to get container status \"488fe513cefd634baf91cf7608d1b02a180e63cfb4fcb2b9b2f5e3570e08d007\": rpc error: code = NotFound desc = could not find container \"488fe513cefd634baf91cf7608d1b02a180e63cfb4fcb2b9b2f5e3570e08d007\": container with ID starting with 488fe513cefd634baf91cf7608d1b02a180e63cfb4fcb2b9b2f5e3570e08d007 not found: ID does not exist" Jul 01 20:24:15.017701 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:24:15.017678 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-plgmg\" is forbidden: User \"system:node:ip-10-0-141-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-231.ec2.internal' and this object" podUID="13b9f731-1dd8-42ab-b83c-585bf771bf87" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-plgmg" Jul 01 20:24:15.018854 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:24:15.018835 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r495j\" is forbidden: User \"system:node:ip-10-0-141-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-231.ec2.internal' and this object" podUID="84c41595-e732-4aec-a828-ada56ca64d59" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j" Jul 01 20:24:15.067403 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:15.067372 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k7fbm" Jul 01 20:24:15.075301 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:15.075281 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd8dg" Jul 01 20:24:15.078209 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:15.078102 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84c41595-e732-4aec-a828-ada56ca64d59-extensions-socket-volume\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:24:15.078209 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:15.078118 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56mhw\" (UniqueName: \"kubernetes.io/projected/84c41595-e732-4aec-a828-ada56ca64d59-kube-api-access-56mhw\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:24:15.202808 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:15.202765 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k7fbm"] Jul 01 20:24:15.205707 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:24:15.205677 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19fde1ec_e1d2_445c_b79d_527f0b5aa7ee.slice/crio-3d510ca43da2e2e6ee59812831bfca20979bb9399e7da0a18fd46167c802e729 WatchSource:0}: Error finding container 3d510ca43da2e2e6ee59812831bfca20979bb9399e7da0a18fd46167c802e729: Status 404 returned error can't find the container with id 3d510ca43da2e2e6ee59812831bfca20979bb9399e7da0a18fd46167c802e729 Jul 01 20:24:15.229542 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:15.229519 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd8dg"] Jul 01 20:24:15.241355 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:24:15.241313 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe30090d_72f2_48ae_9b6d_e7c63553a54e.slice/crio-9aa2cec64c4948007ddfa5392e188c55282481f9c13ed2f4d8bd9a61949ca0c4 WatchSource:0}: Error finding container 9aa2cec64c4948007ddfa5392e188c55282481f9c13ed2f4d8bd9a61949ca0c4: Status 404 returned error can't find the container with id 9aa2cec64c4948007ddfa5392e188c55282481f9c13ed2f4d8bd9a61949ca0c4 Jul 01 20:24:16.013207 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:16.013164 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-plgmg" podUID="13b9f731-1dd8-42ab-b83c-585bf771bf87" containerName="manager" containerID="cri-o://d907da841d0d2a66f738998ce691550a04f64355e2ba09240a211d02b97827e9" gracePeriod=2 Jul 01 20:24:16.015499 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:24:16.015470 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r495j\" is forbidden: User \"system:node:ip-10-0-141-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-231.ec2.internal' and this object" podUID="84c41595-e732-4aec-a828-ada56ca64d59" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j" Jul 01 20:24:16.015778 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:16.015752 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd8dg" event={"ID":"fe30090d-72f2-48ae-9b6d-e7c63553a54e","Type":"ContainerStarted","Data":"f8c1fe27538e0bafb13d61e057424b8dbee2dd61b6912432b9ab5a73984c9b47"} Jul 01 20:24:16.015851 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:16.015834 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd8dg" event={"ID":"fe30090d-72f2-48ae-9b6d-e7c63553a54e","Type":"ContainerStarted","Data":"9aa2cec64c4948007ddfa5392e188c55282481f9c13ed2f4d8bd9a61949ca0c4"} Jul 01 20:24:16.015903 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:16.015866 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd8dg" Jul 01 20:24:16.016901 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:24:16.016874 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-plgmg\" is forbidden: User \"system:node:ip-10-0-141-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-231.ec2.internal' and this object" podUID="13b9f731-1dd8-42ab-b83c-585bf771bf87" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-plgmg" Jul 01 20:24:16.017247 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:16.017229 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k7fbm" event={"ID":"19fde1ec-e1d2-445c-b79d-527f0b5aa7ee","Type":"ContainerStarted","Data":"da43e91737a190f0abc1cec02c7f6aa5684917b8e147f51d826ee0b15eaca716"} Jul 01 20:24:16.017341 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:16.017270 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k7fbm" event={"ID":"19fde1ec-e1d2-445c-b79d-527f0b5aa7ee","Type":"ContainerStarted","Data":"3d510ca43da2e2e6ee59812831bfca20979bb9399e7da0a18fd46167c802e729"} Jul 01 20:24:16.017406 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:16.017378 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k7fbm" Jul 01 20:24:16.018097 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:24:16.018067 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-plgmg\" is forbidden: User \"system:node:ip-10-0-141-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-231.ec2.internal' and this object" podUID="13b9f731-1dd8-42ab-b83c-585bf771bf87" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-plgmg" Jul 01 20:24:16.019461 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:24:16.019441 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r495j\" is forbidden: User \"system:node:ip-10-0-141-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-231.ec2.internal' and this object" podUID="84c41595-e732-4aec-a828-ada56ca64d59" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j" Jul 01 20:24:16.048731 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:16.048667 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd8dg" podStartSLOduration=2.048645867 podStartE2EDuration="2.048645867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:24:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:24:16.048541286 +0000 UTC m=+430.269034236" watchObservedRunningTime="2026-07-01 20:24:16.048645867 +0000 UTC m=+430.269138816" Jul 01 20:24:16.050090 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:24:16.050043 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-plgmg\" is forbidden: User \"system:node:ip-10-0-141-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-231.ec2.internal' and this object" podUID="13b9f731-1dd8-42ab-b83c-585bf771bf87" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-plgmg" Jul 01 20:24:16.051407 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:24:16.051376 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r495j\" is forbidden: User \"system:node:ip-10-0-141-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-231.ec2.internal' and this object" podUID="84c41595-e732-4aec-a828-ada56ca64d59" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j" Jul 01 20:24:16.070732 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:16.070686 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k7fbm" podStartSLOduration=2.070671418 podStartE2EDuration="2.070671418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:24:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:24:16.069506133 +0000 UTC m=+430.289999085" watchObservedRunningTime="2026-07-01 20:24:16.070671418 +0000 UTC m=+430.291164367" Jul 01 20:24:16.217065 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:24:16.217023 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r495j\" is forbidden: User \"system:node:ip-10-0-141-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-231.ec2.internal' and this object" podUID="84c41595-e732-4aec-a828-ada56ca64d59" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r495j" Jul 01 20:24:16.218448 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:24:16.218420 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-plgmg\" is forbidden: User \"system:node:ip-10-0-141-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-231.ec2.internal' and this object" podUID="13b9f731-1dd8-42ab-b83c-585bf771bf87" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-plgmg" Jul 01 20:24:16.219582 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:16.219561 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84c41595-e732-4aec-a828-ada56ca64d59" path="/var/lib/kubelet/pods/84c41595-e732-4aec-a828-ada56ca64d59/volumes" Jul 01 20:24:16.261650 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:16.261629 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-plgmg" Jul 01 20:24:16.390709 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:16.390672 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ct9qv\" (UniqueName: \"kubernetes.io/projected/13b9f731-1dd8-42ab-b83c-585bf771bf87-kube-api-access-ct9qv\") pod \"13b9f731-1dd8-42ab-b83c-585bf771bf87\" (UID: \"13b9f731-1dd8-42ab-b83c-585bf771bf87\") " Jul 01 20:24:16.390868 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:16.390725 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/13b9f731-1dd8-42ab-b83c-585bf771bf87-extensions-socket-volume\") pod \"13b9f731-1dd8-42ab-b83c-585bf771bf87\" (UID: \"13b9f731-1dd8-42ab-b83c-585bf771bf87\") " Jul 01 20:24:16.391022 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:16.390997 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13b9f731-1dd8-42ab-b83c-585bf771bf87-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "13b9f731-1dd8-42ab-b83c-585bf771bf87" (UID: "13b9f731-1dd8-42ab-b83c-585bf771bf87"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 20:24:16.392792 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:16.392773 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13b9f731-1dd8-42ab-b83c-585bf771bf87-kube-api-access-ct9qv" (OuterVolumeSpecName: "kube-api-access-ct9qv") pod "13b9f731-1dd8-42ab-b83c-585bf771bf87" (UID: "13b9f731-1dd8-42ab-b83c-585bf771bf87"). InnerVolumeSpecName "kube-api-access-ct9qv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:24:16.491807 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:16.491768 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ct9qv\" (UniqueName: \"kubernetes.io/projected/13b9f731-1dd8-42ab-b83c-585bf771bf87-kube-api-access-ct9qv\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:24:16.491807 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:16.491799 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/13b9f731-1dd8-42ab-b83c-585bf771bf87-extensions-socket-volume\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:24:17.022855 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:17.022820 2574 generic.go:356] "Generic (PLEG): container finished" podID="13b9f731-1dd8-42ab-b83c-585bf771bf87" containerID="d907da841d0d2a66f738998ce691550a04f64355e2ba09240a211d02b97827e9" exitCode=2 Jul 01 20:24:17.023303 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:17.022861 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-plgmg" Jul 01 20:24:17.023303 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:17.022914 2574 scope.go:117] "RemoveContainer" containerID="d907da841d0d2a66f738998ce691550a04f64355e2ba09240a211d02b97827e9" Jul 01 20:24:17.024785 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:24:17.024756 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-plgmg\" is forbidden: User \"system:node:ip-10-0-141-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-231.ec2.internal' and this object" podUID="13b9f731-1dd8-42ab-b83c-585bf771bf87" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-plgmg" Jul 01 20:24:17.031515 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:17.031499 2574 scope.go:117] "RemoveContainer" containerID="d907da841d0d2a66f738998ce691550a04f64355e2ba09240a211d02b97827e9" Jul 01 20:24:17.031776 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:24:17.031759 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d907da841d0d2a66f738998ce691550a04f64355e2ba09240a211d02b97827e9\": container with ID starting with d907da841d0d2a66f738998ce691550a04f64355e2ba09240a211d02b97827e9 not found: ID does not exist" containerID="d907da841d0d2a66f738998ce691550a04f64355e2ba09240a211d02b97827e9" Jul 01 20:24:17.031847 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:17.031786 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d907da841d0d2a66f738998ce691550a04f64355e2ba09240a211d02b97827e9"} err="failed to get container status \"d907da841d0d2a66f738998ce691550a04f64355e2ba09240a211d02b97827e9\": rpc error: code = NotFound desc = could not find container \"d907da841d0d2a66f738998ce691550a04f64355e2ba09240a211d02b97827e9\": container with ID starting with d907da841d0d2a66f738998ce691550a04f64355e2ba09240a211d02b97827e9 not found: ID does not exist" Jul 01 20:24:17.032459 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:24:17.032441 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-plgmg\" is forbidden: User \"system:node:ip-10-0-141-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-231.ec2.internal' and this object" podUID="13b9f731-1dd8-42ab-b83c-585bf771bf87" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-plgmg" Jul 01 20:24:18.218829 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:18.218790 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13b9f731-1dd8-42ab-b83c-585bf771bf87" path="/var/lib/kubelet/pods/13b9f731-1dd8-42ab-b83c-585bf771bf87/volumes" Jul 01 20:24:27.025817 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:27.025739 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k7fbm" Jul 01 20:24:27.025817 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:27.025805 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd8dg" Jul 01 20:24:27.106509 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:27.106476 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd8dg"] Jul 01 20:24:27.106813 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:27.106784 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd8dg" podUID="fe30090d-72f2-48ae-9b6d-e7c63553a54e" containerName="manager" containerID="cri-o://f8c1fe27538e0bafb13d61e057424b8dbee2dd61b6912432b9ab5a73984c9b47" gracePeriod=10 Jul 01 20:24:27.355721 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:27.355692 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd8dg" Jul 01 20:24:27.394676 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:27.394647 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dwvf5"] Jul 01 20:24:27.394965 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:27.394954 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe30090d-72f2-48ae-9b6d-e7c63553a54e" containerName="manager" Jul 01 20:24:27.395007 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:27.394967 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe30090d-72f2-48ae-9b6d-e7c63553a54e" containerName="manager" Jul 01 20:24:27.395043 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:27.395015 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe30090d-72f2-48ae-9b6d-e7c63553a54e" containerName="manager" Jul 01 20:24:27.397130 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:27.397116 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dwvf5" Jul 01 20:24:27.411356 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:27.411296 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dwvf5"] Jul 01 20:24:27.480967 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:27.480934 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe30090d-72f2-48ae-9b6d-e7c63553a54e-extensions-socket-volume\") pod \"fe30090d-72f2-48ae-9b6d-e7c63553a54e\" (UID: \"fe30090d-72f2-48ae-9b6d-e7c63553a54e\") " Jul 01 20:24:27.481129 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:27.481050 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ks9c6\" (UniqueName: \"kubernetes.io/projected/fe30090d-72f2-48ae-9b6d-e7c63553a54e-kube-api-access-ks9c6\") pod \"fe30090d-72f2-48ae-9b6d-e7c63553a54e\" (UID: \"fe30090d-72f2-48ae-9b6d-e7c63553a54e\") " Jul 01 20:24:27.481203 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:27.481181 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2jrz\" (UniqueName: \"kubernetes.io/projected/e650acee-dd18-419b-8036-459f1402fb66-kube-api-access-l2jrz\") pod \"kuadrant-operator-controller-manager-86878c769f-dwvf5\" (UID: \"e650acee-dd18-419b-8036-459f1402fb66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dwvf5" Jul 01 20:24:27.481293 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:27.481271 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe30090d-72f2-48ae-9b6d-e7c63553a54e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fe30090d-72f2-48ae-9b6d-e7c63553a54e" (UID: "fe30090d-72f2-48ae-9b6d-e7c63553a54e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 20:24:27.481373 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:27.481305 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e650acee-dd18-419b-8036-459f1402fb66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dwvf5\" (UID: \"e650acee-dd18-419b-8036-459f1402fb66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dwvf5" Jul 01 20:24:27.481435 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:27.481399 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe30090d-72f2-48ae-9b6d-e7c63553a54e-extensions-socket-volume\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:24:27.483112 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:27.483084 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe30090d-72f2-48ae-9b6d-e7c63553a54e-kube-api-access-ks9c6" (OuterVolumeSpecName: "kube-api-access-ks9c6") pod "fe30090d-72f2-48ae-9b6d-e7c63553a54e" (UID: "fe30090d-72f2-48ae-9b6d-e7c63553a54e"). InnerVolumeSpecName "kube-api-access-ks9c6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:24:27.582531 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:27.582493 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e650acee-dd18-419b-8036-459f1402fb66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dwvf5\" (UID: \"e650acee-dd18-419b-8036-459f1402fb66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dwvf5" Jul 01 20:24:27.582799 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:27.582548 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2jrz\" (UniqueName: \"kubernetes.io/projected/e650acee-dd18-419b-8036-459f1402fb66-kube-api-access-l2jrz\") pod \"kuadrant-operator-controller-manager-86878c769f-dwvf5\" (UID: \"e650acee-dd18-419b-8036-459f1402fb66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dwvf5" Jul 01 20:24:27.582799 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:27.582580 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ks9c6\" (UniqueName: \"kubernetes.io/projected/fe30090d-72f2-48ae-9b6d-e7c63553a54e-kube-api-access-ks9c6\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:24:27.582974 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:27.582952 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e650acee-dd18-419b-8036-459f1402fb66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dwvf5\" (UID: \"e650acee-dd18-419b-8036-459f1402fb66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dwvf5" Jul 01 20:24:27.595762 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:27.595708 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2jrz\" (UniqueName: \"kubernetes.io/projected/e650acee-dd18-419b-8036-459f1402fb66-kube-api-access-l2jrz\") pod \"kuadrant-operator-controller-manager-86878c769f-dwvf5\" (UID: \"e650acee-dd18-419b-8036-459f1402fb66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dwvf5" Jul 01 20:24:27.708158 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:27.708121 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dwvf5" Jul 01 20:24:27.844084 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:27.843946 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dwvf5"] Jul 01 20:24:27.846833 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:24:27.846772 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode650acee_dd18_419b_8036_459f1402fb66.slice/crio-49a3bfc3d1a4a18ab1920e35a5ba57cde774a731b6531810bca77caa1d341389 WatchSource:0}: Error finding container 49a3bfc3d1a4a18ab1920e35a5ba57cde774a731b6531810bca77caa1d341389: Status 404 returned error can't find the container with id 49a3bfc3d1a4a18ab1920e35a5ba57cde774a731b6531810bca77caa1d341389 Jul 01 20:24:28.073246 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:28.073205 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dwvf5" event={"ID":"e650acee-dd18-419b-8036-459f1402fb66","Type":"ContainerStarted","Data":"f818fabdba08f9c2e8589f0fec0055590124379f99c2cd8cbdec46c2e6f829e9"} Jul 01 20:24:28.073703 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:28.073379 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dwvf5" Jul 01 20:24:28.073703 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:28.073416 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dwvf5" event={"ID":"e650acee-dd18-419b-8036-459f1402fb66","Type":"ContainerStarted","Data":"49a3bfc3d1a4a18ab1920e35a5ba57cde774a731b6531810bca77caa1d341389"} Jul 01 20:24:28.074444 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:28.074425 2574 generic.go:356] "Generic (PLEG): container finished" podID="fe30090d-72f2-48ae-9b6d-e7c63553a54e" containerID="f8c1fe27538e0bafb13d61e057424b8dbee2dd61b6912432b9ab5a73984c9b47" exitCode=0 Jul 01 20:24:28.074546 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:28.074465 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd8dg" Jul 01 20:24:28.074601 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:28.074469 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd8dg" event={"ID":"fe30090d-72f2-48ae-9b6d-e7c63553a54e","Type":"ContainerDied","Data":"f8c1fe27538e0bafb13d61e057424b8dbee2dd61b6912432b9ab5a73984c9b47"} Jul 01 20:24:28.074601 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:28.074591 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd8dg" event={"ID":"fe30090d-72f2-48ae-9b6d-e7c63553a54e","Type":"ContainerDied","Data":"9aa2cec64c4948007ddfa5392e188c55282481f9c13ed2f4d8bd9a61949ca0c4"} Jul 01 20:24:28.074702 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:28.074617 2574 scope.go:117] "RemoveContainer" containerID="f8c1fe27538e0bafb13d61e057424b8dbee2dd61b6912432b9ab5a73984c9b47" Jul 01 20:24:28.082780 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:28.082765 2574 scope.go:117] "RemoveContainer" containerID="f8c1fe27538e0bafb13d61e057424b8dbee2dd61b6912432b9ab5a73984c9b47" Jul 01 20:24:28.083003 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:24:28.082988 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8c1fe27538e0bafb13d61e057424b8dbee2dd61b6912432b9ab5a73984c9b47\": container with ID starting with f8c1fe27538e0bafb13d61e057424b8dbee2dd61b6912432b9ab5a73984c9b47 not found: ID does not exist" containerID="f8c1fe27538e0bafb13d61e057424b8dbee2dd61b6912432b9ab5a73984c9b47" Jul 01 20:24:28.083054 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:28.083009 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8c1fe27538e0bafb13d61e057424b8dbee2dd61b6912432b9ab5a73984c9b47"} err="failed to get container status \"f8c1fe27538e0bafb13d61e057424b8dbee2dd61b6912432b9ab5a73984c9b47\": rpc error: code = NotFound desc = could not find container \"f8c1fe27538e0bafb13d61e057424b8dbee2dd61b6912432b9ab5a73984c9b47\": container with ID starting with f8c1fe27538e0bafb13d61e057424b8dbee2dd61b6912432b9ab5a73984c9b47 not found: ID does not exist" Jul 01 20:24:28.096233 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:28.096189 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dwvf5" podStartSLOduration=1.096175742 podStartE2EDuration="1.096175742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:24:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:24:28.094673594 +0000 UTC m=+442.315166550" watchObservedRunningTime="2026-07-01 20:24:28.096175742 +0000 UTC m=+442.316668690" Jul 01 20:24:28.110826 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:28.110772 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd8dg"] Jul 01 20:24:28.115095 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:28.115075 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jd8dg"] Jul 01 20:24:28.218753 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:28.218713 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe30090d-72f2-48ae-9b6d-e7c63553a54e" path="/var/lib/kubelet/pods/fe30090d-72f2-48ae-9b6d-e7c63553a54e/volumes" Jul 01 20:24:39.081915 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:39.081878 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dwvf5" Jul 01 20:24:39.132471 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:39.132434 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k7fbm"] Jul 01 20:24:39.132682 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:39.132655 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k7fbm" podUID="19fde1ec-e1d2-445c-b79d-527f0b5aa7ee" containerName="manager" containerID="cri-o://da43e91737a190f0abc1cec02c7f6aa5684917b8e147f51d826ee0b15eaca716" gracePeriod=10 Jul 01 20:24:39.378952 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:39.378927 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k7fbm" Jul 01 20:24:39.384622 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:39.384592 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pckjm\" (UniqueName: \"kubernetes.io/projected/19fde1ec-e1d2-445c-b79d-527f0b5aa7ee-kube-api-access-pckjm\") pod \"19fde1ec-e1d2-445c-b79d-527f0b5aa7ee\" (UID: \"19fde1ec-e1d2-445c-b79d-527f0b5aa7ee\") " Jul 01 20:24:39.384811 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:39.384672 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/19fde1ec-e1d2-445c-b79d-527f0b5aa7ee-extensions-socket-volume\") pod \"19fde1ec-e1d2-445c-b79d-527f0b5aa7ee\" (UID: \"19fde1ec-e1d2-445c-b79d-527f0b5aa7ee\") " Jul 01 20:24:39.385017 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:39.384993 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19fde1ec-e1d2-445c-b79d-527f0b5aa7ee-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "19fde1ec-e1d2-445c-b79d-527f0b5aa7ee" (UID: "19fde1ec-e1d2-445c-b79d-527f0b5aa7ee"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 20:24:39.386573 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:39.386550 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19fde1ec-e1d2-445c-b79d-527f0b5aa7ee-kube-api-access-pckjm" (OuterVolumeSpecName: "kube-api-access-pckjm") pod "19fde1ec-e1d2-445c-b79d-527f0b5aa7ee" (UID: "19fde1ec-e1d2-445c-b79d-527f0b5aa7ee"). InnerVolumeSpecName "kube-api-access-pckjm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:24:39.485223 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:39.485183 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pckjm\" (UniqueName: \"kubernetes.io/projected/19fde1ec-e1d2-445c-b79d-527f0b5aa7ee-kube-api-access-pckjm\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:24:39.485223 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:39.485216 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/19fde1ec-e1d2-445c-b79d-527f0b5aa7ee-extensions-socket-volume\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:24:40.127034 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:40.127002 2574 generic.go:356] "Generic (PLEG): container finished" podID="19fde1ec-e1d2-445c-b79d-527f0b5aa7ee" containerID="da43e91737a190f0abc1cec02c7f6aa5684917b8e147f51d826ee0b15eaca716" exitCode=0 Jul 01 20:24:40.127444 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:40.127052 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k7fbm" Jul 01 20:24:40.127444 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:40.127053 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k7fbm" event={"ID":"19fde1ec-e1d2-445c-b79d-527f0b5aa7ee","Type":"ContainerDied","Data":"da43e91737a190f0abc1cec02c7f6aa5684917b8e147f51d826ee0b15eaca716"} Jul 01 20:24:40.127444 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:40.127181 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k7fbm" event={"ID":"19fde1ec-e1d2-445c-b79d-527f0b5aa7ee","Type":"ContainerDied","Data":"3d510ca43da2e2e6ee59812831bfca20979bb9399e7da0a18fd46167c802e729"} Jul 01 20:24:40.127444 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:40.127217 2574 scope.go:117] "RemoveContainer" containerID="da43e91737a190f0abc1cec02c7f6aa5684917b8e147f51d826ee0b15eaca716" Jul 01 20:24:40.135585 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:40.135430 2574 scope.go:117] "RemoveContainer" containerID="da43e91737a190f0abc1cec02c7f6aa5684917b8e147f51d826ee0b15eaca716" Jul 01 20:24:40.135724 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:24:40.135702 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da43e91737a190f0abc1cec02c7f6aa5684917b8e147f51d826ee0b15eaca716\": container with ID starting with da43e91737a190f0abc1cec02c7f6aa5684917b8e147f51d826ee0b15eaca716 not found: ID does not exist" containerID="da43e91737a190f0abc1cec02c7f6aa5684917b8e147f51d826ee0b15eaca716" Jul 01 20:24:40.135765 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:40.135734 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da43e91737a190f0abc1cec02c7f6aa5684917b8e147f51d826ee0b15eaca716"} err="failed to get container status \"da43e91737a190f0abc1cec02c7f6aa5684917b8e147f51d826ee0b15eaca716\": rpc error: code = NotFound desc = could not find container \"da43e91737a190f0abc1cec02c7f6aa5684917b8e147f51d826ee0b15eaca716\": container with ID starting with da43e91737a190f0abc1cec02c7f6aa5684917b8e147f51d826ee0b15eaca716 not found: ID does not exist" Jul 01 20:24:40.150226 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:40.150203 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k7fbm"] Jul 01 20:24:40.154417 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:40.154394 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k7fbm"] Jul 01 20:24:40.219247 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:40.219222 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19fde1ec-e1d2-445c-b79d-527f0b5aa7ee" path="/var/lib/kubelet/pods/19fde1ec-e1d2-445c-b79d-527f0b5aa7ee/volumes" Jul 01 20:24:56.605198 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:56.605162 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cv28t"] Jul 01 20:24:56.605671 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:56.605637 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19fde1ec-e1d2-445c-b79d-527f0b5aa7ee" containerName="manager" Jul 01 20:24:56.605671 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:56.605656 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="19fde1ec-e1d2-445c-b79d-527f0b5aa7ee" containerName="manager" Jul 01 20:24:56.605800 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:56.605736 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="19fde1ec-e1d2-445c-b79d-527f0b5aa7ee" containerName="manager" Jul 01 20:24:56.608432 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:56.608404 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-cv28t" Jul 01 20:24:56.610316 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:56.610289 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 01 20:24:56.610449 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:56.610352 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bkgmg\"" Jul 01 20:24:56.618845 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:56.618818 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cv28t"] Jul 01 20:24:56.634751 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:56.634730 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cv28t"] Jul 01 20:24:56.698651 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:56.698622 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9e6ceaac-b6f7-46b0-98ce-6633225f265c-config-file\") pod \"limitador-limitador-54d6d988d5-cv28t\" (UID: \"9e6ceaac-b6f7-46b0-98ce-6633225f265c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cv28t" Jul 01 20:24:56.698808 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:56.698675 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvch8\" (UniqueName: \"kubernetes.io/projected/9e6ceaac-b6f7-46b0-98ce-6633225f265c-kube-api-access-fvch8\") pod \"limitador-limitador-54d6d988d5-cv28t\" (UID: \"9e6ceaac-b6f7-46b0-98ce-6633225f265c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cv28t" Jul 01 20:24:56.799996 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:56.799962 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvch8\" (UniqueName: \"kubernetes.io/projected/9e6ceaac-b6f7-46b0-98ce-6633225f265c-kube-api-access-fvch8\") pod \"limitador-limitador-54d6d988d5-cv28t\" (UID: \"9e6ceaac-b6f7-46b0-98ce-6633225f265c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cv28t" Jul 01 20:24:56.800214 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:56.800037 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9e6ceaac-b6f7-46b0-98ce-6633225f265c-config-file\") pod \"limitador-limitador-54d6d988d5-cv28t\" (UID: \"9e6ceaac-b6f7-46b0-98ce-6633225f265c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cv28t" Jul 01 20:24:56.800737 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:56.800711 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9e6ceaac-b6f7-46b0-98ce-6633225f265c-config-file\") pod \"limitador-limitador-54d6d988d5-cv28t\" (UID: \"9e6ceaac-b6f7-46b0-98ce-6633225f265c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cv28t" Jul 01 20:24:56.807724 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:56.807700 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvch8\" (UniqueName: \"kubernetes.io/projected/9e6ceaac-b6f7-46b0-98ce-6633225f265c-kube-api-access-fvch8\") pod \"limitador-limitador-54d6d988d5-cv28t\" (UID: \"9e6ceaac-b6f7-46b0-98ce-6633225f265c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cv28t" Jul 01 20:24:56.919074 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:56.918997 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-cv28t" Jul 01 20:24:57.016652 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:57.016619 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-6bmr9"] Jul 01 20:24:57.019355 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:57.019311 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6bmr9" Jul 01 20:24:57.021274 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:57.021256 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ggkp9\"" Jul 01 20:24:57.027751 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:57.027673 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6bmr9"] Jul 01 20:24:57.061373 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:57.061261 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cv28t"] Jul 01 20:24:57.064039 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:24:57.064012 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e6ceaac_b6f7_46b0_98ce_6633225f265c.slice/crio-308d04ee9b441d1f355de1dd69a18978336ff14b8823d285c2280416f0a22847 WatchSource:0}: Error finding container 308d04ee9b441d1f355de1dd69a18978336ff14b8823d285c2280416f0a22847: Status 404 returned error can't find the container with id 308d04ee9b441d1f355de1dd69a18978336ff14b8823d285c2280416f0a22847 Jul 01 20:24:57.102496 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:57.102465 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl7q5\" (UniqueName: \"kubernetes.io/projected/c57562fe-ddd2-455b-ab16-823988a87b16-kube-api-access-nl7q5\") pod \"authorino-58cd955675-6bmr9\" (UID: \"c57562fe-ddd2-455b-ab16-823988a87b16\") " pod="kuadrant-system/authorino-58cd955675-6bmr9" Jul 01 20:24:57.177774 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:57.177702 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-tw4j2"] Jul 01 20:24:57.180254 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:57.180237 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tw4j2" Jul 01 20:24:57.187574 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:57.187546 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tw4j2"] Jul 01 20:24:57.203431 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:57.203409 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksxbq\" (UniqueName: \"kubernetes.io/projected/88e2a7a1-85cc-4f06-b61e-e97e16364756-kube-api-access-ksxbq\") pod \"authorino-75d556bd77-tw4j2\" (UID: \"88e2a7a1-85cc-4f06-b61e-e97e16364756\") " pod="kuadrant-system/authorino-75d556bd77-tw4j2" Jul 01 20:24:57.203539 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:57.203457 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl7q5\" (UniqueName: \"kubernetes.io/projected/c57562fe-ddd2-455b-ab16-823988a87b16-kube-api-access-nl7q5\") pod \"authorino-58cd955675-6bmr9\" (UID: \"c57562fe-ddd2-455b-ab16-823988a87b16\") " pod="kuadrant-system/authorino-58cd955675-6bmr9" Jul 01 20:24:57.205850 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:57.205821 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-cv28t" event={"ID":"9e6ceaac-b6f7-46b0-98ce-6633225f265c","Type":"ContainerStarted","Data":"308d04ee9b441d1f355de1dd69a18978336ff14b8823d285c2280416f0a22847"} Jul 01 20:24:57.210944 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:57.210925 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl7q5\" (UniqueName: \"kubernetes.io/projected/c57562fe-ddd2-455b-ab16-823988a87b16-kube-api-access-nl7q5\") pod \"authorino-58cd955675-6bmr9\" (UID: \"c57562fe-ddd2-455b-ab16-823988a87b16\") " pod="kuadrant-system/authorino-58cd955675-6bmr9" Jul 01 20:24:57.304712 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:57.304680 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksxbq\" (UniqueName: \"kubernetes.io/projected/88e2a7a1-85cc-4f06-b61e-e97e16364756-kube-api-access-ksxbq\") pod \"authorino-75d556bd77-tw4j2\" (UID: \"88e2a7a1-85cc-4f06-b61e-e97e16364756\") " pod="kuadrant-system/authorino-75d556bd77-tw4j2" Jul 01 20:24:57.312763 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:57.312742 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksxbq\" (UniqueName: \"kubernetes.io/projected/88e2a7a1-85cc-4f06-b61e-e97e16364756-kube-api-access-ksxbq\") pod \"authorino-75d556bd77-tw4j2\" (UID: \"88e2a7a1-85cc-4f06-b61e-e97e16364756\") " pod="kuadrant-system/authorino-75d556bd77-tw4j2" Jul 01 20:24:57.330970 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:57.330945 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6bmr9" Jul 01 20:24:57.465169 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:57.464978 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6bmr9"] Jul 01 20:24:57.467660 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:24:57.467624 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc57562fe_ddd2_455b_ab16_823988a87b16.slice/crio-13eae4a043d0bed3ff0d8a5f20e318ba55b014a8bdc4f60fd0b053d1aeed9ac9 WatchSource:0}: Error finding container 13eae4a043d0bed3ff0d8a5f20e318ba55b014a8bdc4f60fd0b053d1aeed9ac9: Status 404 returned error can't find the container with id 13eae4a043d0bed3ff0d8a5f20e318ba55b014a8bdc4f60fd0b053d1aeed9ac9 Jul 01 20:24:57.489818 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:57.489796 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tw4j2" Jul 01 20:24:57.664701 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:57.663494 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tw4j2"] Jul 01 20:24:57.671018 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:24:57.670975 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88e2a7a1_85cc_4f06_b61e_e97e16364756.slice/crio-89f78732fa61dd9e9b92cc99afdc5deb0da68b40eb65e2a94a4577d68e14ee75 WatchSource:0}: Error finding container 89f78732fa61dd9e9b92cc99afdc5deb0da68b40eb65e2a94a4577d68e14ee75: Status 404 returned error can't find the container with id 89f78732fa61dd9e9b92cc99afdc5deb0da68b40eb65e2a94a4577d68e14ee75 Jul 01 20:24:58.220977 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:58.220942 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tw4j2" event={"ID":"88e2a7a1-85cc-4f06-b61e-e97e16364756","Type":"ContainerStarted","Data":"89f78732fa61dd9e9b92cc99afdc5deb0da68b40eb65e2a94a4577d68e14ee75"} Jul 01 20:24:58.221224 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:24:58.220990 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6bmr9" event={"ID":"c57562fe-ddd2-455b-ab16-823988a87b16","Type":"ContainerStarted","Data":"13eae4a043d0bed3ff0d8a5f20e318ba55b014a8bdc4f60fd0b053d1aeed9ac9"} Jul 01 20:25:02.246419 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:02.246298 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-cv28t" event={"ID":"9e6ceaac-b6f7-46b0-98ce-6633225f265c","Type":"ContainerStarted","Data":"b6c19246fa6ffe2997565ddc951d26cb369bb05f9495748a7e7c7bfecacaa62d"} Jul 01 20:25:02.246855 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:02.246485 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-cv28t" Jul 01 20:25:02.247738 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:02.247709 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tw4j2" event={"ID":"88e2a7a1-85cc-4f06-b61e-e97e16364756","Type":"ContainerStarted","Data":"b6b212bcfe639dd6f1362db4c8858b98f5491fcea1184e95442ccdccb3d99523"} Jul 01 20:25:02.249102 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:02.249080 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6bmr9" event={"ID":"c57562fe-ddd2-455b-ab16-823988a87b16","Type":"ContainerStarted","Data":"d25586f57ed8cfb4be97a539fae83db08b2a02d31576111ca77e0b8189f6c6a4"} Jul 01 20:25:02.262820 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:02.262772 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-cv28t" podStartSLOduration=1.461411681 podStartE2EDuration="6.262759115s" totalImagesPullingTime="4.801347434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:24:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:25:02.261545508 +0000 UTC m=+476.482038487" watchObservedRunningTime="2026-07-01 20:25:02.262759115 +0000 UTC m=+476.483252065" Jul 01 20:25:02.275861 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:02.275814 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-6bmr9" podStartSLOduration=1.913743035 podStartE2EDuration="6.27580092s" totalImagesPullingTime="4.362057885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:24:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:25:02.274807394 +0000 UTC m=+476.495300343" watchObservedRunningTime="2026-07-01 20:25:02.27580092 +0000 UTC m=+476.496293866" Jul 01 20:25:02.295985 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:02.295926 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-tw4j2" podStartSLOduration=1.110000592 podStartE2EDuration="5.295906783s" totalImagesPullingTime="4.185906191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:24:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:25:02.293358598 +0000 UTC m=+476.513851547" watchObservedRunningTime="2026-07-01 20:25:02.295906783 +0000 UTC m=+476.516399735" Jul 01 20:25:02.319525 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:02.319496 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6bmr9"] Jul 01 20:25:04.257681 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:04.257622 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-6bmr9" podUID="c57562fe-ddd2-455b-ab16-823988a87b16" containerName="authorino" containerID="cri-o://d25586f57ed8cfb4be97a539fae83db08b2a02d31576111ca77e0b8189f6c6a4" gracePeriod=30 Jul 01 20:25:04.508752 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:04.508686 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6bmr9" Jul 01 20:25:04.570412 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:04.570380 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nl7q5\" (UniqueName: \"kubernetes.io/projected/c57562fe-ddd2-455b-ab16-823988a87b16-kube-api-access-nl7q5\") pod \"c57562fe-ddd2-455b-ab16-823988a87b16\" (UID: \"c57562fe-ddd2-455b-ab16-823988a87b16\") " Jul 01 20:25:04.572374 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:04.572348 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c57562fe-ddd2-455b-ab16-823988a87b16-kube-api-access-nl7q5" (OuterVolumeSpecName: "kube-api-access-nl7q5") pod "c57562fe-ddd2-455b-ab16-823988a87b16" (UID: "c57562fe-ddd2-455b-ab16-823988a87b16"). InnerVolumeSpecName "kube-api-access-nl7q5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:25:04.671193 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:04.671160 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nl7q5\" (UniqueName: \"kubernetes.io/projected/c57562fe-ddd2-455b-ab16-823988a87b16-kube-api-access-nl7q5\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:25:05.263517 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:05.263485 2574 generic.go:356] "Generic (PLEG): container finished" podID="c57562fe-ddd2-455b-ab16-823988a87b16" containerID="d25586f57ed8cfb4be97a539fae83db08b2a02d31576111ca77e0b8189f6c6a4" exitCode=0 Jul 01 20:25:05.263959 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:05.263529 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6bmr9" Jul 01 20:25:05.263959 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:05.263539 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6bmr9" event={"ID":"c57562fe-ddd2-455b-ab16-823988a87b16","Type":"ContainerDied","Data":"d25586f57ed8cfb4be97a539fae83db08b2a02d31576111ca77e0b8189f6c6a4"} Jul 01 20:25:05.263959 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:05.263568 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6bmr9" event={"ID":"c57562fe-ddd2-455b-ab16-823988a87b16","Type":"ContainerDied","Data":"13eae4a043d0bed3ff0d8a5f20e318ba55b014a8bdc4f60fd0b053d1aeed9ac9"} Jul 01 20:25:05.263959 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:05.263585 2574 scope.go:117] "RemoveContainer" containerID="d25586f57ed8cfb4be97a539fae83db08b2a02d31576111ca77e0b8189f6c6a4" Jul 01 20:25:05.271724 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:05.271709 2574 scope.go:117] "RemoveContainer" containerID="d25586f57ed8cfb4be97a539fae83db08b2a02d31576111ca77e0b8189f6c6a4" Jul 01 20:25:05.271975 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:25:05.271959 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d25586f57ed8cfb4be97a539fae83db08b2a02d31576111ca77e0b8189f6c6a4\": container with ID starting with d25586f57ed8cfb4be97a539fae83db08b2a02d31576111ca77e0b8189f6c6a4 not found: ID does not exist" containerID="d25586f57ed8cfb4be97a539fae83db08b2a02d31576111ca77e0b8189f6c6a4" Jul 01 20:25:05.272023 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:05.271985 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d25586f57ed8cfb4be97a539fae83db08b2a02d31576111ca77e0b8189f6c6a4"} err="failed to get container status \"d25586f57ed8cfb4be97a539fae83db08b2a02d31576111ca77e0b8189f6c6a4\": rpc error: code = NotFound desc = could not find container \"d25586f57ed8cfb4be97a539fae83db08b2a02d31576111ca77e0b8189f6c6a4\": container with ID starting with d25586f57ed8cfb4be97a539fae83db08b2a02d31576111ca77e0b8189f6c6a4 not found: ID does not exist" Jul 01 20:25:05.284886 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:05.284861 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6bmr9"] Jul 01 20:25:05.289922 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:05.289904 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-6bmr9"] Jul 01 20:25:06.218407 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:06.218385 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c57562fe-ddd2-455b-ab16-823988a87b16" path="/var/lib/kubelet/pods/c57562fe-ddd2-455b-ab16-823988a87b16/volumes" Jul 01 20:25:13.254765 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:13.254732 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-cv28t" Jul 01 20:25:51.178555 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:51.178517 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 20:25:51.179022 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:51.178840 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c57562fe-ddd2-455b-ab16-823988a87b16" containerName="authorino" Jul 01 20:25:51.179022 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:51.178851 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c57562fe-ddd2-455b-ab16-823988a87b16" containerName="authorino" Jul 01 20:25:51.179022 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:51.178917 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c57562fe-ddd2-455b-ab16-823988a87b16" containerName="authorino" Jul 01 20:25:51.180763 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:51.180746 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 20:25:51.182713 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:51.182692 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 01 20:25:51.183312 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:51.183280 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 01 20:25:51.183448 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:51.183357 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 01 20:25:51.183448 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:51.183400 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-47rn9\"" Jul 01 20:25:51.190343 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:51.190307 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 20:25:51.257318 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:51.257284 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8tgj\" (UniqueName: \"kubernetes.io/projected/b5a415d3-1f11-4f36-8fc6-e505070391ce-kube-api-access-s8tgj\") pod \"maas-keycloak-0\" (UID: \"b5a415d3-1f11-4f36-8fc6-e505070391ce\") " pod="keycloak-system/maas-keycloak-0" Jul 01 20:25:51.358493 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:51.358460 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8tgj\" (UniqueName: \"kubernetes.io/projected/b5a415d3-1f11-4f36-8fc6-e505070391ce-kube-api-access-s8tgj\") pod \"maas-keycloak-0\" (UID: \"b5a415d3-1f11-4f36-8fc6-e505070391ce\") " pod="keycloak-system/maas-keycloak-0" Jul 01 20:25:51.366621 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:51.366599 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8tgj\" (UniqueName: \"kubernetes.io/projected/b5a415d3-1f11-4f36-8fc6-e505070391ce-kube-api-access-s8tgj\") pod \"maas-keycloak-0\" (UID: \"b5a415d3-1f11-4f36-8fc6-e505070391ce\") " pod="keycloak-system/maas-keycloak-0" Jul 01 20:25:51.492354 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:51.492247 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 20:25:51.618515 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:51.618491 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 20:25:51.620721 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:25:51.620696 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5a415d3_1f11_4f36_8fc6_e505070391ce.slice/crio-876191549dc0c1acb5ff06acd7f5ce1a18d8b0695efd1ea187a2f829e822e722 WatchSource:0}: Error finding container 876191549dc0c1acb5ff06acd7f5ce1a18d8b0695efd1ea187a2f829e822e722: Status 404 returned error can't find the container with id 876191549dc0c1acb5ff06acd7f5ce1a18d8b0695efd1ea187a2f829e822e722 Jul 01 20:25:52.460580 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:25:52.460490 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b5a415d3-1f11-4f36-8fc6-e505070391ce","Type":"ContainerStarted","Data":"876191549dc0c1acb5ff06acd7f5ce1a18d8b0695efd1ea187a2f829e822e722"} Jul 01 20:26:00.501071 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:00.501012 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b5a415d3-1f11-4f36-8fc6-e505070391ce","Type":"ContainerStarted","Data":"26196ae17c5dadcfd0dc332915e9e3956329df544e4df975c56d8d7fb6854106"} Jul 01 20:26:00.520905 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:00.519936 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.496054817 podStartE2EDuration="9.519911827s" totalImagesPullingTime="8.02385701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:25:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:26:00.518145671 +0000 UTC m=+534.738638634" watchObservedRunningTime="2026-07-01 20:26:00.519911827 +0000 UTC m=+534.740404777" Jul 01 20:26:01.492898 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:01.492854 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 01 20:26:01.493113 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:01.492929 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 01 20:26:01.494618 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:01.494579 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b5a415d3-1f11-4f36-8fc6-e505070391ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jul 01 20:26:02.493486 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:02.493440 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b5a415d3-1f11-4f36-8fc6-e505070391ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jul 01 20:26:03.493791 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:03.493738 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b5a415d3-1f11-4f36-8fc6-e505070391ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jul 01 20:26:04.492828 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:04.492784 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b5a415d3-1f11-4f36-8fc6-e505070391ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jul 01 20:26:05.493687 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:05.493634 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b5a415d3-1f11-4f36-8fc6-e505070391ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jul 01 20:26:06.493123 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:06.493075 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b5a415d3-1f11-4f36-8fc6-e505070391ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jul 01 20:26:07.493277 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:07.493226 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b5a415d3-1f11-4f36-8fc6-e505070391ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jul 01 20:26:08.492910 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:08.492862 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b5a415d3-1f11-4f36-8fc6-e505070391ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jul 01 20:26:09.492900 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:09.492845 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b5a415d3-1f11-4f36-8fc6-e505070391ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jul 01 20:26:10.493313 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:10.493258 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b5a415d3-1f11-4f36-8fc6-e505070391ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jul 01 20:26:11.492963 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:11.492918 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b5a415d3-1f11-4f36-8fc6-e505070391ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jul 01 20:26:12.492889 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:12.492840 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b5a415d3-1f11-4f36-8fc6-e505070391ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jul 01 20:26:13.624698 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:13.624656 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 01 20:26:13.643041 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:13.642933 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="b5a415d3-1f11-4f36-8fc6-e505070391ce" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 20:26:23.631954 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:23.631921 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 01 20:26:24.535941 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:24.535909 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hwltg"] Jul 01 20:26:24.544167 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:24.544139 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hwltg" Jul 01 20:26:24.545969 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:24.545947 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hwltg"] Jul 01 20:26:24.669612 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:24.669572 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjchc\" (UniqueName: \"kubernetes.io/projected/12e4c63e-f792-4e86-9cbd-74b5a6233629-kube-api-access-tjchc\") pod \"authorino-5d4b67c446-hwltg\" (UID: \"12e4c63e-f792-4e86-9cbd-74b5a6233629\") " pod="kuadrant-system/authorino-5d4b67c446-hwltg" Jul 01 20:26:24.770713 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:24.770676 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjchc\" (UniqueName: \"kubernetes.io/projected/12e4c63e-f792-4e86-9cbd-74b5a6233629-kube-api-access-tjchc\") pod \"authorino-5d4b67c446-hwltg\" (UID: \"12e4c63e-f792-4e86-9cbd-74b5a6233629\") " pod="kuadrant-system/authorino-5d4b67c446-hwltg" Jul 01 20:26:24.778750 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:24.778720 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjchc\" (UniqueName: \"kubernetes.io/projected/12e4c63e-f792-4e86-9cbd-74b5a6233629-kube-api-access-tjchc\") pod \"authorino-5d4b67c446-hwltg\" (UID: \"12e4c63e-f792-4e86-9cbd-74b5a6233629\") " pod="kuadrant-system/authorino-5d4b67c446-hwltg" Jul 01 20:26:24.787060 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:24.787001 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hwltg"] Jul 01 20:26:24.787265 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:24.787252 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hwltg" Jul 01 20:26:24.817473 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:24.817441 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-66dd556db5-bqls4"] Jul 01 20:26:24.819922 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:24.819900 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66dd556db5-bqls4" Jul 01 20:26:24.829419 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:24.829397 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66dd556db5-bqls4"] Jul 01 20:26:24.916550 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:24.916520 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hwltg"] Jul 01 20:26:24.918728 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:26:24.918701 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12e4c63e_f792_4e86_9cbd_74b5a6233629.slice/crio-dcf6aadbc997f5245f27a76e2e42d5abba61cf0157218193948f144158dc8751 WatchSource:0}: Error finding container dcf6aadbc997f5245f27a76e2e42d5abba61cf0157218193948f144158dc8751: Status 404 returned error can't find the container with id dcf6aadbc997f5245f27a76e2e42d5abba61cf0157218193948f144158dc8751 Jul 01 20:26:24.971830 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:24.971799 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-649hn\" (UniqueName: \"kubernetes.io/projected/426c7a18-b487-48fe-894f-951d0d01a0b9-kube-api-access-649hn\") pod \"authorino-66dd556db5-bqls4\" (UID: \"426c7a18-b487-48fe-894f-951d0d01a0b9\") " pod="kuadrant-system/authorino-66dd556db5-bqls4" Jul 01 20:26:24.988304 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:24.988272 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66dd556db5-bqls4"] Jul 01 20:26:24.988542 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:26:24.988522 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-649hn], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-66dd556db5-bqls4" podUID="426c7a18-b487-48fe-894f-951d0d01a0b9" Jul 01 20:26:25.016203 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:25.016174 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-64f4cd76f-fxss5"] Jul 01 20:26:25.018409 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:25.018392 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64f4cd76f-fxss5" Jul 01 20:26:25.020273 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:25.020251 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 01 20:26:25.027970 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:25.027948 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64f4cd76f-fxss5"] Jul 01 20:26:25.072431 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:25.072300 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-649hn\" (UniqueName: \"kubernetes.io/projected/426c7a18-b487-48fe-894f-951d0d01a0b9-kube-api-access-649hn\") pod \"authorino-66dd556db5-bqls4\" (UID: \"426c7a18-b487-48fe-894f-951d0d01a0b9\") " pod="kuadrant-system/authorino-66dd556db5-bqls4" Jul 01 20:26:25.080035 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:25.080002 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-649hn\" (UniqueName: \"kubernetes.io/projected/426c7a18-b487-48fe-894f-951d0d01a0b9-kube-api-access-649hn\") pod \"authorino-66dd556db5-bqls4\" (UID: \"426c7a18-b487-48fe-894f-951d0d01a0b9\") " pod="kuadrant-system/authorino-66dd556db5-bqls4" Jul 01 20:26:25.173303 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:25.173253 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5bdbebae-a768-43e7-972f-f8e0086f8a7f-tls-cert\") pod \"authorino-64f4cd76f-fxss5\" (UID: \"5bdbebae-a768-43e7-972f-f8e0086f8a7f\") " pod="kuadrant-system/authorino-64f4cd76f-fxss5" Jul 01 20:26:25.173496 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:25.173400 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjsbj\" (UniqueName: \"kubernetes.io/projected/5bdbebae-a768-43e7-972f-f8e0086f8a7f-kube-api-access-pjsbj\") pod \"authorino-64f4cd76f-fxss5\" (UID: \"5bdbebae-a768-43e7-972f-f8e0086f8a7f\") " pod="kuadrant-system/authorino-64f4cd76f-fxss5" Jul 01 20:26:25.274105 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:25.274054 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjsbj\" (UniqueName: \"kubernetes.io/projected/5bdbebae-a768-43e7-972f-f8e0086f8a7f-kube-api-access-pjsbj\") pod \"authorino-64f4cd76f-fxss5\" (UID: \"5bdbebae-a768-43e7-972f-f8e0086f8a7f\") " pod="kuadrant-system/authorino-64f4cd76f-fxss5" Jul 01 20:26:25.274287 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:25.274123 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5bdbebae-a768-43e7-972f-f8e0086f8a7f-tls-cert\") pod \"authorino-64f4cd76f-fxss5\" (UID: \"5bdbebae-a768-43e7-972f-f8e0086f8a7f\") " pod="kuadrant-system/authorino-64f4cd76f-fxss5" Jul 01 20:26:25.276521 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:25.276503 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5bdbebae-a768-43e7-972f-f8e0086f8a7f-tls-cert\") pod \"authorino-64f4cd76f-fxss5\" (UID: \"5bdbebae-a768-43e7-972f-f8e0086f8a7f\") " pod="kuadrant-system/authorino-64f4cd76f-fxss5" Jul 01 20:26:25.282429 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:25.282410 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjsbj\" (UniqueName: \"kubernetes.io/projected/5bdbebae-a768-43e7-972f-f8e0086f8a7f-kube-api-access-pjsbj\") pod \"authorino-64f4cd76f-fxss5\" (UID: \"5bdbebae-a768-43e7-972f-f8e0086f8a7f\") " pod="kuadrant-system/authorino-64f4cd76f-fxss5" Jul 01 20:26:25.327996 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:25.327972 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64f4cd76f-fxss5" Jul 01 20:26:25.455090 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:25.455029 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64f4cd76f-fxss5"] Jul 01 20:26:25.457726 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:26:25.457694 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5bdbebae_a768_43e7_972f_f8e0086f8a7f.slice/crio-2485baf904b1d2e82371f79ca2af9ab2973fbf498d6f3055ea354af8702bd7f2 WatchSource:0}: Error finding container 2485baf904b1d2e82371f79ca2af9ab2973fbf498d6f3055ea354af8702bd7f2: Status 404 returned error can't find the container with id 2485baf904b1d2e82371f79ca2af9ab2973fbf498d6f3055ea354af8702bd7f2 Jul 01 20:26:25.637084 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:25.636997 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64f4cd76f-fxss5" event={"ID":"5bdbebae-a768-43e7-972f-f8e0086f8a7f","Type":"ContainerStarted","Data":"2485baf904b1d2e82371f79ca2af9ab2973fbf498d6f3055ea354af8702bd7f2"} Jul 01 20:26:25.638521 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:25.638491 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hwltg" event={"ID":"12e4c63e-f792-4e86-9cbd-74b5a6233629","Type":"ContainerStarted","Data":"f775325954bd2c998c34b0a2a42ab7b13c84c2153a95390cad21aa120978eb11"} Jul 01 20:26:25.638637 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:25.638522 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66dd556db5-bqls4" Jul 01 20:26:25.638637 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:25.638532 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hwltg" event={"ID":"12e4c63e-f792-4e86-9cbd-74b5a6233629","Type":"ContainerStarted","Data":"dcf6aadbc997f5245f27a76e2e42d5abba61cf0157218193948f144158dc8751"} Jul 01 20:26:25.638637 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:25.638542 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-hwltg" podUID="12e4c63e-f792-4e86-9cbd-74b5a6233629" containerName="authorino" containerID="cri-o://f775325954bd2c998c34b0a2a42ab7b13c84c2153a95390cad21aa120978eb11" gracePeriod=30 Jul 01 20:26:25.644821 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:25.644803 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66dd556db5-bqls4" Jul 01 20:26:25.654139 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:25.654095 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-hwltg" podStartSLOduration=1.100391007 podStartE2EDuration="1.654081586s" totalImagesPullingTime="553.690579ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:26:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:26:25.652896793 +0000 UTC m=+559.873389754" watchObservedRunningTime="2026-07-01 20:26:25.654081586 +0000 UTC m=+559.874574534" Jul 01 20:26:25.778898 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:25.778863 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-649hn\" (UniqueName: \"kubernetes.io/projected/426c7a18-b487-48fe-894f-951d0d01a0b9-kube-api-access-649hn\") pod \"426c7a18-b487-48fe-894f-951d0d01a0b9\" (UID: \"426c7a18-b487-48fe-894f-951d0d01a0b9\") " Jul 01 20:26:25.780878 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:25.780844 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/426c7a18-b487-48fe-894f-951d0d01a0b9-kube-api-access-649hn" (OuterVolumeSpecName: "kube-api-access-649hn") pod "426c7a18-b487-48fe-894f-951d0d01a0b9" (UID: "426c7a18-b487-48fe-894f-951d0d01a0b9"). InnerVolumeSpecName "kube-api-access-649hn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:26:25.879598 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:25.879569 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-649hn\" (UniqueName: \"kubernetes.io/projected/426c7a18-b487-48fe-894f-951d0d01a0b9-kube-api-access-649hn\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:26:25.915115 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:25.915080 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hwltg" Jul 01 20:26:26.081158 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:26.081118 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjchc\" (UniqueName: \"kubernetes.io/projected/12e4c63e-f792-4e86-9cbd-74b5a6233629-kube-api-access-tjchc\") pod \"12e4c63e-f792-4e86-9cbd-74b5a6233629\" (UID: \"12e4c63e-f792-4e86-9cbd-74b5a6233629\") " Jul 01 20:26:26.083186 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:26.083159 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12e4c63e-f792-4e86-9cbd-74b5a6233629-kube-api-access-tjchc" (OuterVolumeSpecName: "kube-api-access-tjchc") pod "12e4c63e-f792-4e86-9cbd-74b5a6233629" (UID: "12e4c63e-f792-4e86-9cbd-74b5a6233629"). InnerVolumeSpecName "kube-api-access-tjchc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:26:26.182861 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:26.182773 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjchc\" (UniqueName: \"kubernetes.io/projected/12e4c63e-f792-4e86-9cbd-74b5a6233629-kube-api-access-tjchc\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:26:26.644215 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:26.644187 2574 generic.go:356] "Generic (PLEG): container finished" podID="12e4c63e-f792-4e86-9cbd-74b5a6233629" containerID="f775325954bd2c998c34b0a2a42ab7b13c84c2153a95390cad21aa120978eb11" exitCode=0 Jul 01 20:26:26.644419 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:26.644234 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hwltg" Jul 01 20:26:26.644419 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:26.644284 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hwltg" event={"ID":"12e4c63e-f792-4e86-9cbd-74b5a6233629","Type":"ContainerDied","Data":"f775325954bd2c998c34b0a2a42ab7b13c84c2153a95390cad21aa120978eb11"} Jul 01 20:26:26.644419 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:26.644349 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hwltg" event={"ID":"12e4c63e-f792-4e86-9cbd-74b5a6233629","Type":"ContainerDied","Data":"dcf6aadbc997f5245f27a76e2e42d5abba61cf0157218193948f144158dc8751"} Jul 01 20:26:26.644419 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:26.644351 2574 scope.go:117] "RemoveContainer" containerID="f775325954bd2c998c34b0a2a42ab7b13c84c2153a95390cad21aa120978eb11" Jul 01 20:26:26.645806 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:26.645782 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66dd556db5-bqls4" Jul 01 20:26:26.645913 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:26.645809 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64f4cd76f-fxss5" event={"ID":"5bdbebae-a768-43e7-972f-f8e0086f8a7f","Type":"ContainerStarted","Data":"59858608a727d0635ec86157c247362a8b53aabf9be5945c452a304a00bb9470"} Jul 01 20:26:26.652832 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:26.652815 2574 scope.go:117] "RemoveContainer" containerID="f775325954bd2c998c34b0a2a42ab7b13c84c2153a95390cad21aa120978eb11" Jul 01 20:26:26.653091 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:26:26.653072 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f775325954bd2c998c34b0a2a42ab7b13c84c2153a95390cad21aa120978eb11\": container with ID starting with f775325954bd2c998c34b0a2a42ab7b13c84c2153a95390cad21aa120978eb11 not found: ID does not exist" containerID="f775325954bd2c998c34b0a2a42ab7b13c84c2153a95390cad21aa120978eb11" Jul 01 20:26:26.653135 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:26.653099 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f775325954bd2c998c34b0a2a42ab7b13c84c2153a95390cad21aa120978eb11"} err="failed to get container status \"f775325954bd2c998c34b0a2a42ab7b13c84c2153a95390cad21aa120978eb11\": rpc error: code = NotFound desc = could not find container \"f775325954bd2c998c34b0a2a42ab7b13c84c2153a95390cad21aa120978eb11\": container with ID starting with f775325954bd2c998c34b0a2a42ab7b13c84c2153a95390cad21aa120978eb11 not found: ID does not exist" Jul 01 20:26:26.663348 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:26.663295 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-64f4cd76f-fxss5" podStartSLOduration=1.27325231 podStartE2EDuration="1.663283611s" totalImagesPullingTime="390.031301ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:26:26.662402591 +0000 UTC m=+560.882895554" watchObservedRunningTime="2026-07-01 20:26:26.663283611 +0000 UTC m=+560.883776560" Jul 01 20:26:26.677881 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:26.677860 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hwltg"] Jul 01 20:26:26.680831 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:26.680811 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hwltg"] Jul 01 20:26:26.695966 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:26.695940 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tw4j2"] Jul 01 20:26:26.696140 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:26.696116 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-tw4j2" podUID="88e2a7a1-85cc-4f06-b61e-e97e16364756" containerName="authorino" containerID="cri-o://b6b212bcfe639dd6f1362db4c8858b98f5491fcea1184e95442ccdccb3d99523" gracePeriod=30 Jul 01 20:26:26.701686 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:26.701575 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66dd556db5-bqls4"] Jul 01 20:26:26.707606 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:26.707542 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-66dd556db5-bqls4"] Jul 01 20:26:26.939186 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:26.939162 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tw4j2" Jul 01 20:26:27.091261 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:27.091227 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksxbq\" (UniqueName: \"kubernetes.io/projected/88e2a7a1-85cc-4f06-b61e-e97e16364756-kube-api-access-ksxbq\") pod \"88e2a7a1-85cc-4f06-b61e-e97e16364756\" (UID: \"88e2a7a1-85cc-4f06-b61e-e97e16364756\") " Jul 01 20:26:27.093499 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:27.093465 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88e2a7a1-85cc-4f06-b61e-e97e16364756-kube-api-access-ksxbq" (OuterVolumeSpecName: "kube-api-access-ksxbq") pod "88e2a7a1-85cc-4f06-b61e-e97e16364756" (UID: "88e2a7a1-85cc-4f06-b61e-e97e16364756"). InnerVolumeSpecName "kube-api-access-ksxbq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:26:27.192300 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:27.192220 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksxbq\" (UniqueName: \"kubernetes.io/projected/88e2a7a1-85cc-4f06-b61e-e97e16364756-kube-api-access-ksxbq\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:26:27.651068 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:27.651035 2574 generic.go:356] "Generic (PLEG): container finished" podID="88e2a7a1-85cc-4f06-b61e-e97e16364756" containerID="b6b212bcfe639dd6f1362db4c8858b98f5491fcea1184e95442ccdccb3d99523" exitCode=0 Jul 01 20:26:27.651263 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:27.651076 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tw4j2" Jul 01 20:26:27.651263 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:27.651110 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tw4j2" event={"ID":"88e2a7a1-85cc-4f06-b61e-e97e16364756","Type":"ContainerDied","Data":"b6b212bcfe639dd6f1362db4c8858b98f5491fcea1184e95442ccdccb3d99523"} Jul 01 20:26:27.651263 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:27.651145 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tw4j2" event={"ID":"88e2a7a1-85cc-4f06-b61e-e97e16364756","Type":"ContainerDied","Data":"89f78732fa61dd9e9b92cc99afdc5deb0da68b40eb65e2a94a4577d68e14ee75"} Jul 01 20:26:27.651263 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:27.651166 2574 scope.go:117] "RemoveContainer" containerID="b6b212bcfe639dd6f1362db4c8858b98f5491fcea1184e95442ccdccb3d99523" Jul 01 20:26:27.665030 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:27.665008 2574 scope.go:117] "RemoveContainer" containerID="b6b212bcfe639dd6f1362db4c8858b98f5491fcea1184e95442ccdccb3d99523" Jul 01 20:26:27.665501 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:26:27.665478 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6b212bcfe639dd6f1362db4c8858b98f5491fcea1184e95442ccdccb3d99523\": container with ID starting with b6b212bcfe639dd6f1362db4c8858b98f5491fcea1184e95442ccdccb3d99523 not found: ID does not exist" containerID="b6b212bcfe639dd6f1362db4c8858b98f5491fcea1184e95442ccdccb3d99523" Jul 01 20:26:27.665586 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:27.665509 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6b212bcfe639dd6f1362db4c8858b98f5491fcea1184e95442ccdccb3d99523"} err="failed to get container status \"b6b212bcfe639dd6f1362db4c8858b98f5491fcea1184e95442ccdccb3d99523\": rpc error: code = NotFound desc = could not find container \"b6b212bcfe639dd6f1362db4c8858b98f5491fcea1184e95442ccdccb3d99523\": container with ID starting with b6b212bcfe639dd6f1362db4c8858b98f5491fcea1184e95442ccdccb3d99523 not found: ID does not exist" Jul 01 20:26:27.673929 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:27.673908 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tw4j2"] Jul 01 20:26:27.677497 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:27.677475 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tw4j2"] Jul 01 20:26:28.218842 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:28.218808 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12e4c63e-f792-4e86-9cbd-74b5a6233629" path="/var/lib/kubelet/pods/12e4c63e-f792-4e86-9cbd-74b5a6233629/volumes" Jul 01 20:26:28.219207 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:28.219119 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="426c7a18-b487-48fe-894f-951d0d01a0b9" path="/var/lib/kubelet/pods/426c7a18-b487-48fe-894f-951d0d01a0b9/volumes" Jul 01 20:26:28.219347 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:26:28.219319 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88e2a7a1-85cc-4f06-b61e-e97e16364756" path="/var/lib/kubelet/pods/88e2a7a1-85cc-4f06-b61e-e97e16364756/volumes" Jul 01 20:27:06.198139 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:06.198112 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mfbr_7ece6589-3e50-4328-aa47-3a030462201a/ovn-acl-logging/0.log" Jul 01 20:27:06.198660 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:06.198212 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mfbr_7ece6589-3e50-4328-aa47-3a030462201a/ovn-acl-logging/0.log" Jul 01 20:27:06.604427 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:06.604390 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cv28t"] Jul 01 20:27:18.168847 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:18.168798 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 20:27:18.171493 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:18.169077 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="b5a415d3-1f11-4f36-8fc6-e505070391ce" containerName="keycloak" containerID="cri-o://26196ae17c5dadcfd0dc332915e9e3956329df544e4df975c56d8d7fb6854106" gracePeriod=30 Jul 01 20:27:19.881848 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:19.881750 2574 generic.go:356] "Generic (PLEG): container finished" podID="b5a415d3-1f11-4f36-8fc6-e505070391ce" containerID="26196ae17c5dadcfd0dc332915e9e3956329df544e4df975c56d8d7fb6854106" exitCode=143 Jul 01 20:27:19.882188 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:19.881833 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b5a415d3-1f11-4f36-8fc6-e505070391ce","Type":"ContainerDied","Data":"26196ae17c5dadcfd0dc332915e9e3956329df544e4df975c56d8d7fb6854106"} Jul 01 20:27:20.213846 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:20.213820 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 20:27:20.326645 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:20.326607 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8tgj\" (UniqueName: \"kubernetes.io/projected/b5a415d3-1f11-4f36-8fc6-e505070391ce-kube-api-access-s8tgj\") pod \"b5a415d3-1f11-4f36-8fc6-e505070391ce\" (UID: \"b5a415d3-1f11-4f36-8fc6-e505070391ce\") " Jul 01 20:27:20.328887 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:20.328841 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5a415d3-1f11-4f36-8fc6-e505070391ce-kube-api-access-s8tgj" (OuterVolumeSpecName: "kube-api-access-s8tgj") pod "b5a415d3-1f11-4f36-8fc6-e505070391ce" (UID: "b5a415d3-1f11-4f36-8fc6-e505070391ce"). InnerVolumeSpecName "kube-api-access-s8tgj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:27:20.427394 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:20.427357 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8tgj\" (UniqueName: \"kubernetes.io/projected/b5a415d3-1f11-4f36-8fc6-e505070391ce-kube-api-access-s8tgj\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:27:20.887895 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:20.887856 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b5a415d3-1f11-4f36-8fc6-e505070391ce","Type":"ContainerDied","Data":"876191549dc0c1acb5ff06acd7f5ce1a18d8b0695efd1ea187a2f829e822e722"} Jul 01 20:27:20.888318 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:20.887913 2574 scope.go:117] "RemoveContainer" containerID="26196ae17c5dadcfd0dc332915e9e3956329df544e4df975c56d8d7fb6854106" Jul 01 20:27:20.888318 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:20.887866 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 20:27:20.907759 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:20.907733 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 20:27:20.911168 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:20.911144 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 20:27:20.933955 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:20.933928 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 20:27:20.934251 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:20.934239 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12e4c63e-f792-4e86-9cbd-74b5a6233629" containerName="authorino" Jul 01 20:27:20.934294 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:20.934253 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="12e4c63e-f792-4e86-9cbd-74b5a6233629" containerName="authorino" Jul 01 20:27:20.934294 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:20.934266 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88e2a7a1-85cc-4f06-b61e-e97e16364756" containerName="authorino" Jul 01 20:27:20.934294 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:20.934272 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="88e2a7a1-85cc-4f06-b61e-e97e16364756" containerName="authorino" Jul 01 20:27:20.934294 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:20.934283 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5a415d3-1f11-4f36-8fc6-e505070391ce" containerName="keycloak" Jul 01 20:27:20.934294 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:20.934289 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5a415d3-1f11-4f36-8fc6-e505070391ce" containerName="keycloak" Jul 01 20:27:20.934462 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:20.934367 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5a415d3-1f11-4f36-8fc6-e505070391ce" containerName="keycloak" Jul 01 20:27:20.934462 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:20.934375 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="88e2a7a1-85cc-4f06-b61e-e97e16364756" containerName="authorino" Jul 01 20:27:20.934462 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:20.934382 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="12e4c63e-f792-4e86-9cbd-74b5a6233629" containerName="authorino" Jul 01 20:27:20.938848 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:20.938827 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 20:27:20.940916 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:20.940887 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 01 20:27:20.941030 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:20.940918 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 01 20:27:20.941030 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:20.940967 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jul 01 20:27:20.941030 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:20.940967 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 01 20:27:20.941194 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:20.941152 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-47rn9\"" Jul 01 20:27:20.946029 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:20.946006 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 20:27:21.033078 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:21.033042 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/a4a3699b-ac2d-413a-9d00-b8ede3adaa67-test-realms\") pod \"maas-keycloak-0\" (UID: \"a4a3699b-ac2d-413a-9d00-b8ede3adaa67\") " pod="keycloak-system/maas-keycloak-0" Jul 01 20:27:21.033276 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:21.033158 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kspp8\" (UniqueName: \"kubernetes.io/projected/a4a3699b-ac2d-413a-9d00-b8ede3adaa67-kube-api-access-kspp8\") pod \"maas-keycloak-0\" (UID: \"a4a3699b-ac2d-413a-9d00-b8ede3adaa67\") " pod="keycloak-system/maas-keycloak-0" Jul 01 20:27:21.133664 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:21.133627 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kspp8\" (UniqueName: \"kubernetes.io/projected/a4a3699b-ac2d-413a-9d00-b8ede3adaa67-kube-api-access-kspp8\") pod \"maas-keycloak-0\" (UID: \"a4a3699b-ac2d-413a-9d00-b8ede3adaa67\") " pod="keycloak-system/maas-keycloak-0" Jul 01 20:27:21.133848 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:21.133682 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/a4a3699b-ac2d-413a-9d00-b8ede3adaa67-test-realms\") pod \"maas-keycloak-0\" (UID: \"a4a3699b-ac2d-413a-9d00-b8ede3adaa67\") " pod="keycloak-system/maas-keycloak-0" Jul 01 20:27:21.134287 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:21.134270 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/a4a3699b-ac2d-413a-9d00-b8ede3adaa67-test-realms\") pod \"maas-keycloak-0\" (UID: \"a4a3699b-ac2d-413a-9d00-b8ede3adaa67\") " pod="keycloak-system/maas-keycloak-0" Jul 01 20:27:21.141052 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:21.140991 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kspp8\" (UniqueName: \"kubernetes.io/projected/a4a3699b-ac2d-413a-9d00-b8ede3adaa67-kube-api-access-kspp8\") pod \"maas-keycloak-0\" (UID: \"a4a3699b-ac2d-413a-9d00-b8ede3adaa67\") " pod="keycloak-system/maas-keycloak-0" Jul 01 20:27:21.250174 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:21.250140 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 20:27:21.378791 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:21.378766 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 20:27:21.381476 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:27:21.381448 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4a3699b_ac2d_413a_9d00_b8ede3adaa67.slice/crio-53d00bd1d9f7c8e9e69a0ef5c8e1c7882824716dbe5bf021938bcd5e6b5f4143 WatchSource:0}: Error finding container 53d00bd1d9f7c8e9e69a0ef5c8e1c7882824716dbe5bf021938bcd5e6b5f4143: Status 404 returned error can't find the container with id 53d00bd1d9f7c8e9e69a0ef5c8e1c7882824716dbe5bf021938bcd5e6b5f4143 Jul 01 20:27:21.383164 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:21.383148 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 20:27:21.893857 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:21.893827 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a4a3699b-ac2d-413a-9d00-b8ede3adaa67","Type":"ContainerStarted","Data":"53d00bd1d9f7c8e9e69a0ef5c8e1c7882824716dbe5bf021938bcd5e6b5f4143"} Jul 01 20:27:22.221030 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:22.220949 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5a415d3-1f11-4f36-8fc6-e505070391ce" path="/var/lib/kubelet/pods/b5a415d3-1f11-4f36-8fc6-e505070391ce/volumes" Jul 01 20:27:22.903100 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:22.903060 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a4a3699b-ac2d-413a-9d00-b8ede3adaa67","Type":"ContainerStarted","Data":"0fe882cf3a203e72a42d6d6222a9ae4485608055fd77fafa09e7f174f608ffd2"} Jul 01 20:27:22.921940 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:22.921873 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.458884564 podStartE2EDuration="2.92185168s" totalImagesPullingTime="462.967116ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:27:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:27:22.920958595 +0000 UTC m=+617.141451577" watchObservedRunningTime="2026-07-01 20:27:22.92185168 +0000 UTC m=+617.142344631" Jul 01 20:27:23.252313 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:23.252224 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 01 20:27:23.252683 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:23.252641 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4a3699b-ac2d-413a-9d00-b8ede3adaa67" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jul 01 20:27:24.250637 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:24.250593 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4a3699b-ac2d-413a-9d00-b8ede3adaa67" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jul 01 20:27:25.251419 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:25.251365 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4a3699b-ac2d-413a-9d00-b8ede3adaa67" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jul 01 20:27:26.251175 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:26.251120 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4a3699b-ac2d-413a-9d00-b8ede3adaa67" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jul 01 20:27:27.251419 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:27.251368 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4a3699b-ac2d-413a-9d00-b8ede3adaa67" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jul 01 20:27:28.251146 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:28.251094 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4a3699b-ac2d-413a-9d00-b8ede3adaa67" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jul 01 20:27:29.251466 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:29.251405 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4a3699b-ac2d-413a-9d00-b8ede3adaa67" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jul 01 20:27:30.251514 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:30.251456 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4a3699b-ac2d-413a-9d00-b8ede3adaa67" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jul 01 20:27:31.250735 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:31.250697 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 01 20:27:31.251018 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:31.250988 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4a3699b-ac2d-413a-9d00-b8ede3adaa67" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jul 01 20:27:32.250819 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:32.250767 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4a3699b-ac2d-413a-9d00-b8ede3adaa67" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jul 01 20:27:33.250906 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:33.250857 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4a3699b-ac2d-413a-9d00-b8ede3adaa67" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jul 01 20:27:34.251102 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:34.251062 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4a3699b-ac2d-413a-9d00-b8ede3adaa67" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jul 01 20:27:35.374021 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:35.373982 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 01 20:27:35.388684 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:35.388621 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="a4a3699b-ac2d-413a-9d00-b8ede3adaa67" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 20:27:45.381940 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:45.381904 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 01 20:27:56.107639 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:56.107606 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7444cbf9c-8zqkh"] Jul 01 20:27:56.112162 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:56.112138 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7444cbf9c-8zqkh" Jul 01 20:27:56.114206 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:56.114185 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jul 01 20:27:56.119445 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:56.119212 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7444cbf9c-8zqkh"] Jul 01 20:27:56.249380 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:56.249350 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/91ecc359-498e-46f8-9fce-4b253f5504d8-tls-cert\") pod \"authorino-7444cbf9c-8zqkh\" (UID: \"91ecc359-498e-46f8-9fce-4b253f5504d8\") " pod="kuadrant-system/authorino-7444cbf9c-8zqkh" Jul 01 20:27:56.249554 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:56.249410 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/91ecc359-498e-46f8-9fce-4b253f5504d8-oidc-ca\") pod \"authorino-7444cbf9c-8zqkh\" (UID: \"91ecc359-498e-46f8-9fce-4b253f5504d8\") " pod="kuadrant-system/authorino-7444cbf9c-8zqkh" Jul 01 20:27:56.249554 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:56.249474 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbr7k\" (UniqueName: \"kubernetes.io/projected/91ecc359-498e-46f8-9fce-4b253f5504d8-kube-api-access-mbr7k\") pod \"authorino-7444cbf9c-8zqkh\" (UID: \"91ecc359-498e-46f8-9fce-4b253f5504d8\") " pod="kuadrant-system/authorino-7444cbf9c-8zqkh" Jul 01 20:27:56.350932 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:56.350896 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/91ecc359-498e-46f8-9fce-4b253f5504d8-oidc-ca\") pod \"authorino-7444cbf9c-8zqkh\" (UID: \"91ecc359-498e-46f8-9fce-4b253f5504d8\") " pod="kuadrant-system/authorino-7444cbf9c-8zqkh" Jul 01 20:27:56.351135 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:56.350957 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbr7k\" (UniqueName: \"kubernetes.io/projected/91ecc359-498e-46f8-9fce-4b253f5504d8-kube-api-access-mbr7k\") pod \"authorino-7444cbf9c-8zqkh\" (UID: \"91ecc359-498e-46f8-9fce-4b253f5504d8\") " pod="kuadrant-system/authorino-7444cbf9c-8zqkh" Jul 01 20:27:56.351135 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:56.351065 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/91ecc359-498e-46f8-9fce-4b253f5504d8-tls-cert\") pod \"authorino-7444cbf9c-8zqkh\" (UID: \"91ecc359-498e-46f8-9fce-4b253f5504d8\") " pod="kuadrant-system/authorino-7444cbf9c-8zqkh" Jul 01 20:27:56.351756 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:56.351729 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/91ecc359-498e-46f8-9fce-4b253f5504d8-oidc-ca\") pod \"authorino-7444cbf9c-8zqkh\" (UID: \"91ecc359-498e-46f8-9fce-4b253f5504d8\") " pod="kuadrant-system/authorino-7444cbf9c-8zqkh" Jul 01 20:27:56.353469 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:56.353444 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/91ecc359-498e-46f8-9fce-4b253f5504d8-tls-cert\") pod \"authorino-7444cbf9c-8zqkh\" (UID: \"91ecc359-498e-46f8-9fce-4b253f5504d8\") " pod="kuadrant-system/authorino-7444cbf9c-8zqkh" Jul 01 20:27:56.358749 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:56.358693 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbr7k\" (UniqueName: \"kubernetes.io/projected/91ecc359-498e-46f8-9fce-4b253f5504d8-kube-api-access-mbr7k\") pod \"authorino-7444cbf9c-8zqkh\" (UID: \"91ecc359-498e-46f8-9fce-4b253f5504d8\") " pod="kuadrant-system/authorino-7444cbf9c-8zqkh" Jul 01 20:27:56.421955 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:56.421921 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7444cbf9c-8zqkh" Jul 01 20:27:56.553267 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:56.553243 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7444cbf9c-8zqkh"] Jul 01 20:27:56.555608 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:27:56.555580 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91ecc359_498e_46f8_9fce_4b253f5504d8.slice/crio-e49acd22c27ee09543afc5e6d81ab7c7423c5b5734ac1d6fa09f0974e2b03161 WatchSource:0}: Error finding container e49acd22c27ee09543afc5e6d81ab7c7423c5b5734ac1d6fa09f0974e2b03161: Status 404 returned error can't find the container with id e49acd22c27ee09543afc5e6d81ab7c7423c5b5734ac1d6fa09f0974e2b03161 Jul 01 20:27:57.108089 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:57.108000 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7444cbf9c-8zqkh" event={"ID":"91ecc359-498e-46f8-9fce-4b253f5504d8","Type":"ContainerStarted","Data":"11b8fc4261417a61b69a115851ae2b63731151ecafdf0c03a4fbdfc2c5961a40"} Jul 01 20:27:57.108089 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:57.108041 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7444cbf9c-8zqkh" event={"ID":"91ecc359-498e-46f8-9fce-4b253f5504d8","Type":"ContainerStarted","Data":"e49acd22c27ee09543afc5e6d81ab7c7423c5b5734ac1d6fa09f0974e2b03161"} Jul 01 20:27:57.150837 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:57.150780 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7444cbf9c-8zqkh" podStartSLOduration=0.853583128 podStartE2EDuration="1.150763241s" totalImagesPullingTime="297.180113ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:27:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:27:57.147484814 +0000 UTC m=+651.367977784" watchObservedRunningTime="2026-07-01 20:27:57.150763241 +0000 UTC m=+651.371256191" Jul 01 20:27:57.187804 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:57.187773 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-64f4cd76f-fxss5"] Jul 01 20:27:57.187970 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:57.187934 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-64f4cd76f-fxss5" podUID="5bdbebae-a768-43e7-972f-f8e0086f8a7f" containerName="authorino" containerID="cri-o://59858608a727d0635ec86157c247362a8b53aabf9be5945c452a304a00bb9470" gracePeriod=30 Jul 01 20:27:57.426237 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:57.426206 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64f4cd76f-fxss5" Jul 01 20:27:57.561292 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:57.561246 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5bdbebae-a768-43e7-972f-f8e0086f8a7f-tls-cert\") pod \"5bdbebae-a768-43e7-972f-f8e0086f8a7f\" (UID: \"5bdbebae-a768-43e7-972f-f8e0086f8a7f\") " Jul 01 20:27:57.561528 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:57.561399 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjsbj\" (UniqueName: \"kubernetes.io/projected/5bdbebae-a768-43e7-972f-f8e0086f8a7f-kube-api-access-pjsbj\") pod \"5bdbebae-a768-43e7-972f-f8e0086f8a7f\" (UID: \"5bdbebae-a768-43e7-972f-f8e0086f8a7f\") " Jul 01 20:27:57.563426 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:57.563396 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bdbebae-a768-43e7-972f-f8e0086f8a7f-kube-api-access-pjsbj" (OuterVolumeSpecName: "kube-api-access-pjsbj") pod "5bdbebae-a768-43e7-972f-f8e0086f8a7f" (UID: "5bdbebae-a768-43e7-972f-f8e0086f8a7f"). InnerVolumeSpecName "kube-api-access-pjsbj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:27:57.571069 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:57.571044 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bdbebae-a768-43e7-972f-f8e0086f8a7f-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5bdbebae-a768-43e7-972f-f8e0086f8a7f" (UID: "5bdbebae-a768-43e7-972f-f8e0086f8a7f"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:27:57.662824 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:57.662742 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjsbj\" (UniqueName: \"kubernetes.io/projected/5bdbebae-a768-43e7-972f-f8e0086f8a7f-kube-api-access-pjsbj\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:27:57.662824 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:57.662767 2574 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5bdbebae-a768-43e7-972f-f8e0086f8a7f-tls-cert\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:27:58.113670 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:58.113637 2574 generic.go:356] "Generic (PLEG): container finished" podID="5bdbebae-a768-43e7-972f-f8e0086f8a7f" containerID="59858608a727d0635ec86157c247362a8b53aabf9be5945c452a304a00bb9470" exitCode=0 Jul 01 20:27:58.114088 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:58.113679 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64f4cd76f-fxss5" Jul 01 20:27:58.114088 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:58.113721 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64f4cd76f-fxss5" event={"ID":"5bdbebae-a768-43e7-972f-f8e0086f8a7f","Type":"ContainerDied","Data":"59858608a727d0635ec86157c247362a8b53aabf9be5945c452a304a00bb9470"} Jul 01 20:27:58.114088 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:58.113761 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64f4cd76f-fxss5" event={"ID":"5bdbebae-a768-43e7-972f-f8e0086f8a7f","Type":"ContainerDied","Data":"2485baf904b1d2e82371f79ca2af9ab2973fbf498d6f3055ea354af8702bd7f2"} Jul 01 20:27:58.114088 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:58.113778 2574 scope.go:117] "RemoveContainer" containerID="59858608a727d0635ec86157c247362a8b53aabf9be5945c452a304a00bb9470" Jul 01 20:27:58.122106 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:58.122089 2574 scope.go:117] "RemoveContainer" containerID="59858608a727d0635ec86157c247362a8b53aabf9be5945c452a304a00bb9470" Jul 01 20:27:58.122395 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:27:58.122368 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59858608a727d0635ec86157c247362a8b53aabf9be5945c452a304a00bb9470\": container with ID starting with 59858608a727d0635ec86157c247362a8b53aabf9be5945c452a304a00bb9470 not found: ID does not exist" containerID="59858608a727d0635ec86157c247362a8b53aabf9be5945c452a304a00bb9470" Jul 01 20:27:58.122485 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:58.122406 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59858608a727d0635ec86157c247362a8b53aabf9be5945c452a304a00bb9470"} err="failed to get container status \"59858608a727d0635ec86157c247362a8b53aabf9be5945c452a304a00bb9470\": rpc error: code = NotFound desc = could not find container \"59858608a727d0635ec86157c247362a8b53aabf9be5945c452a304a00bb9470\": container with ID starting with 59858608a727d0635ec86157c247362a8b53aabf9be5945c452a304a00bb9470 not found: ID does not exist" Jul 01 20:27:58.132656 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:58.132636 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-64f4cd76f-fxss5"] Jul 01 20:27:58.139057 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:58.139037 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-64f4cd76f-fxss5"] Jul 01 20:27:58.218900 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:27:58.218869 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bdbebae-a768-43e7-972f-f8e0086f8a7f" path="/var/lib/kubelet/pods/5bdbebae-a768-43e7-972f-f8e0086f8a7f/volumes" Jul 01 20:28:05.284276 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:05.284239 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cv28t"] Jul 01 20:28:12.580294 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:12.580251 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cv28t"] Jul 01 20:28:39.885954 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:39.885916 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cv28t"] Jul 01 20:28:52.385288 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:52.385210 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7"] Jul 01 20:28:52.385787 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:52.385767 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bdbebae-a768-43e7-972f-f8e0086f8a7f" containerName="authorino" Jul 01 20:28:52.385850 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:52.385790 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bdbebae-a768-43e7-972f-f8e0086f8a7f" containerName="authorino" Jul 01 20:28:52.385946 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:52.385928 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bdbebae-a768-43e7-972f-f8e0086f8a7f" containerName="authorino" Jul 01 20:28:52.389023 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:52.389006 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7" Jul 01 20:28:52.391575 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:52.391556 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-s2778\"" Jul 01 20:28:52.391689 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:52.391571 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 01 20:28:52.391689 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:52.391558 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 01 20:28:52.391689 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:52.391558 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 01 20:28:52.396646 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:52.396628 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7"] Jul 01 20:28:52.527675 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:52.527633 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4716555a-358d-4298-a0bc-1e67ecc0808b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7\" (UID: \"4716555a-358d-4298-a0bc-1e67ecc0808b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7" Jul 01 20:28:52.527675 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:52.527678 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4716555a-358d-4298-a0bc-1e67ecc0808b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7\" (UID: \"4716555a-358d-4298-a0bc-1e67ecc0808b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7" Jul 01 20:28:52.527878 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:52.527701 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4716555a-358d-4298-a0bc-1e67ecc0808b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7\" (UID: \"4716555a-358d-4298-a0bc-1e67ecc0808b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7" Jul 01 20:28:52.527878 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:52.527746 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85d8n\" (UniqueName: \"kubernetes.io/projected/4716555a-358d-4298-a0bc-1e67ecc0808b-kube-api-access-85d8n\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7\" (UID: \"4716555a-358d-4298-a0bc-1e67ecc0808b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7" Jul 01 20:28:52.527878 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:52.527852 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4716555a-358d-4298-a0bc-1e67ecc0808b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7\" (UID: \"4716555a-358d-4298-a0bc-1e67ecc0808b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7" Jul 01 20:28:52.628340 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:52.628291 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4716555a-358d-4298-a0bc-1e67ecc0808b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7\" (UID: \"4716555a-358d-4298-a0bc-1e67ecc0808b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7" Jul 01 20:28:52.628502 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:52.628394 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4716555a-358d-4298-a0bc-1e67ecc0808b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7\" (UID: \"4716555a-358d-4298-a0bc-1e67ecc0808b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7" Jul 01 20:28:52.628502 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:52.628414 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4716555a-358d-4298-a0bc-1e67ecc0808b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7\" (UID: \"4716555a-358d-4298-a0bc-1e67ecc0808b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7" Jul 01 20:28:52.628502 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:52.628439 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4716555a-358d-4298-a0bc-1e67ecc0808b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7\" (UID: \"4716555a-358d-4298-a0bc-1e67ecc0808b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7" Jul 01 20:28:52.628502 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:52.628459 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85d8n\" (UniqueName: \"kubernetes.io/projected/4716555a-358d-4298-a0bc-1e67ecc0808b-kube-api-access-85d8n\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7\" (UID: \"4716555a-358d-4298-a0bc-1e67ecc0808b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7" Jul 01 20:28:52.628758 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:52.628732 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4716555a-358d-4298-a0bc-1e67ecc0808b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7\" (UID: \"4716555a-358d-4298-a0bc-1e67ecc0808b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7" Jul 01 20:28:52.628841 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:52.628791 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4716555a-358d-4298-a0bc-1e67ecc0808b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7\" (UID: \"4716555a-358d-4298-a0bc-1e67ecc0808b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7" Jul 01 20:28:52.630580 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:52.630560 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4716555a-358d-4298-a0bc-1e67ecc0808b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7\" (UID: \"4716555a-358d-4298-a0bc-1e67ecc0808b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7" Jul 01 20:28:52.630838 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:52.630821 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4716555a-358d-4298-a0bc-1e67ecc0808b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7\" (UID: \"4716555a-358d-4298-a0bc-1e67ecc0808b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7" Jul 01 20:28:52.636343 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:52.636272 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85d8n\" (UniqueName: \"kubernetes.io/projected/4716555a-358d-4298-a0bc-1e67ecc0808b-kube-api-access-85d8n\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7\" (UID: \"4716555a-358d-4298-a0bc-1e67ecc0808b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7" Jul 01 20:28:52.700104 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:52.700075 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7" Jul 01 20:28:52.828029 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:52.828000 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7"] Jul 01 20:28:52.830646 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:28:52.830618 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4716555a_358d_4298_a0bc_1e67ecc0808b.slice/crio-c0cb6cdb159e1efb14a50ec3fc0f9e61152ff89b90c2feca9bb28593d8ecb7e5 WatchSource:0}: Error finding container c0cb6cdb159e1efb14a50ec3fc0f9e61152ff89b90c2feca9bb28593d8ecb7e5: Status 404 returned error can't find the container with id c0cb6cdb159e1efb14a50ec3fc0f9e61152ff89b90c2feca9bb28593d8ecb7e5 Jul 01 20:28:53.359960 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:53.359922 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7" event={"ID":"4716555a-358d-4298-a0bc-1e67ecc0808b","Type":"ContainerStarted","Data":"c0cb6cdb159e1efb14a50ec3fc0f9e61152ff89b90c2feca9bb28593d8ecb7e5"} Jul 01 20:28:53.482349 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:53.482000 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cv28t"] Jul 01 20:28:54.365400 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:54.365366 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7" event={"ID":"4716555a-358d-4298-a0bc-1e67ecc0808b","Type":"ContainerStarted","Data":"a0457f7054078118cc9393c3fbc325b549de2e1d9abc81b04f011cbd29501529"} Jul 01 20:28:54.382467 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:28:54.382423 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7" podStartSLOduration=1.306192197 podStartE2EDuration="2.3824079s" totalImagesPullingTime="1.076215703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:28:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:28:54.380928627 +0000 UTC m=+708.601421575" watchObservedRunningTime="2026-07-01 20:28:54.3824079 +0000 UTC m=+708.602900849" Jul 01 20:29:01.797530 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:01.797445 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cv28t"] Jul 01 20:29:02.700900 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:02.700853 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7" Jul 01 20:29:02.701104 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:02.700932 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7" Jul 01 20:29:02.713167 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:02.713142 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7" Jul 01 20:29:03.414760 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:03.414733 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7" Jul 01 20:29:13.483699 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:13.483663 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cv28t"] Jul 01 20:29:55.749562 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:55.749527 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-549b6c7588-45srk"] Jul 01 20:29:55.752685 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:55.752664 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-549b6c7588-45srk" Jul 01 20:29:55.760737 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:55.760714 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-549b6c7588-45srk"] Jul 01 20:29:55.873694 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:55.873659 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/eb138e76-bd36-4d5e-8ee5-d888a1362f2f-oidc-ca\") pod \"authorino-549b6c7588-45srk\" (UID: \"eb138e76-bd36-4d5e-8ee5-d888a1362f2f\") " pod="kuadrant-system/authorino-549b6c7588-45srk" Jul 01 20:29:55.873866 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:55.873729 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eb138e76-bd36-4d5e-8ee5-d888a1362f2f-tls-cert\") pod \"authorino-549b6c7588-45srk\" (UID: \"eb138e76-bd36-4d5e-8ee5-d888a1362f2f\") " pod="kuadrant-system/authorino-549b6c7588-45srk" Jul 01 20:29:55.873866 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:55.873765 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ppz9\" (UniqueName: \"kubernetes.io/projected/eb138e76-bd36-4d5e-8ee5-d888a1362f2f-kube-api-access-9ppz9\") pod \"authorino-549b6c7588-45srk\" (UID: \"eb138e76-bd36-4d5e-8ee5-d888a1362f2f\") " pod="kuadrant-system/authorino-549b6c7588-45srk" Jul 01 20:29:55.974425 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:55.974387 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/eb138e76-bd36-4d5e-8ee5-d888a1362f2f-oidc-ca\") pod \"authorino-549b6c7588-45srk\" (UID: \"eb138e76-bd36-4d5e-8ee5-d888a1362f2f\") " pod="kuadrant-system/authorino-549b6c7588-45srk" Jul 01 20:29:55.974586 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:55.974464 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eb138e76-bd36-4d5e-8ee5-d888a1362f2f-tls-cert\") pod \"authorino-549b6c7588-45srk\" (UID: \"eb138e76-bd36-4d5e-8ee5-d888a1362f2f\") " pod="kuadrant-system/authorino-549b6c7588-45srk" Jul 01 20:29:55.974586 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:55.974491 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ppz9\" (UniqueName: \"kubernetes.io/projected/eb138e76-bd36-4d5e-8ee5-d888a1362f2f-kube-api-access-9ppz9\") pod \"authorino-549b6c7588-45srk\" (UID: \"eb138e76-bd36-4d5e-8ee5-d888a1362f2f\") " pod="kuadrant-system/authorino-549b6c7588-45srk" Jul 01 20:29:55.975046 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:55.975017 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/eb138e76-bd36-4d5e-8ee5-d888a1362f2f-oidc-ca\") pod \"authorino-549b6c7588-45srk\" (UID: \"eb138e76-bd36-4d5e-8ee5-d888a1362f2f\") " pod="kuadrant-system/authorino-549b6c7588-45srk" Jul 01 20:29:55.976857 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:55.976830 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eb138e76-bd36-4d5e-8ee5-d888a1362f2f-tls-cert\") pod \"authorino-549b6c7588-45srk\" (UID: \"eb138e76-bd36-4d5e-8ee5-d888a1362f2f\") " pod="kuadrant-system/authorino-549b6c7588-45srk" Jul 01 20:29:55.982010 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:55.981993 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ppz9\" (UniqueName: \"kubernetes.io/projected/eb138e76-bd36-4d5e-8ee5-d888a1362f2f-kube-api-access-9ppz9\") pod \"authorino-549b6c7588-45srk\" (UID: \"eb138e76-bd36-4d5e-8ee5-d888a1362f2f\") " pod="kuadrant-system/authorino-549b6c7588-45srk" Jul 01 20:29:56.061989 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:56.061916 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-549b6c7588-45srk" Jul 01 20:29:56.191376 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:56.191352 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-549b6c7588-45srk"] Jul 01 20:29:56.193814 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:29:56.193786 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb138e76_bd36_4d5e_8ee5_d888a1362f2f.slice/crio-14fc98474d5331a2f86f7a1a789316dda4c43175468018bd50170c529e36fca6 WatchSource:0}: Error finding container 14fc98474d5331a2f86f7a1a789316dda4c43175468018bd50170c529e36fca6: Status 404 returned error can't find the container with id 14fc98474d5331a2f86f7a1a789316dda4c43175468018bd50170c529e36fca6 Jul 01 20:29:56.631232 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:56.631195 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-549b6c7588-45srk" event={"ID":"eb138e76-bd36-4d5e-8ee5-d888a1362f2f","Type":"ContainerStarted","Data":"67f7e65df4bd8871ffc4fe7484ee5d554409d402412f424cdd2f9fb41716c690"} Jul 01 20:29:56.631385 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:56.631248 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-549b6c7588-45srk" event={"ID":"eb138e76-bd36-4d5e-8ee5-d888a1362f2f","Type":"ContainerStarted","Data":"14fc98474d5331a2f86f7a1a789316dda4c43175468018bd50170c529e36fca6"} Jul 01 20:29:56.653251 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:56.653198 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-549b6c7588-45srk" podStartSLOduration=1.305865329 podStartE2EDuration="1.653180406s" totalImagesPullingTime="347.315077ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:29:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:29:56.652892711 +0000 UTC m=+770.873385660" watchObservedRunningTime="2026-07-01 20:29:56.653180406 +0000 UTC m=+770.873673356" Jul 01 20:29:56.683923 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:56.683888 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7444cbf9c-8zqkh"] Jul 01 20:29:56.684365 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:56.684094 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7444cbf9c-8zqkh" podUID="91ecc359-498e-46f8-9fce-4b253f5504d8" containerName="authorino" containerID="cri-o://11b8fc4261417a61b69a115851ae2b63731151ecafdf0c03a4fbdfc2c5961a40" gracePeriod=30 Jul 01 20:29:56.936828 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:56.936800 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7444cbf9c-8zqkh" Jul 01 20:29:57.084227 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:57.084189 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/91ecc359-498e-46f8-9fce-4b253f5504d8-tls-cert\") pod \"91ecc359-498e-46f8-9fce-4b253f5504d8\" (UID: \"91ecc359-498e-46f8-9fce-4b253f5504d8\") " Jul 01 20:29:57.084414 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:57.084307 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/91ecc359-498e-46f8-9fce-4b253f5504d8-oidc-ca\") pod \"91ecc359-498e-46f8-9fce-4b253f5504d8\" (UID: \"91ecc359-498e-46f8-9fce-4b253f5504d8\") " Jul 01 20:29:57.084414 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:57.084350 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbr7k\" (UniqueName: \"kubernetes.io/projected/91ecc359-498e-46f8-9fce-4b253f5504d8-kube-api-access-mbr7k\") pod \"91ecc359-498e-46f8-9fce-4b253f5504d8\" (UID: \"91ecc359-498e-46f8-9fce-4b253f5504d8\") " Jul 01 20:29:57.086843 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:57.086811 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91ecc359-498e-46f8-9fce-4b253f5504d8-kube-api-access-mbr7k" (OuterVolumeSpecName: "kube-api-access-mbr7k") pod "91ecc359-498e-46f8-9fce-4b253f5504d8" (UID: "91ecc359-498e-46f8-9fce-4b253f5504d8"). InnerVolumeSpecName "kube-api-access-mbr7k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:29:57.089655 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:57.089612 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91ecc359-498e-46f8-9fce-4b253f5504d8-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "91ecc359-498e-46f8-9fce-4b253f5504d8" (UID: "91ecc359-498e-46f8-9fce-4b253f5504d8"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:29:57.095810 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:57.095765 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91ecc359-498e-46f8-9fce-4b253f5504d8-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "91ecc359-498e-46f8-9fce-4b253f5504d8" (UID: "91ecc359-498e-46f8-9fce-4b253f5504d8"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:29:57.185696 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:57.185659 2574 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/91ecc359-498e-46f8-9fce-4b253f5504d8-oidc-ca\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:29:57.185696 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:57.185692 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbr7k\" (UniqueName: \"kubernetes.io/projected/91ecc359-498e-46f8-9fce-4b253f5504d8-kube-api-access-mbr7k\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:29:57.185696 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:57.185702 2574 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/91ecc359-498e-46f8-9fce-4b253f5504d8-tls-cert\") on node \"ip-10-0-141-231.ec2.internal\" DevicePath \"\"" Jul 01 20:29:57.638673 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:57.638633 2574 generic.go:356] "Generic (PLEG): container finished" podID="91ecc359-498e-46f8-9fce-4b253f5504d8" containerID="11b8fc4261417a61b69a115851ae2b63731151ecafdf0c03a4fbdfc2c5961a40" exitCode=0 Jul 01 20:29:57.638972 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:57.638687 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7444cbf9c-8zqkh" Jul 01 20:29:57.638972 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:57.638782 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7444cbf9c-8zqkh" event={"ID":"91ecc359-498e-46f8-9fce-4b253f5504d8","Type":"ContainerDied","Data":"11b8fc4261417a61b69a115851ae2b63731151ecafdf0c03a4fbdfc2c5961a40"} Jul 01 20:29:57.638972 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:57.638816 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7444cbf9c-8zqkh" event={"ID":"91ecc359-498e-46f8-9fce-4b253f5504d8","Type":"ContainerDied","Data":"e49acd22c27ee09543afc5e6d81ab7c7423c5b5734ac1d6fa09f0974e2b03161"} Jul 01 20:29:57.638972 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:57.638835 2574 scope.go:117] "RemoveContainer" containerID="11b8fc4261417a61b69a115851ae2b63731151ecafdf0c03a4fbdfc2c5961a40" Jul 01 20:29:57.649642 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:57.649622 2574 scope.go:117] "RemoveContainer" containerID="11b8fc4261417a61b69a115851ae2b63731151ecafdf0c03a4fbdfc2c5961a40" Jul 01 20:29:57.649922 ip-10-0-141-231 kubenswrapper[2574]: E0701 20:29:57.649903 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11b8fc4261417a61b69a115851ae2b63731151ecafdf0c03a4fbdfc2c5961a40\": container with ID starting with 11b8fc4261417a61b69a115851ae2b63731151ecafdf0c03a4fbdfc2c5961a40 not found: ID does not exist" containerID="11b8fc4261417a61b69a115851ae2b63731151ecafdf0c03a4fbdfc2c5961a40" Jul 01 20:29:57.649966 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:57.649930 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11b8fc4261417a61b69a115851ae2b63731151ecafdf0c03a4fbdfc2c5961a40"} err="failed to get container status \"11b8fc4261417a61b69a115851ae2b63731151ecafdf0c03a4fbdfc2c5961a40\": rpc error: code = NotFound desc = could not find container \"11b8fc4261417a61b69a115851ae2b63731151ecafdf0c03a4fbdfc2c5961a40\": container with ID starting with 11b8fc4261417a61b69a115851ae2b63731151ecafdf0c03a4fbdfc2c5961a40 not found: ID does not exist" Jul 01 20:29:57.663753 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:57.663722 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7444cbf9c-8zqkh"] Jul 01 20:29:57.665291 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:57.665271 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7444cbf9c-8zqkh"] Jul 01 20:29:58.220027 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:29:58.219996 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91ecc359-498e-46f8-9fce-4b253f5504d8" path="/var/lib/kubelet/pods/91ecc359-498e-46f8-9fce-4b253f5504d8/volumes" Jul 01 20:30:35.337577 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:35.337500 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-549b6c7588-45srk_eb138e76-bd36-4d5e-8ee5-d888a1362f2f/authorino/0.log" Jul 01 20:30:39.784099 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:39.784055 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-74c9cf85ff-gsrv8_41da8e9e-0a80-43f9-b211-e500442c26df/nginx/0.log" Jul 01 20:30:40.797554 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:40.797528 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67bb96b6fd-gkvwb_a3f91853-6619-4132-b6fe-26ee72c926d8/copy-manifests/0.log" Jul 01 20:30:40.803784 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:40.803763 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67bb96b6fd-gkvwb_a3f91853-6619-4132-b6fe-26ee72c926d8/manager/0.log" Jul 01 20:30:42.243376 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:42.243349 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-549b6c7588-45srk_eb138e76-bd36-4d5e-8ee5-d888a1362f2f/authorino/0.log" Jul 01 20:30:42.472259 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:42.472232 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-5lpxj_b2d9a773-5b86-41f7-8746-072310180c12/manager/0.log" Jul 01 20:30:42.816828 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:42.816798 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-dwvf5_e650acee-dd18-419b-8036-459f1402fb66/manager/0.log" Jul 01 20:30:42.941724 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:42.941686 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-cv28t_9e6ceaac-b6f7-46b0-98ce-6633225f265c/limitador/0.log" Jul 01 20:30:43.885178 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:43.885136 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f97fd55b7-bscqb_e7107a7c-acf7-460f-9efb-ad355eb04091/kube-auth-proxy/0.log" Jul 01 20:30:45.427639 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:45.427611 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649mwvl7_4716555a-358d-4298-a0bc-1e67ecc0808b/main/0.log" Jul 01 20:30:52.289669 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:52.289640 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-n8j6z_c64a3366-7257-45a2-b9e8-1db08d59c81a/global-pull-secret-syncer/0.log" Jul 01 20:30:52.360629 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:52.360599 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xjj2k_5dd4d0cb-8571-4dd6-867a-49de95334f70/konnectivity-agent/0.log" Jul 01 20:30:52.455254 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:52.455167 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-231.ec2.internal_5548dc72c03db29f83e1333607e1ad90/haproxy/0.log" Jul 01 20:30:56.670953 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:56.670862 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-549b6c7588-45srk_eb138e76-bd36-4d5e-8ee5-d888a1362f2f/authorino/0.log" Jul 01 20:30:56.745442 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:56.745415 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-5lpxj_b2d9a773-5b86-41f7-8746-072310180c12/manager/0.log" Jul 01 20:30:56.895501 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:56.895466 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-dwvf5_e650acee-dd18-419b-8036-459f1402fb66/manager/0.log" Jul 01 20:30:56.917649 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:56.917624 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-cv28t_9e6ceaac-b6f7-46b0-98ce-6633225f265c/limitador/0.log" Jul 01 20:30:58.966647 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:58.966617 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-2brj6_6f7e9e75-3c51-4903-a19b-2003b141a539/kube-state-metrics/0.log" Jul 01 20:30:58.984599 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:58.984522 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-2brj6_6f7e9e75-3c51-4903-a19b-2003b141a539/kube-rbac-proxy-main/0.log" Jul 01 20:30:59.006807 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:59.006785 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-2brj6_6f7e9e75-3c51-4903-a19b-2003b141a539/kube-rbac-proxy-self/0.log" Jul 01 20:30:59.101304 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:59.101280 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5k7vc_b5c59fd4-21b1-454d-8c4e-32f9316a2976/node-exporter/0.log" Jul 01 20:30:59.123763 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:59.123741 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5k7vc_b5c59fd4-21b1-454d-8c4e-32f9316a2976/kube-rbac-proxy/0.log" Jul 01 20:30:59.144427 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:59.144407 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5k7vc_b5c59fd4-21b1-454d-8c4e-32f9316a2976/init-textfile/0.log" Jul 01 20:30:59.325788 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:59.325758 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-8wrjj_591ce368-d097-4cea-85b8-f93d96f66878/kube-rbac-proxy-main/0.log" Jul 01 20:30:59.362733 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:59.362711 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-8wrjj_591ce368-d097-4cea-85b8-f93d96f66878/kube-rbac-proxy-self/0.log" Jul 01 20:30:59.394348 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:59.394314 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-8wrjj_591ce368-d097-4cea-85b8-f93d96f66878/openshift-state-metrics/0.log" Jul 01 20:30:59.455912 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:59.455886 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cd552fdd-e599-47bf-8e81-a207df8e63ac/prometheus/0.log" Jul 01 20:30:59.486630 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:59.486606 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cd552fdd-e599-47bf-8e81-a207df8e63ac/config-reloader/0.log" Jul 01 20:30:59.516202 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:59.516180 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cd552fdd-e599-47bf-8e81-a207df8e63ac/thanos-sidecar/0.log" Jul 01 20:30:59.558025 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:59.558002 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cd552fdd-e599-47bf-8e81-a207df8e63ac/kube-rbac-proxy-web/0.log" Jul 01 20:30:59.580213 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:59.580193 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cd552fdd-e599-47bf-8e81-a207df8e63ac/kube-rbac-proxy/0.log" Jul 01 20:30:59.602317 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:59.602296 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cd552fdd-e599-47bf-8e81-a207df8e63ac/kube-rbac-proxy-thanos/0.log" Jul 01 20:30:59.625589 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:59.625572 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cd552fdd-e599-47bf-8e81-a207df8e63ac/init-config-reloader/0.log" Jul 01 20:30:59.663163 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:59.663136 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-6zfwj_f9b506aa-a0df-4d96-a5cd-5748a5352df2/prometheus-operator/0.log" Jul 01 20:30:59.685059 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:30:59.685041 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-6zfwj_f9b506aa-a0df-4d96-a5cd-5748a5352df2/kube-rbac-proxy/0.log" Jul 01 20:31:02.578254 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:02.578221 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zq556/perf-node-gather-daemonset-qnzbz"] Jul 01 20:31:02.578629 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:02.578598 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91ecc359-498e-46f8-9fce-4b253f5504d8" containerName="authorino" Jul 01 20:31:02.578629 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:02.578610 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="91ecc359-498e-46f8-9fce-4b253f5504d8" containerName="authorino" Jul 01 20:31:02.578704 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:02.578666 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="91ecc359-498e-46f8-9fce-4b253f5504d8" containerName="authorino" Jul 01 20:31:02.581496 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:02.581474 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zq556/perf-node-gather-daemonset-qnzbz" Jul 01 20:31:02.583310 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:02.583289 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zq556\"/\"openshift-service-ca.crt\"" Jul 01 20:31:02.583510 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:02.583358 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zq556\"/\"kube-root-ca.crt\"" Jul 01 20:31:02.583510 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:02.583358 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zq556\"/\"default-dockercfg-sn5vm\"" Jul 01 20:31:02.589494 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:02.589471 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zq556/perf-node-gather-daemonset-qnzbz"] Jul 01 20:31:02.620085 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:02.620059 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5499b6fb8f-jm497_ed516f34-b8e5-486f-8da5-c30216e8ab7b/download-server/0.log" Jul 01 20:31:02.639467 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:02.639430 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr8vz\" (UniqueName: \"kubernetes.io/projected/b2a44afa-9d12-44de-9c6e-a6c717253e67-kube-api-access-sr8vz\") pod \"perf-node-gather-daemonset-qnzbz\" (UID: \"b2a44afa-9d12-44de-9c6e-a6c717253e67\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-qnzbz" Jul 01 20:31:02.639592 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:02.639478 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2a44afa-9d12-44de-9c6e-a6c717253e67-lib-modules\") pod \"perf-node-gather-daemonset-qnzbz\" (UID: \"b2a44afa-9d12-44de-9c6e-a6c717253e67\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-qnzbz" Jul 01 20:31:02.639592 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:02.639507 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2a44afa-9d12-44de-9c6e-a6c717253e67-sys\") pod \"perf-node-gather-daemonset-qnzbz\" (UID: \"b2a44afa-9d12-44de-9c6e-a6c717253e67\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-qnzbz" Jul 01 20:31:02.639592 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:02.639576 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b2a44afa-9d12-44de-9c6e-a6c717253e67-proc\") pod \"perf-node-gather-daemonset-qnzbz\" (UID: \"b2a44afa-9d12-44de-9c6e-a6c717253e67\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-qnzbz" Jul 01 20:31:02.639716 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:02.639619 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b2a44afa-9d12-44de-9c6e-a6c717253e67-podres\") pod \"perf-node-gather-daemonset-qnzbz\" (UID: \"b2a44afa-9d12-44de-9c6e-a6c717253e67\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-qnzbz" Jul 01 20:31:02.740615 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:02.740587 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr8vz\" (UniqueName: \"kubernetes.io/projected/b2a44afa-9d12-44de-9c6e-a6c717253e67-kube-api-access-sr8vz\") pod \"perf-node-gather-daemonset-qnzbz\" (UID: \"b2a44afa-9d12-44de-9c6e-a6c717253e67\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-qnzbz" Jul 01 20:31:02.740773 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:02.740635 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2a44afa-9d12-44de-9c6e-a6c717253e67-lib-modules\") pod \"perf-node-gather-daemonset-qnzbz\" (UID: \"b2a44afa-9d12-44de-9c6e-a6c717253e67\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-qnzbz" Jul 01 20:31:02.740773 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:02.740660 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2a44afa-9d12-44de-9c6e-a6c717253e67-sys\") pod \"perf-node-gather-daemonset-qnzbz\" (UID: \"b2a44afa-9d12-44de-9c6e-a6c717253e67\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-qnzbz" Jul 01 20:31:02.740773 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:02.740693 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b2a44afa-9d12-44de-9c6e-a6c717253e67-proc\") pod \"perf-node-gather-daemonset-qnzbz\" (UID: \"b2a44afa-9d12-44de-9c6e-a6c717253e67\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-qnzbz" Jul 01 20:31:02.740773 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:02.740715 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b2a44afa-9d12-44de-9c6e-a6c717253e67-podres\") pod \"perf-node-gather-daemonset-qnzbz\" (UID: \"b2a44afa-9d12-44de-9c6e-a6c717253e67\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-qnzbz" Jul 01 20:31:02.740960 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:02.740784 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2a44afa-9d12-44de-9c6e-a6c717253e67-lib-modules\") pod \"perf-node-gather-daemonset-qnzbz\" (UID: \"b2a44afa-9d12-44de-9c6e-a6c717253e67\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-qnzbz" Jul 01 20:31:02.740960 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:02.740787 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2a44afa-9d12-44de-9c6e-a6c717253e67-sys\") pod \"perf-node-gather-daemonset-qnzbz\" (UID: \"b2a44afa-9d12-44de-9c6e-a6c717253e67\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-qnzbz" Jul 01 20:31:02.740960 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:02.740808 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b2a44afa-9d12-44de-9c6e-a6c717253e67-proc\") pod \"perf-node-gather-daemonset-qnzbz\" (UID: \"b2a44afa-9d12-44de-9c6e-a6c717253e67\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-qnzbz" Jul 01 20:31:02.740960 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:02.740883 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b2a44afa-9d12-44de-9c6e-a6c717253e67-podres\") pod \"perf-node-gather-daemonset-qnzbz\" (UID: \"b2a44afa-9d12-44de-9c6e-a6c717253e67\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-qnzbz" Jul 01 20:31:02.748547 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:02.748525 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr8vz\" (UniqueName: \"kubernetes.io/projected/b2a44afa-9d12-44de-9c6e-a6c717253e67-kube-api-access-sr8vz\") pod \"perf-node-gather-daemonset-qnzbz\" (UID: \"b2a44afa-9d12-44de-9c6e-a6c717253e67\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-qnzbz" Jul 01 20:31:02.891359 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:02.891246 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zq556/perf-node-gather-daemonset-qnzbz" Jul 01 20:31:03.016630 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:03.016604 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zq556/perf-node-gather-daemonset-qnzbz"] Jul 01 20:31:03.018919 ip-10-0-141-231 kubenswrapper[2574]: W0701 20:31:03.018891 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb2a44afa_9d12_44de_9c6e_a6c717253e67.slice/crio-23ee6fb6951b126a25ad3abc0c5256d7e7ec288284a6210cdde41d904f64c2c0 WatchSource:0}: Error finding container 23ee6fb6951b126a25ad3abc0c5256d7e7ec288284a6210cdde41d904f64c2c0: Status 404 returned error can't find the container with id 23ee6fb6951b126a25ad3abc0c5256d7e7ec288284a6210cdde41d904f64c2c0 Jul 01 20:31:03.937578 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:03.937542 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zq556/perf-node-gather-daemonset-qnzbz" event={"ID":"b2a44afa-9d12-44de-9c6e-a6c717253e67","Type":"ContainerStarted","Data":"447349a3620e7cf25575f9889489b9d1a6ee4a5c146d829eaaf30257492b1fc3"} Jul 01 20:31:03.938254 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:03.937602 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zq556/perf-node-gather-daemonset-qnzbz" event={"ID":"b2a44afa-9d12-44de-9c6e-a6c717253e67","Type":"ContainerStarted","Data":"23ee6fb6951b126a25ad3abc0c5256d7e7ec288284a6210cdde41d904f64c2c0"} Jul 01 20:31:03.938254 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:03.937660 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zq556/perf-node-gather-daemonset-qnzbz" Jul 01 20:31:03.953726 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:03.953682 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zq556/perf-node-gather-daemonset-qnzbz" podStartSLOduration=1.9536673100000002 podStartE2EDuration="1.95366731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:31:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:31:03.952014605 +0000 UTC m=+838.172507578" watchObservedRunningTime="2026-07-01 20:31:03.95366731 +0000 UTC m=+838.174160258" Jul 01 20:31:04.246693 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:04.246618 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5xk96_dfcf9070-0230-4b25-ae6d-bf3c6bc51cb8/dns/0.log" Jul 01 20:31:04.268348 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:04.268299 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5xk96_dfcf9070-0230-4b25-ae6d-bf3c6bc51cb8/kube-rbac-proxy/0.log" Jul 01 20:31:04.398975 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:04.398945 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dltf8_43152b18-e982-4ed0-a0b1-bbb43942c9b8/dns-node-resolver/0.log" Jul 01 20:31:04.953097 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:04.953071 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mdknz_3dcbabb0-a6a2-4add-a392-561e8cedc9d2/node-ca/0.log" Jul 01 20:31:05.978916 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:05.978891 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f97fd55b7-bscqb_e7107a7c-acf7-460f-9efb-ad355eb04091/kube-auth-proxy/0.log" Jul 01 20:31:06.697389 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:06.697361 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qx7kb_5f2457d4-e11f-44e6-b5f5-9c64fbc4eb65/serve-healthcheck-canary/0.log" Jul 01 20:31:07.277903 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:07.277877 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qmrmp_d03b064c-b018-4fcb-9f99-ce9c2e54105c/kube-rbac-proxy/0.log" Jul 01 20:31:07.296918 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:07.296890 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qmrmp_d03b064c-b018-4fcb-9f99-ce9c2e54105c/exporter/0.log" Jul 01 20:31:07.317311 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:07.317290 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qmrmp_d03b064c-b018-4fcb-9f99-ce9c2e54105c/extractor/0.log" Jul 01 20:31:09.550026 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:09.549994 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-74c9cf85ff-gsrv8_41da8e9e-0a80-43f9-b211-e500442c26df/nginx/0.log" Jul 01 20:31:09.944721 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:09.944687 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67bb96b6fd-gkvwb_a3f91853-6619-4132-b6fe-26ee72c926d8/manager/0.log" Jul 01 20:31:09.951931 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:09.951910 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zq556/perf-node-gather-daemonset-qnzbz" Jul 01 20:31:09.985635 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:09.985610 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67bb96b6fd-gkvwb_a3f91853-6619-4132-b6fe-26ee72c926d8/copy-manifests/0.log" Jul 01 20:31:11.498245 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:11.498206 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7565f6b689-8pcz9_0154266f-4153-4f06-9bac-da3f628b2d23/manager/0.log" Jul 01 20:31:12.565365 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:12.565275 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f97fd55b7-bscqb_e7107a7c-acf7-460f-9efb-ad355eb04091/kube-auth-proxy/0.log" Jul 01 20:31:13.726676 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:13.726642 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f97fd55b7-bscqb_e7107a7c-acf7-460f-9efb-ad355eb04091/kube-auth-proxy/0.log" Jul 01 20:31:17.983503 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:17.983473 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2bqpm_130bae62-2f3a-4d1c-8e3c-05c0643fadd9/kube-multus/0.log" Jul 01 20:31:18.160138 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:18.160059 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dw6kb_7e5e6e70-82d3-4cd0-b589-68fb150c80cc/kube-multus-additional-cni-plugins/0.log" Jul 01 20:31:18.182921 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:18.182897 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dw6kb_7e5e6e70-82d3-4cd0-b589-68fb150c80cc/egress-router-binary-copy/0.log" Jul 01 20:31:18.204079 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:18.204056 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dw6kb_7e5e6e70-82d3-4cd0-b589-68fb150c80cc/cni-plugins/0.log" Jul 01 20:31:18.224614 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:18.224593 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dw6kb_7e5e6e70-82d3-4cd0-b589-68fb150c80cc/bond-cni-plugin/0.log" Jul 01 20:31:18.248040 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:18.248015 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dw6kb_7e5e6e70-82d3-4cd0-b589-68fb150c80cc/routeoverride-cni/0.log" Jul 01 20:31:18.273074 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:18.273044 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dw6kb_7e5e6e70-82d3-4cd0-b589-68fb150c80cc/whereabouts-cni-bincopy/0.log" Jul 01 20:31:18.294605 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:18.294525 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dw6kb_7e5e6e70-82d3-4cd0-b589-68fb150c80cc/whereabouts-cni/0.log" Jul 01 20:31:18.571095 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:18.571014 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-krqwd_0077ab1f-92a9-4220-a3bd-cb3af8897040/network-metrics-daemon/0.log" Jul 01 20:31:18.593253 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:18.593226 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-krqwd_0077ab1f-92a9-4220-a3bd-cb3af8897040/kube-rbac-proxy/0.log" Jul 01 20:31:19.403238 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:19.403207 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mfbr_7ece6589-3e50-4328-aa47-3a030462201a/ovn-controller/0.log" Jul 01 20:31:19.419253 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:19.419206 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mfbr_7ece6589-3e50-4328-aa47-3a030462201a/ovn-acl-logging/0.log" Jul 01 20:31:19.419253 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:19.419214 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mfbr_7ece6589-3e50-4328-aa47-3a030462201a/ovn-acl-logging/1.log" Jul 01 20:31:19.434886 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:19.434863 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mfbr_7ece6589-3e50-4328-aa47-3a030462201a/kube-rbac-proxy-node/0.log" Jul 01 20:31:19.454421 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:19.454398 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mfbr_7ece6589-3e50-4328-aa47-3a030462201a/kube-rbac-proxy-ovn-metrics/0.log" Jul 01 20:31:19.474208 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:19.474189 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mfbr_7ece6589-3e50-4328-aa47-3a030462201a/northd/0.log" Jul 01 20:31:19.498636 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:19.498618 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mfbr_7ece6589-3e50-4328-aa47-3a030462201a/nbdb/0.log" Jul 01 20:31:19.517297 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:19.517280 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mfbr_7ece6589-3e50-4328-aa47-3a030462201a/sbdb/0.log" Jul 01 20:31:19.558596 ip-10-0-141-231 kubenswrapper[2574]: I0701 20:31:19.558570 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mfbr_7ece6589-3e50-4328-aa47-3a030462201a/ovnkube-controller/0.log"