Jul 10 15:55:00.469902 ip-10-0-136-164 systemd[1]: Starting Kubernetes Kubelet... Jul 10 15:55:00.778169 ip-10-0-136-164 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 15:55:00.778169 ip-10-0-136-164 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 10 15:55:00.778169 ip-10-0-136-164 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 15:55:00.778169 ip-10-0-136-164 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 10 15:55:00.778169 ip-10-0-136-164 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 15:55:00.780109 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.780018 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 10 15:55:00.786430 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786407 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 15:55:00.786430 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786431 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 15:55:00.786506 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786435 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 15:55:00.786506 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786438 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 15:55:00.786506 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786441 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 15:55:00.786506 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786443 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 15:55:00.786506 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786447 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 15:55:00.786506 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786450 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 15:55:00.786506 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786452 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 15:55:00.786506 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786455 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 15:55:00.786506 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786457 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 15:55:00.786506 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786460 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 15:55:00.786506 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786462 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 15:55:00.786506 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786465 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 15:55:00.786506 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786467 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 15:55:00.786506 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786470 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 15:55:00.786506 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786472 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 15:55:00.786506 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786474 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 15:55:00.786506 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786483 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 15:55:00.786506 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786486 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 15:55:00.786506 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786488 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 15:55:00.786506 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786490 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 15:55:00.786989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786493 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 15:55:00.786989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786495 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 15:55:00.786989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786497 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 15:55:00.786989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786500 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 15:55:00.786989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786502 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 15:55:00.786989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786505 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 15:55:00.786989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786507 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 15:55:00.786989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786510 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 15:55:00.786989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786513 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 15:55:00.786989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786515 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 15:55:00.786989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786518 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 15:55:00.786989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786520 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 15:55:00.786989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786523 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 15:55:00.786989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786525 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 15:55:00.786989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786528 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 15:55:00.786989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786530 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 15:55:00.786989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786533 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 15:55:00.786989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786535 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 15:55:00.786989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786537 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 15:55:00.786989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786540 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 10 15:55:00.787455 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786542 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 15:55:00.787455 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786544 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 15:55:00.787455 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786547 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 15:55:00.787455 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786549 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 15:55:00.787455 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786551 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 15:55:00.787455 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786554 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 15:55:00.787455 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786556 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 15:55:00.787455 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786561 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 15:55:00.787455 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786563 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 15:55:00.787455 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786577 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 15:55:00.787455 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786579 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 15:55:00.787455 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786582 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 15:55:00.787455 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786585 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 15:55:00.787455 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786588 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 15:55:00.787455 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786591 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 15:55:00.787455 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786593 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 15:55:00.787455 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786596 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 15:55:00.787455 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786598 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 15:55:00.787455 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786601 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 15:55:00.787948 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786603 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 15:55:00.787948 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786606 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 15:55:00.787948 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786608 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 15:55:00.787948 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786611 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 15:55:00.787948 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786613 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 15:55:00.787948 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786616 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 15:55:00.787948 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786619 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 15:55:00.787948 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786621 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 15:55:00.787948 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786624 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 15:55:00.787948 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786626 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 15:55:00.787948 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786628 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 15:55:00.787948 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786631 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 15:55:00.787948 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786633 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 15:55:00.787948 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786636 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 15:55:00.787948 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786640 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 15:55:00.787948 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786643 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 15:55:00.787948 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786646 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 15:55:00.787948 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786648 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 15:55:00.787948 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786651 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 15:55:00.788402 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786653 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 15:55:00.788402 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786656 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 15:55:00.788402 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786658 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 15:55:00.788402 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786661 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 15:55:00.788402 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786664 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 15:55:00.788402 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786666 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 15:55:00.788402 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786671 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 15:55:00.788402 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786674 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 15:55:00.788402 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786677 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 15:55:00.788402 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786679 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 15:55:00.788402 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786682 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 15:55:00.788402 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786684 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 15:55:00.788402 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786688 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 15:55:00.788402 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786691 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 15:55:00.788402 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786694 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 15:55:00.788402 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786697 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 15:55:00.788402 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786700 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 15:55:00.788402 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786703 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 15:55:00.788402 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.786706 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 15:55:00.788402 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787413 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 15:55:00.788935 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787420 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 15:55:00.788935 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787423 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 15:55:00.788935 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787426 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 15:55:00.788935 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787430 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 15:55:00.788935 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787433 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 15:55:00.788935 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787435 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 15:55:00.788935 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787438 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 15:55:00.788935 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787440 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 15:55:00.788935 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787443 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 15:55:00.788935 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787446 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 15:55:00.788935 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787448 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 15:55:00.788935 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787451 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 15:55:00.788935 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787453 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 15:55:00.788935 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787455 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 15:55:00.788935 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787458 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 15:55:00.788935 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787461 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 15:55:00.788935 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787464 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 15:55:00.788935 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787467 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 15:55:00.788935 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787470 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 15:55:00.788935 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787473 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 15:55:00.789420 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787476 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 15:55:00.789420 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787478 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 15:55:00.789420 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787481 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 15:55:00.789420 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787484 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 15:55:00.789420 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787486 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 15:55:00.789420 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787489 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 15:55:00.789420 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787491 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 15:55:00.789420 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787494 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 15:55:00.789420 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787496 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 15:55:00.789420 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787499 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 15:55:00.789420 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787501 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 15:55:00.789420 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787504 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 15:55:00.789420 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787507 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 15:55:00.789420 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787509 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 15:55:00.789420 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787511 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 15:55:00.789420 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787514 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 15:55:00.789420 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787516 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 15:55:00.789420 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787519 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 15:55:00.789420 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787521 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 15:55:00.789420 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787523 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 15:55:00.789923 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787526 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 15:55:00.789923 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787528 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 15:55:00.789923 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787531 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 15:55:00.789923 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787534 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 15:55:00.789923 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787537 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 15:55:00.789923 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787539 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 15:55:00.789923 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787541 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 15:55:00.789923 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787555 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 15:55:00.789923 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787560 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 15:55:00.789923 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787562 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 15:55:00.789923 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787565 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 15:55:00.789923 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787585 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 15:55:00.789923 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787588 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 15:55:00.789923 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787592 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 15:55:00.789923 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787596 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 15:55:00.789923 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787599 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 15:55:00.789923 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787602 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 15:55:00.789923 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787605 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 15:55:00.789923 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787608 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 15:55:00.790379 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787610 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 15:55:00.790379 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787612 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 15:55:00.790379 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787615 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 15:55:00.790379 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787618 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 15:55:00.790379 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787625 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 15:55:00.790379 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787629 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 15:55:00.790379 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787631 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 15:55:00.790379 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787635 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 15:55:00.790379 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787637 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 15:55:00.790379 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787640 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 15:55:00.790379 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787643 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 15:55:00.790379 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787645 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 15:55:00.790379 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787648 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 15:55:00.790379 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787651 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 15:55:00.790379 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787654 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 15:55:00.790379 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787657 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 15:55:00.790379 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787660 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 15:55:00.790379 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787663 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 15:55:00.790379 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787665 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 15:55:00.790847 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787668 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 15:55:00.790847 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787671 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 15:55:00.790847 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787673 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 15:55:00.790847 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787677 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 15:55:00.790847 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787681 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 15:55:00.790847 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787687 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 15:55:00.790847 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787689 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 15:55:00.790847 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787692 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 15:55:00.790847 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787694 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 15:55:00.790847 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787697 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 15:55:00.790847 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787700 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 15:55:00.790847 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787703 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 15:55:00.790847 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787705 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 15:55:00.790847 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787707 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 15:55:00.790847 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787710 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 15:55:00.790847 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787712 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 15:55:00.790847 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787715 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 15:55:00.790847 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787717 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 10 15:55:00.790847 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787720 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 15:55:00.790847 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.787722 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 15:55:00.791311 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788157 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 15:55:00.791311 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788163 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 15:55:00.791311 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788166 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 15:55:00.791311 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788169 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 15:55:00.791311 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788172 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 15:55:00.791311 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788175 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 15:55:00.791311 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788177 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 15:55:00.791311 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788180 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 15:55:00.791311 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788183 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 15:55:00.791311 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788185 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 15:55:00.791311 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788188 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 15:55:00.791311 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788190 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 15:55:00.791311 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788193 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 15:55:00.791311 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788195 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 15:55:00.791311 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788199 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 15:55:00.791311 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788203 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 15:55:00.791311 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788206 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 15:55:00.791311 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788211 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 15:55:00.791311 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788214 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 15:55:00.791781 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788217 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 15:55:00.791781 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788220 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 15:55:00.791781 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788223 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 15:55:00.791781 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788225 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 15:55:00.791781 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788228 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 15:55:00.791781 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788230 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 15:55:00.791781 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788232 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 15:55:00.791781 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788235 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 15:55:00.791781 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788237 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 15:55:00.791781 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788240 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 15:55:00.791781 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788242 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 15:55:00.791781 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788245 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 15:55:00.791781 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788247 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 15:55:00.791781 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788250 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 15:55:00.791781 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788254 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 15:55:00.791781 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788257 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 15:55:00.791781 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788260 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 15:55:00.791781 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788263 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 15:55:00.791781 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788265 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 15:55:00.792231 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788268 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 15:55:00.792231 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788270 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 15:55:00.792231 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788273 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 15:55:00.792231 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788276 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 15:55:00.792231 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788278 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 15:55:00.792231 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788280 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 15:55:00.792231 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788283 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 15:55:00.792231 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788285 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 15:55:00.792231 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788288 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 15:55:00.792231 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788290 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 15:55:00.792231 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788293 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 15:55:00.792231 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788297 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 15:55:00.792231 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788300 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 15:55:00.792231 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788302 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 15:55:00.792231 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788305 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 15:55:00.792231 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788307 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 15:55:00.792231 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788309 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 15:55:00.792231 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788312 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 15:55:00.792231 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788314 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 15:55:00.792231 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788316 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 15:55:00.792718 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788319 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 15:55:00.792718 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788321 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 15:55:00.792718 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788324 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 15:55:00.792718 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788326 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 10 15:55:00.792718 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788329 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 15:55:00.792718 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788331 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 15:55:00.792718 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788333 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 15:55:00.792718 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788336 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 15:55:00.792718 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788338 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 15:55:00.792718 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788341 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 15:55:00.792718 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788343 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 15:55:00.792718 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788345 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 15:55:00.792718 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788348 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 15:55:00.792718 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788350 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 15:55:00.792718 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788353 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 15:55:00.792718 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788356 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 15:55:00.792718 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788358 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 15:55:00.792718 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788362 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 15:55:00.792718 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788364 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 15:55:00.792718 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788366 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 15:55:00.793184 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788369 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 15:55:00.793184 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788372 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 15:55:00.793184 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788375 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 15:55:00.793184 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788379 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 15:55:00.793184 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788382 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 15:55:00.793184 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788384 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 15:55:00.793184 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788387 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 15:55:00.793184 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788390 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 15:55:00.793184 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788392 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 15:55:00.793184 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788395 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 15:55:00.793184 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788397 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 15:55:00.793184 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788400 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 15:55:00.793184 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788402 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 15:55:00.793184 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788405 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 15:55:00.793184 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788407 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 15:55:00.793184 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788410 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 15:55:00.793184 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788413 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 15:55:00.793184 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788415 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 15:55:00.793184 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788418 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 15:55:00.793690 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788420 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 15:55:00.793690 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.788423 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 15:55:00.793690 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788493 2562 flags.go:64] FLAG: --address="0.0.0.0" Jul 10 15:55:00.793690 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788501 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 10 15:55:00.793690 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788507 2562 flags.go:64] FLAG: --anonymous-auth="true" Jul 10 15:55:00.793690 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788511 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 10 15:55:00.793690 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788516 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 10 15:55:00.793690 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788519 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 10 15:55:00.793690 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788523 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 10 15:55:00.793690 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788527 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 10 15:55:00.793690 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788530 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 10 15:55:00.793690 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788533 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 10 15:55:00.793690 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788536 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 10 15:55:00.793690 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788539 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 10 15:55:00.793690 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788542 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 10 15:55:00.793690 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788545 2562 flags.go:64] FLAG: --cgroup-root="" Jul 10 15:55:00.793690 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788549 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 10 15:55:00.793690 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788552 2562 flags.go:64] FLAG: --client-ca-file="" Jul 10 15:55:00.793690 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788555 2562 flags.go:64] FLAG: --cloud-provider="external" Jul 10 15:55:00.793690 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788558 2562 flags.go:64] FLAG: --cluster-dns="[]" Jul 10 15:55:00.793690 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788563 2562 flags.go:64] FLAG: --cluster-domain="" Jul 10 15:55:00.793690 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788565 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 10 15:55:00.793690 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788586 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 10 15:55:00.793690 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788589 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 10 15:55:00.794246 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788592 2562 flags.go:64] FLAG: --container-log-max-files="5" Jul 10 15:55:00.794246 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788596 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 10 15:55:00.794246 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788598 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 10 15:55:00.794246 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788602 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 10 15:55:00.794246 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788605 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 10 15:55:00.794246 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788608 2562 flags.go:64] FLAG: --contention-profiling="false" Jul 10 15:55:00.794246 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788610 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 10 15:55:00.794246 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788614 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 10 15:55:00.794246 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788617 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 10 15:55:00.794246 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788620 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 10 15:55:00.794246 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788627 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 10 15:55:00.794246 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788630 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 10 15:55:00.794246 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788633 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 10 15:55:00.794246 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788636 2562 flags.go:64] FLAG: --enable-load-reader="false" Jul 10 15:55:00.794246 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788639 2562 flags.go:64] FLAG: --enable-server="true" Jul 10 15:55:00.794246 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788642 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 10 15:55:00.794246 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788646 2562 flags.go:64] FLAG: --event-burst="100" Jul 10 15:55:00.794246 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788649 2562 flags.go:64] FLAG: --event-qps="50" Jul 10 15:55:00.794246 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788651 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 10 15:55:00.794246 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788654 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 10 15:55:00.794246 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788657 2562 flags.go:64] FLAG: --eviction-hard="" Jul 10 15:55:00.794246 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788660 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 10 15:55:00.794246 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788663 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 10 15:55:00.794246 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788666 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 10 15:55:00.794246 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788669 2562 flags.go:64] FLAG: --eviction-soft="" Jul 10 15:55:00.795025 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788673 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 10 15:55:00.795025 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788676 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 10 15:55:00.795025 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788679 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 10 15:55:00.795025 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788683 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jul 10 15:55:00.795025 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788685 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 10 15:55:00.795025 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788688 2562 flags.go:64] FLAG: --fail-swap-on="true" Jul 10 15:55:00.795025 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788691 2562 flags.go:64] FLAG: --feature-gates="" Jul 10 15:55:00.795025 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788695 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jul 10 15:55:00.795025 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788698 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 10 15:55:00.795025 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788701 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 10 15:55:00.795025 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788704 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 10 15:55:00.795025 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788707 2562 flags.go:64] FLAG: --healthz-port="10248" Jul 10 15:55:00.795025 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788710 2562 flags.go:64] FLAG: --help="false" Jul 10 15:55:00.795025 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788715 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-136-164.ec2.internal" Jul 10 15:55:00.795025 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788718 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 10 15:55:00.795025 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788721 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jul 10 15:55:00.795025 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788724 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 10 15:55:00.795025 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788727 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 10 15:55:00.795025 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788731 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 10 15:55:00.795025 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788734 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 10 15:55:00.795025 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788737 2562 flags.go:64] FLAG: --image-service-endpoint="" Jul 10 15:55:00.795025 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788740 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 10 15:55:00.795025 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788742 2562 flags.go:64] FLAG: --kube-api-burst="100" Jul 10 15:55:00.795646 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788745 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 10 15:55:00.795646 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788748 2562 flags.go:64] FLAG: --kube-api-qps="50" Jul 10 15:55:00.795646 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788751 2562 flags.go:64] FLAG: --kube-reserved="" Jul 10 15:55:00.795646 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788754 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 10 15:55:00.795646 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788757 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 10 15:55:00.795646 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788760 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jul 10 15:55:00.795646 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788763 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 10 15:55:00.795646 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788766 2562 flags.go:64] FLAG: --lock-file="" Jul 10 15:55:00.795646 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788769 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 10 15:55:00.795646 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788772 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 10 15:55:00.795646 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788775 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 10 15:55:00.795646 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788781 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jul 10 15:55:00.795646 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788784 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 10 15:55:00.795646 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788787 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jul 10 15:55:00.795646 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788789 2562 flags.go:64] FLAG: --logging-format="text" Jul 10 15:55:00.795646 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788792 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 10 15:55:00.795646 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788796 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 10 15:55:00.795646 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788798 2562 flags.go:64] FLAG: --manifest-url="" Jul 10 15:55:00.795646 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788801 2562 flags.go:64] FLAG: --manifest-url-header="" Jul 10 15:55:00.795646 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788805 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 10 15:55:00.795646 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788809 2562 flags.go:64] FLAG: --max-open-files="1000000" Jul 10 15:55:00.795646 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788813 2562 flags.go:64] FLAG: --max-pods="110" Jul 10 15:55:00.795646 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788817 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 10 15:55:00.795646 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788820 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 10 15:55:00.795646 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788823 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jul 10 15:55:00.796333 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788826 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 10 15:55:00.796333 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788829 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 10 15:55:00.796333 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788832 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 10 15:55:00.796333 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788835 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 10 15:55:00.796333 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788842 2562 flags.go:64] FLAG: --node-status-max-images="50" Jul 10 15:55:00.796333 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788845 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 10 15:55:00.796333 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788848 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jul 10 15:55:00.796333 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788851 2562 flags.go:64] FLAG: --pod-cidr="" Jul 10 15:55:00.796333 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788853 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 10 15:55:00.796333 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788859 2562 flags.go:64] FLAG: --pod-manifest-path="" Jul 10 15:55:00.796333 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788862 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jul 10 15:55:00.796333 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788865 2562 flags.go:64] FLAG: --pods-per-core="0" Jul 10 15:55:00.796333 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788868 2562 flags.go:64] FLAG: --port="10250" Jul 10 15:55:00.796333 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788871 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 10 15:55:00.796333 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788874 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c48c614cdcd0de8c" Jul 10 15:55:00.796333 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788877 2562 flags.go:64] FLAG: --qos-reserved="" Jul 10 15:55:00.796333 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788880 2562 flags.go:64] FLAG: --read-only-port="10255" Jul 10 15:55:00.796333 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788883 2562 flags.go:64] FLAG: --register-node="true" Jul 10 15:55:00.796333 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788886 2562 flags.go:64] FLAG: --register-with-taints="" Jul 10 15:55:00.796333 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788890 2562 flags.go:64] FLAG: --registry-burst="10" Jul 10 15:55:00.796333 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788893 2562 flags.go:64] FLAG: --registry-qps="5" Jul 10 15:55:00.796333 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788896 2562 flags.go:64] FLAG: --reserved-cpus="" Jul 10 15:55:00.796333 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788899 2562 flags.go:64] FLAG: --reserved-memory="" Jul 10 15:55:00.796333 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788903 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 10 15:55:00.796333 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788905 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 10 15:55:00.797299 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788908 2562 flags.go:64] FLAG: --rotate-certificates="false" Jul 10 15:55:00.797299 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788911 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 10 15:55:00.797299 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788914 2562 flags.go:64] FLAG: --runonce="false" Jul 10 15:55:00.797299 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788916 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 10 15:55:00.797299 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788921 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 10 15:55:00.797299 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788924 2562 flags.go:64] FLAG: --seccomp-default="false" Jul 10 15:55:00.797299 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788926 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 10 15:55:00.797299 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788929 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 10 15:55:00.797299 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788932 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 10 15:55:00.797299 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788935 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 10 15:55:00.797299 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788938 2562 flags.go:64] FLAG: --storage-driver-password="root" Jul 10 15:55:00.797299 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788941 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jul 10 15:55:00.797299 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788944 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jul 10 15:55:00.797299 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788947 2562 flags.go:64] FLAG: --storage-driver-user="root" Jul 10 15:55:00.797299 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788950 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 10 15:55:00.797299 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788953 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 10 15:55:00.797299 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788956 2562 flags.go:64] FLAG: --system-cgroups="" Jul 10 15:55:00.797299 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788959 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 10 15:55:00.797299 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788964 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 10 15:55:00.797299 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788966 2562 flags.go:64] FLAG: --tls-cert-file="" Jul 10 15:55:00.797299 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788969 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 10 15:55:00.797299 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788973 2562 flags.go:64] FLAG: --tls-min-version="" Jul 10 15:55:00.797299 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788976 2562 flags.go:64] FLAG: --tls-private-key-file="" Jul 10 15:55:00.797299 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788981 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jul 10 15:55:00.797299 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788984 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 10 15:55:00.798024 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788987 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jul 10 15:55:00.798024 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788989 2562 flags.go:64] FLAG: --v="2" Jul 10 15:55:00.798024 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788994 2562 flags.go:64] FLAG: --version="false" Jul 10 15:55:00.798024 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.788998 2562 flags.go:64] FLAG: --vmodule="" Jul 10 15:55:00.798024 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.789002 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 10 15:55:00.798024 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.789005 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 10 15:55:00.798024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789121 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 15:55:00.798024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789125 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 15:55:00.798024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789129 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 15:55:00.798024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789132 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 15:55:00.798024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789135 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 15:55:00.798024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789140 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 15:55:00.798024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789142 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 15:55:00.798024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789145 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 15:55:00.798024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789148 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 15:55:00.798024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789150 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 15:55:00.798024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789153 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 15:55:00.798024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789155 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 15:55:00.798024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789158 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 15:55:00.798024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789160 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 15:55:00.798024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789162 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 15:55:00.798530 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789165 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 15:55:00.798530 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789167 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 15:55:00.798530 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789170 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 15:55:00.798530 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789173 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 15:55:00.798530 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789176 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 15:55:00.798530 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789178 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 15:55:00.798530 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789180 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 15:55:00.798530 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789183 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 15:55:00.798530 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789185 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 15:55:00.798530 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789189 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 15:55:00.798530 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789192 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 15:55:00.798530 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789194 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 15:55:00.798530 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789197 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 15:55:00.798530 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789199 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 15:55:00.798530 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789202 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 15:55:00.798530 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789205 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 15:55:00.798530 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789207 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 15:55:00.798530 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789210 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 15:55:00.798530 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789212 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 15:55:00.798530 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789215 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 15:55:00.799024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789217 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 15:55:00.799024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789219 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 15:55:00.799024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789223 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 15:55:00.799024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789227 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 15:55:00.799024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789230 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 15:55:00.799024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789233 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 15:55:00.799024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789235 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 15:55:00.799024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789238 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 15:55:00.799024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789240 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 15:55:00.799024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789243 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 15:55:00.799024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789247 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 15:55:00.799024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789250 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 15:55:00.799024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789253 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 15:55:00.799024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789255 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 15:55:00.799024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789258 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 15:55:00.799024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789261 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 15:55:00.799024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789264 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 15:55:00.799024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789266 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 15:55:00.799024 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789269 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 15:55:00.799485 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789271 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 15:55:00.799485 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789274 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 15:55:00.799485 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789277 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 15:55:00.799485 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789280 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 15:55:00.799485 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789282 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 15:55:00.799485 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789285 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 15:55:00.799485 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789288 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 15:55:00.799485 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789290 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 15:55:00.799485 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789293 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 15:55:00.799485 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789295 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 15:55:00.799485 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789298 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 15:55:00.799485 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789300 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 15:55:00.799485 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789303 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 15:55:00.799485 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789305 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 15:55:00.799485 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789307 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 15:55:00.799485 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789311 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 15:55:00.799485 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789313 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 15:55:00.799485 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789317 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 15:55:00.799485 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789320 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 15:55:00.800041 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789323 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 15:55:00.800041 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789325 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 15:55:00.800041 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789328 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 15:55:00.800041 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789330 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 15:55:00.800041 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789333 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 15:55:00.800041 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789335 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 15:55:00.800041 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789338 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 15:55:00.800041 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789341 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 15:55:00.800041 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789343 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 15:55:00.800041 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789346 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 15:55:00.800041 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789348 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 15:55:00.800041 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789350 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 15:55:00.800041 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789353 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 15:55:00.800041 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789355 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 15:55:00.800041 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789358 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 15:55:00.800041 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789361 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 15:55:00.800041 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789364 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 15:55:00.800041 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789366 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 15:55:00.800041 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789369 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 15:55:00.800041 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789371 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 15:55:00.800516 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789374 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 10 15:55:00.800516 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789376 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 15:55:00.800516 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789379 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 15:55:00.800516 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789382 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 15:55:00.800516 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789384 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 15:55:00.800516 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.789386 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 15:55:00.800516 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.789921 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 15:55:00.800516 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.798868 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 10 15:55:00.800516 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.799012 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 10 15:55:00.800516 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.799035 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 10 15:55:00.800516 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.799043 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 10 15:55:00.800516 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799103 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 15:55:00.800516 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799109 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 15:55:00.800516 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799113 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 10 15:55:00.800516 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799116 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 15:55:00.800904 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799119 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 15:55:00.800904 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799122 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 15:55:00.800904 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799125 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 15:55:00.800904 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799128 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 15:55:00.800904 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799131 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 15:55:00.800904 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799133 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 15:55:00.800904 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799136 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 15:55:00.800904 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799139 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 15:55:00.800904 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799143 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 15:55:00.800904 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799146 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 15:55:00.800904 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799149 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 15:55:00.800904 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799151 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 15:55:00.800904 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799154 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 15:55:00.800904 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799157 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 15:55:00.800904 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799160 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 15:55:00.800904 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799162 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 15:55:00.800904 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799165 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 15:55:00.800904 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799167 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 15:55:00.800904 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799170 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 15:55:00.801355 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799172 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 15:55:00.801355 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799175 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 15:55:00.801355 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799177 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 15:55:00.801355 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799180 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 15:55:00.801355 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799183 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 15:55:00.801355 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799185 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 15:55:00.801355 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799188 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 15:55:00.801355 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799191 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 15:55:00.801355 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799195 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 15:55:00.801355 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799198 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 15:55:00.801355 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799200 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 15:55:00.801355 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799203 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 15:55:00.801355 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799205 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 15:55:00.801355 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799208 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 15:55:00.801355 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799210 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 15:55:00.801355 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799213 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 15:55:00.801355 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799215 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 15:55:00.801355 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799218 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 15:55:00.801355 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799220 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 15:55:00.801355 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799223 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 15:55:00.801856 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799225 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 15:55:00.801856 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799228 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 15:55:00.801856 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799230 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 15:55:00.801856 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799233 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 15:55:00.801856 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799236 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 15:55:00.801856 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799239 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 15:55:00.801856 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799241 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 15:55:00.801856 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799244 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 15:55:00.801856 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799246 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 15:55:00.801856 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799248 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 15:55:00.801856 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799251 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 15:55:00.801856 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799253 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 15:55:00.801856 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799256 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 15:55:00.801856 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799258 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 15:55:00.801856 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799261 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 15:55:00.801856 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799263 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 15:55:00.801856 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799266 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 15:55:00.801856 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799268 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 15:55:00.801856 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799271 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 15:55:00.802306 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799274 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 15:55:00.802306 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799276 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 15:55:00.802306 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799279 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 15:55:00.802306 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799281 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 15:55:00.802306 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799284 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 15:55:00.802306 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799286 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 15:55:00.802306 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799307 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 15:55:00.802306 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799311 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 15:55:00.802306 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799314 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 15:55:00.802306 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799317 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 15:55:00.802306 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799320 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 15:55:00.802306 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799323 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 15:55:00.802306 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799325 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 15:55:00.802306 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799330 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 15:55:00.802306 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799333 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 15:55:00.802306 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799336 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 15:55:00.802306 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799339 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 15:55:00.802306 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799343 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 15:55:00.802306 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799346 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 15:55:00.802306 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799349 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 15:55:00.802796 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799351 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 15:55:00.802796 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799355 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 15:55:00.802796 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799359 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 15:55:00.802796 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799362 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 15:55:00.802796 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799364 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 15:55:00.802796 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799367 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 15:55:00.802796 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799370 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 15:55:00.802796 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799372 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 15:55:00.802796 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799375 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 15:55:00.802796 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799377 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 15:55:00.802796 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799379 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 15:55:00.802796 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799384 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 15:55:00.802796 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799386 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 15:55:00.802796 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799389 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 15:55:00.802796 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799391 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 15:55:00.802796 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799394 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 15:55:00.802796 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799397 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 15:55:00.803197 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.799402 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 15:55:00.803197 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799522 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 15:55:00.803197 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799527 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 15:55:00.803197 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799530 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 15:55:00.803197 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799533 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 15:55:00.803197 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799536 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 15:55:00.803197 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799539 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 15:55:00.803197 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799542 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 15:55:00.803197 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799554 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 15:55:00.803197 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799558 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 15:55:00.803197 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799561 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 15:55:00.803197 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799582 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 15:55:00.803197 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799587 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 15:55:00.803197 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799591 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 15:55:00.803197 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799594 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 15:55:00.803562 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799596 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 15:55:00.803562 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799599 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 15:55:00.803562 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799602 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 15:55:00.803562 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799604 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 15:55:00.803562 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799606 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 15:55:00.803562 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799609 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 15:55:00.803562 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799611 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 15:55:00.803562 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799614 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 15:55:00.803562 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799616 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 15:55:00.803562 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799619 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 15:55:00.803562 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799622 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 15:55:00.803562 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799624 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 15:55:00.803562 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799627 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 15:55:00.803562 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799630 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 15:55:00.803562 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799633 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 15:55:00.803562 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799635 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 15:55:00.803562 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799638 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 15:55:00.803562 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799640 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 15:55:00.803562 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799642 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 15:55:00.803562 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799645 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 15:55:00.804065 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799647 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 15:55:00.804065 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799650 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 15:55:00.804065 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799652 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 15:55:00.804065 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799655 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 15:55:00.804065 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799657 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 15:55:00.804065 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799659 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 15:55:00.804065 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799662 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 15:55:00.804065 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799664 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 15:55:00.804065 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799666 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 15:55:00.804065 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799669 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 15:55:00.804065 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799671 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 15:55:00.804065 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799674 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 15:55:00.804065 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799677 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 15:55:00.804065 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799679 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 15:55:00.804065 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799682 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 15:55:00.804065 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799684 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 15:55:00.804065 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799686 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 15:55:00.804065 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799689 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 15:55:00.804065 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799692 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 15:55:00.804065 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799694 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 15:55:00.804533 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799696 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 15:55:00.804533 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799699 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 15:55:00.804533 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799702 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 15:55:00.804533 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799704 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 15:55:00.804533 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799707 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 15:55:00.804533 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799710 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 15:55:00.804533 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799712 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 15:55:00.804533 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799716 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 15:55:00.804533 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799719 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 15:55:00.804533 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799722 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 15:55:00.804533 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799725 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 15:55:00.804533 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799728 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 15:55:00.804533 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799730 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 15:55:00.804533 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799733 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 15:55:00.804533 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799735 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 15:55:00.804533 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799738 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 10 15:55:00.804533 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799740 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 15:55:00.804533 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799743 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 15:55:00.804533 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799745 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 15:55:00.804989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799747 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 15:55:00.804989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799750 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 15:55:00.804989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799752 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 15:55:00.804989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799754 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 15:55:00.804989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799757 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 15:55:00.804989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799760 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 15:55:00.804989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799762 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 15:55:00.804989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799764 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 15:55:00.804989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799767 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 15:55:00.804989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799769 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 15:55:00.804989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799771 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 15:55:00.804989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799774 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 15:55:00.804989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799776 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 15:55:00.804989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799779 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 15:55:00.804989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799781 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 15:55:00.804989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799783 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 15:55:00.804989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799786 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 15:55:00.804989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799789 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 15:55:00.804989 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799791 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 15:55:00.805445 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799794 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 15:55:00.805445 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799798 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 15:55:00.805445 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799801 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 15:55:00.805445 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799803 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 15:55:00.805445 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799806 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 15:55:00.805445 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799809 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 15:55:00.805445 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:00.799812 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 15:55:00.805445 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.799817 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 15:55:00.805445 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.799951 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jul 10 15:55:00.805445 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.802120 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 10 15:55:00.805445 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.803323 2562 server.go:1019] "Starting client certificate rotation" Jul 10 15:55:00.805445 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.803423 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 15:55:00.805445 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.803461 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 15:55:00.805781 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.805444 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 15:55:00.807431 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.807414 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 15:55:00.815682 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.815667 2562 log.go:25] "Validated CRI v1 runtime API" Jul 10 15:55:00.817812 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.817794 2562 log.go:25] "Validated CRI v1 image API" Jul 10 15:55:00.819237 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.819219 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 10 15:55:00.821350 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.821325 2562 fs.go:135] Filesystem UUIDs: map[6235632f-e0c1-4051-afa2-ff0cae6fedbc:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f420d023-1fab-4257-8e53-c8c67f125468:/dev/nvme0n1p4] Jul 10 15:55:00.821406 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.821349 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 10 15:55:00.825982 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.825861 2562 manager.go:216] Machine: {Timestamp:2026-07-10 15:55:00.825359708 +0000 UTC m=+0.257844713 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100426 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20885eb784191fbd10dbaa9ed74906 SystemUUID:ec20885e-b784-191f-bd10-dbaa9ed74906 BootID:22d33e70-aac3-46a7-949e-5188781c7c3f Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:55:61:ed:b6:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:55:61:ed:b6:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:34:f8:09:56:ec Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 10 15:55:00.825982 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.825971 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 10 15:55:00.826115 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.826103 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 10 15:55:00.828909 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.828882 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 10 15:55:00.829052 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.828911 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-164.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 10 15:55:00.829582 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.829560 2562 topology_manager.go:138] "Creating topology manager with none policy" Jul 10 15:55:00.829617 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.829587 2562 container_manager_linux.go:309] "Creating device plugin manager" Jul 10 15:55:00.829617 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.829595 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 15:55:00.830238 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.830227 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 15:55:00.831554 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.831536 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 10 15:55:00.835760 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.835746 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 10 15:55:00.835887 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.835877 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 10 15:55:00.836426 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.836416 2562 kubelet.go:486] "Attempting to sync node with API server" Jul 10 15:55:00.836463 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.836432 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 10 15:55:00.836463 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.836450 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 10 15:55:00.836463 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.836459 2562 kubelet.go:398] "Adding apiserver pod source" Jul 10 15:55:00.836615 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.836471 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 10 15:55:00.837559 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.837535 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 15:55:00.837678 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.837587 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 15:55:00.840165 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.840144 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 10 15:55:00.842019 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.842005 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 10 15:55:00.842089 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.842037 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 10 15:55:00.842212 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.842194 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 10 15:55:00.842212 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.842215 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 10 15:55:00.842322 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.842223 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 10 15:55:00.842322 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.842232 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 10 15:55:00.842322 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.842243 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 10 15:55:00.842322 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.842248 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 10 15:55:00.842650 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.842638 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 10 15:55:00.842650 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.842649 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 10 15:55:00.842722 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.842657 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 10 15:55:00.842722 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.842663 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 10 15:55:00.842722 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.842671 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 10 15:55:00.842722 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.842679 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 10 15:55:00.843848 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.843837 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 10 15:55:00.843848 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.843847 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 10 15:55:00.847273 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.847250 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-164.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 10 15:55:00.847368 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.847342 2562 server.go:1268] "Started kubelet" Jul 10 15:55:00.847439 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:00.847415 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 10 15:55:00.847537 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.847495 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 10 15:55:00.847625 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.847582 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 10 15:55:00.847708 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.847612 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 10 15:55:00.847708 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:00.847519 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-164.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 10 15:55:00.848446 ip-10-0-136-164 systemd[1]: Started Kubernetes Kubelet. Jul 10 15:55:00.849031 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.848935 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 10 15:55:00.849663 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.849648 2562 server.go:310] "Adding debug handlers to kubelet server" Jul 10 15:55:00.852875 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.852854 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 15:55:00.852945 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:00.852871 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 10 15:55:00.854243 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.854225 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 10 15:55:00.854325 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.854293 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 10 15:55:00.854388 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:00.854365 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-164.ec2.internal\" not found" Jul 10 15:55:00.856605 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.854832 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 10 15:55:00.856605 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.855730 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 10 15:55:00.856756 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.856620 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 10 15:55:00.857291 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.857273 2562 reconstruct.go:97] "Volume reconstruction finished" Jul 10 15:55:00.857368 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.857301 2562 reconciler.go:29] "Reconciler: start to sync state" Jul 10 15:55:00.857413 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:00.856613 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-164.ec2.internal.18c0f8b32b424a0d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-164.ec2.internal,UID:ip-10-0-136-164.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-164.ec2.internal,},FirstTimestamp:2026-07-10 15:55:00.847315469 +0000 UTC m=+0.279800459,LastTimestamp:2026-07-10 15:55:00.847315469 +0000 UTC m=+0.279800459,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-164.ec2.internal,}" Jul 10 15:55:00.857795 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.857780 2562 factory.go:55] Registering systemd factory Jul 10 15:55:00.857849 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.857812 2562 factory.go:223] Registration of the systemd container factory successfully Jul 10 15:55:00.858080 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.858064 2562 factory.go:153] Registering CRI-O factory Jul 10 15:55:00.858118 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.858088 2562 factory.go:223] Registration of the crio container factory successfully Jul 10 15:55:00.858165 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.858154 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 10 15:55:00.858197 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.858181 2562 factory.go:103] Registering Raw factory Jul 10 15:55:00.858242 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.858197 2562 manager.go:1196] Started watching for new ooms in manager Jul 10 15:55:00.858613 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.858601 2562 manager.go:349] Starting recovery of all containers Jul 10 15:55:00.860753 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:00.860727 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 10 15:55:00.861004 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:00.860983 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-164.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 10 15:55:00.870833 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.870809 2562 manager.go:354] Recovery completed Jul 10 15:55:00.872264 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:00.872237 2562 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 10 15:55:00.875144 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.875133 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 15:55:00.877408 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.877388 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-164.ec2.internal" event="NodeHasSufficientMemory" Jul 10 15:55:00.877490 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.877426 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-164.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 15:55:00.877490 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.877437 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-164.ec2.internal" event="NodeHasSufficientPID" Jul 10 15:55:00.878055 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.878040 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 10 15:55:00.878055 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.878049 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 15:55:00.878055 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.878053 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 10 15:55:00.878217 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.878072 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 10 15:55:00.878706 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.878693 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-164.ec2.internal" event="NodeHasSufficientMemory" Jul 10 15:55:00.878780 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.878718 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-164.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 15:55:00.878780 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.878728 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-164.ec2.internal" event="NodeHasSufficientPID" Jul 10 15:55:00.879858 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:00.879791 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-164.ec2.internal.18c0f8b32d0d7979 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-164.ec2.internal,UID:ip-10-0-136-164.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-164.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-164.ec2.internal,},FirstTimestamp:2026-07-10 15:55:00.877408633 +0000 UTC m=+0.309893622,LastTimestamp:2026-07-10 15:55:00.877408633 +0000 UTC m=+0.309893622,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-164.ec2.internal,}" Jul 10 15:55:00.880290 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.880274 2562 policy_none.go:49] "None policy: Start" Jul 10 15:55:00.880290 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.880292 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 10 15:55:00.880379 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.880302 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 10 15:55:00.882253 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.882241 2562 policy_none.go:47] "Start" Jul 10 15:55:00.891688 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:00.891612 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-164.ec2.internal.18c0f8b32d0dd228 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-164.ec2.internal,UID:ip-10-0-136-164.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-164.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-164.ec2.internal,},FirstTimestamp:2026-07-10 15:55:00.877431336 +0000 UTC m=+0.309916324,LastTimestamp:2026-07-10 15:55:00.877431336 +0000 UTC m=+0.309916324,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-164.ec2.internal,}" Jul 10 15:55:00.904288 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:00.904220 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-164.ec2.internal.18c0f8b32d0df6ca default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-164.ec2.internal,UID:ip-10-0-136-164.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-164.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-164.ec2.internal,},FirstTimestamp:2026-07-10 15:55:00.877440714 +0000 UTC m=+0.309925698,LastTimestamp:2026-07-10 15:55:00.877440714 +0000 UTC m=+0.309925698,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-164.ec2.internal,}" Jul 10 15:55:00.910283 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.910262 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kp55w" Jul 10 15:55:00.917258 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.917244 2562 manager.go:337] "Starting Device Plugin manager" Jul 10 15:55:00.917325 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:00.917279 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 10 15:55:00.917325 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.917288 2562 server.go:87] "Starting device plugin registration server" Jul 10 15:55:00.917584 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.917555 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 10 15:55:00.917695 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.917589 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 10 15:55:00.917764 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.917701 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 10 15:55:00.918272 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.918246 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 10 15:55:00.918272 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.918259 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 10 15:55:00.918703 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:00.918681 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 10 15:55:00.918808 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.918703 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kp55w" Jul 10 15:55:00.918808 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:00.918743 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-164.ec2.internal\" not found" Jul 10 15:55:00.920317 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:00.920238 2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-164.ec2.internal.18c0f8b32d0d7979\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-164.ec2.internal.18c0f8b32d0d7979 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-164.ec2.internal,UID:ip-10-0-136-164.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-164.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-164.ec2.internal,},FirstTimestamp:2026-07-10 15:55:00.877408633 +0000 UTC m=+0.309893622,LastTimestamp:2026-07-10 15:55:00.878704675 +0000 UTC m=+0.311189660,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-164.ec2.internal,}" Jul 10 15:55:00.981122 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.981087 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 10 15:55:00.983245 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.982510 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 10 15:55:00.983245 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.982551 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 10 15:55:00.983245 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.982593 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jul 10 15:55:00.983245 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:00.982705 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 10 15:55:00.985398 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:00.985377 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 15:55:01.017779 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.017743 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 15:55:01.018720 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.018703 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-164.ec2.internal" event="NodeHasSufficientMemory" Jul 10 15:55:01.018807 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.018732 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-164.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 15:55:01.018807 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.018774 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-164.ec2.internal" event="NodeHasSufficientPID" Jul 10 15:55:01.018807 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.018806 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-164.ec2.internal" Jul 10 15:55:01.029110 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.029056 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-164.ec2.internal" Jul 10 15:55:01.029110 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:01.029082 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-164.ec2.internal\": node \"ip-10-0-136-164.ec2.internal\" not found" Jul 10 15:55:01.082950 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.082907 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-164.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-164.ec2.internal"] Jul 10 15:55:01.083084 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.082989 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 15:55:01.084003 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.083984 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-164.ec2.internal" event="NodeHasSufficientMemory" Jul 10 15:55:01.084108 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.084021 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-164.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 15:55:01.084108 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.084037 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-164.ec2.internal" event="NodeHasSufficientPID" Jul 10 15:55:01.086329 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.086313 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 15:55:01.086449 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.086434 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-164.ec2.internal" Jul 10 15:55:01.086495 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.086466 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 15:55:01.087105 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.087088 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-164.ec2.internal" event="NodeHasSufficientMemory" Jul 10 15:55:01.087217 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.087119 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-164.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 15:55:01.087217 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.087129 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-164.ec2.internal" event="NodeHasSufficientPID" Jul 10 15:55:01.087217 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.087088 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-164.ec2.internal" event="NodeHasSufficientMemory" Jul 10 15:55:01.087217 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.087202 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-164.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 15:55:01.087217 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.087218 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-164.ec2.internal" event="NodeHasSufficientPID" Jul 10 15:55:01.089418 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.089399 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-164.ec2.internal" Jul 10 15:55:01.089480 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.089439 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 15:55:01.090628 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.090611 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-164.ec2.internal" event="NodeHasSufficientMemory" Jul 10 15:55:01.090708 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.090645 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-164.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 15:55:01.090708 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.090659 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-164.ec2.internal" event="NodeHasSufficientPID" Jul 10 15:55:01.102199 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:01.102177 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-164.ec2.internal\" not found" Jul 10 15:55:01.115446 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:01.115415 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-164.ec2.internal\" not found" node="ip-10-0-136-164.ec2.internal" Jul 10 15:55:01.119918 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:01.119895 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-164.ec2.internal\" not found" node="ip-10-0-136-164.ec2.internal" Jul 10 15:55:01.158845 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.158808 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bf7065f98e0473976e9b61c34610e8e3-config\") pod \"kube-apiserver-proxy-ip-10-0-136-164.ec2.internal\" (UID: \"bf7065f98e0473976e9b61c34610e8e3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-164.ec2.internal" Jul 10 15:55:01.158845 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.158842 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1c56d5a6298310aad20712b064e11d42-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-164.ec2.internal\" (UID: \"1c56d5a6298310aad20712b064e11d42\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-164.ec2.internal" Jul 10 15:55:01.159033 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.158863 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c56d5a6298310aad20712b064e11d42-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-164.ec2.internal\" (UID: \"1c56d5a6298310aad20712b064e11d42\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-164.ec2.internal" Jul 10 15:55:01.202863 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:01.202836 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-164.ec2.internal\" not found" Jul 10 15:55:01.259443 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.259416 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bf7065f98e0473976e9b61c34610e8e3-config\") pod \"kube-apiserver-proxy-ip-10-0-136-164.ec2.internal\" (UID: \"bf7065f98e0473976e9b61c34610e8e3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-164.ec2.internal" Jul 10 15:55:01.259523 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.259446 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1c56d5a6298310aad20712b064e11d42-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-164.ec2.internal\" (UID: \"1c56d5a6298310aad20712b064e11d42\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-164.ec2.internal" Jul 10 15:55:01.259523 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.259467 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c56d5a6298310aad20712b064e11d42-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-164.ec2.internal\" (UID: \"1c56d5a6298310aad20712b064e11d42\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-164.ec2.internal" Jul 10 15:55:01.259523 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.259514 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1c56d5a6298310aad20712b064e11d42-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-164.ec2.internal\" (UID: \"1c56d5a6298310aad20712b064e11d42\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-164.ec2.internal" Jul 10 15:55:01.259658 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.259525 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bf7065f98e0473976e9b61c34610e8e3-config\") pod \"kube-apiserver-proxy-ip-10-0-136-164.ec2.internal\" (UID: \"bf7065f98e0473976e9b61c34610e8e3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-164.ec2.internal" Jul 10 15:55:01.259658 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.259593 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c56d5a6298310aad20712b064e11d42-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-164.ec2.internal\" (UID: \"1c56d5a6298310aad20712b064e11d42\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-164.ec2.internal" Jul 10 15:55:01.303657 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:01.303593 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-164.ec2.internal\" not found" Jul 10 15:55:01.404560 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:01.404520 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-164.ec2.internal\" not found" Jul 10 15:55:01.417749 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.417722 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-164.ec2.internal" Jul 10 15:55:01.422616 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.422594 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-164.ec2.internal" Jul 10 15:55:01.504943 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:01.504902 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-164.ec2.internal\" not found" Jul 10 15:55:01.605663 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:01.605559 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-164.ec2.internal\" not found" Jul 10 15:55:01.706225 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:01.706191 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-164.ec2.internal\" not found" Jul 10 15:55:01.786046 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.786019 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 15:55:01.802806 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.802774 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 10 15:55:01.802942 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.802922 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 15:55:01.802978 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.802934 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 15:55:01.807000 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:01.806976 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-164.ec2.internal\" not found" Jul 10 15:55:01.857154 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.857080 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 15:55:01.923345 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.923296 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 15:50:00 +0000 UTC" deadline="2028-02-09 14:15:37.771256693 +0000 UTC" Jul 10 15:55:01.923345 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.923333 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13894h20m35.847925853s" Jul 10 15:55:01.954408 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.954380 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-164.ec2.internal" Jul 10 15:55:01.969588 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.969547 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 15:55:01.970917 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.970899 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-164.ec2.internal" Jul 10 15:55:01.979814 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:01.979788 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 15:55:02.070451 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.070415 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 15:55:02.139778 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:02.139531 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c56d5a6298310aad20712b064e11d42.slice/crio-5261c54d477b25ad11be5d67e62056b137f6d33ec2833569492265007e17afa2 WatchSource:0}: Error finding container 5261c54d477b25ad11be5d67e62056b137f6d33ec2833569492265007e17afa2: Status 404 returned error can't find the container with id 5261c54d477b25ad11be5d67e62056b137f6d33ec2833569492265007e17afa2 Jul 10 15:55:02.143694 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.143677 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 15:55:02.173208 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:02.173178 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf7065f98e0473976e9b61c34610e8e3.slice/crio-324dee9dc0275a311f36a5836479560892fc1973d7b603665d1d0f4f7b7d16e1 WatchSource:0}: Error finding container 324dee9dc0275a311f36a5836479560892fc1973d7b603665d1d0f4f7b7d16e1: Status 404 returned error can't find the container with id 324dee9dc0275a311f36a5836479560892fc1973d7b603665d1d0f4f7b7d16e1 Jul 10 15:55:02.838866 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.838830 2562 apiserver.go:52] "Watching apiserver" Jul 10 15:55:02.846183 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.846155 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 10 15:55:02.848597 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.848336 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-w9r4g","openshift-cluster-node-tuning-operator/tuned-8zp7m","openshift-image-registry/node-ca-m94m9","openshift-multus/multus-5pg5m","openshift-multus/multus-additional-cni-plugins-jdrgl","openshift-network-diagnostics/network-check-target-cmq2z","openshift-network-operator/iptables-alerter-trngf","kube-system/kube-apiserver-proxy-ip-10-0-136-164.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb54","openshift-dns/node-resolver-9j2fq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-164.ec2.internal","openshift-multus/network-metrics-daemon-b9hg4","openshift-ovn-kubernetes/ovnkube-node-4p9m2","kube-system/global-pull-secret-syncer-rw8tw"] Jul 10 15:55:02.851422 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.850814 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.852838 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.852819 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:02.852945 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:02.852906 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9hg4" podUID="30cc000d-f3a7-453b-a542-d3f9af19fefb" Jul 10 15:55:02.853901 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.853880 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 10 15:55:02.855967 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.854118 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zkn26\"" Jul 10 15:55:02.855967 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.854306 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 10 15:55:02.855967 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.854666 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 10 15:55:02.855967 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.854850 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 10 15:55:02.855967 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.855005 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 10 15:55:02.855967 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.855713 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w9r4g" Jul 10 15:55:02.859706 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.859683 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-trngf" Jul 10 15:55:02.860179 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.859887 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7b92z\"" Jul 10 15:55:02.861309 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.860545 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jdrgl" Jul 10 15:55:02.861638 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.861558 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 10 15:55:02.862452 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.862122 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:55:02.862452 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:02.862186 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmq2z" podUID="a7af48f4-6437-4c48-b20f-731923004f10" Jul 10 15:55:02.863188 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.863168 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 10 15:55:02.863352 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.863339 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 10 15:55:02.863411 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.863397 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kk29t\"" Jul 10 15:55:02.863768 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.863555 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 10 15:55:02.864413 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.863722 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 10 15:55:02.864953 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.863723 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 10 15:55:02.865044 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.864681 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 10 15:55:02.865110 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.864839 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m94m9" Jul 10 15:55:02.865205 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.865188 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-f66gp\"" Jul 10 15:55:02.866629 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.866607 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c49cw\" (UniqueName: \"kubernetes.io/projected/9a85fded-c683-4463-b8ad-d09429d9eaf5-kube-api-access-c49cw\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.866708 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.866651 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4d9f312-84ef-48eb-be54-c55e7601fa50-host-slash\") pod \"iptables-alerter-trngf\" (UID: \"d4d9f312-84ef-48eb-be54-c55e7601fa50\") " pod="openshift-network-operator/iptables-alerter-trngf" Jul 10 15:55:02.866708 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.866672 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-multus-cni-dir\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.866708 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.866693 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-host-var-lib-kubelet\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.866797 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.866716 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67fd65fd-74e1-4c36-914a-b93627e423a7-cnibin\") pod \"multus-additional-cni-plugins-jdrgl\" (UID: \"67fd65fd-74e1-4c36-914a-b93627e423a7\") " pod="openshift-multus/multus-additional-cni-plugins-jdrgl" Jul 10 15:55:02.866797 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.866730 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67fd65fd-74e1-4c36-914a-b93627e423a7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jdrgl\" (UID: \"67fd65fd-74e1-4c36-914a-b93627e423a7\") " pod="openshift-multus/multus-additional-cni-plugins-jdrgl" Jul 10 15:55:02.866797 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.866745 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a85fded-c683-4463-b8ad-d09429d9eaf5-cni-binary-copy\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.866797 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.866761 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-host-var-lib-cni-bin\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.866797 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.866778 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67fd65fd-74e1-4c36-914a-b93627e423a7-system-cni-dir\") pod \"multus-additional-cni-plugins-jdrgl\" (UID: \"67fd65fd-74e1-4c36-914a-b93627e423a7\") " pod="openshift-multus/multus-additional-cni-plugins-jdrgl" Jul 10 15:55:02.866797 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.866791 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/67fd65fd-74e1-4c36-914a-b93627e423a7-os-release\") pod \"multus-additional-cni-plugins-jdrgl\" (UID: \"67fd65fd-74e1-4c36-914a-b93627e423a7\") " pod="openshift-multus/multus-additional-cni-plugins-jdrgl" Jul 10 15:55:02.866944 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.866804 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/67fd65fd-74e1-4c36-914a-b93627e423a7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jdrgl\" (UID: \"67fd65fd-74e1-4c36-914a-b93627e423a7\") " pod="openshift-multus/multus-additional-cni-plugins-jdrgl" Jul 10 15:55:02.866944 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.866817 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fl24\" (UniqueName: \"kubernetes.io/projected/30cc000d-f3a7-453b-a542-d3f9af19fefb-kube-api-access-2fl24\") pod \"network-metrics-daemon-b9hg4\" (UID: \"30cc000d-f3a7-453b-a542-d3f9af19fefb\") " pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:02.866944 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.866830 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/67fd65fd-74e1-4c36-914a-b93627e423a7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jdrgl\" (UID: \"67fd65fd-74e1-4c36-914a-b93627e423a7\") " pod="openshift-multus/multus-additional-cni-plugins-jdrgl" Jul 10 15:55:02.866944 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.866844 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btwpt\" (UniqueName: \"kubernetes.io/projected/a7af48f4-6437-4c48-b20f-731923004f10-kube-api-access-btwpt\") pod \"network-check-target-cmq2z\" (UID: \"a7af48f4-6437-4c48-b20f-731923004f10\") " pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:55:02.866944 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.866858 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-cnibin\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.866944 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.866869 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-os-release\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.866944 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.866882 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-multus-socket-dir-parent\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.866944 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.866900 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-hostroot\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.866944 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.866923 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-host-run-multus-certs\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.866944 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.866944 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b0c331ff-5e5f-46f2-af72-86afa6e6c6c4-konnectivity-ca\") pod \"konnectivity-agent-w9r4g\" (UID: \"b0c331ff-5e5f-46f2-af72-86afa6e6c6c4\") " pod="kube-system/konnectivity-agent-w9r4g" Jul 10 15:55:02.867190 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.866965 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg2lv\" (UniqueName: \"kubernetes.io/projected/67fd65fd-74e1-4c36-914a-b93627e423a7-kube-api-access-dg2lv\") pod \"multus-additional-cni-plugins-jdrgl\" (UID: \"67fd65fd-74e1-4c36-914a-b93627e423a7\") " pod="openshift-multus/multus-additional-cni-plugins-jdrgl" Jul 10 15:55:02.867190 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.866992 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-system-cni-dir\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.867190 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.867012 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-host-run-k8s-cni-cncf-io\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.867190 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.867032 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-host-run-netns\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.867190 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.867053 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-etc-kubernetes\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.867190 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.867075 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b0c331ff-5e5f-46f2-af72-86afa6e6c6c4-agent-certs\") pod \"konnectivity-agent-w9r4g\" (UID: \"b0c331ff-5e5f-46f2-af72-86afa6e6c6c4\") " pod="kube-system/konnectivity-agent-w9r4g" Jul 10 15:55:02.867190 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.867095 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4d9f312-84ef-48eb-be54-c55e7601fa50-iptables-alerter-script\") pod \"iptables-alerter-trngf\" (UID: \"d4d9f312-84ef-48eb-be54-c55e7601fa50\") " pod="openshift-network-operator/iptables-alerter-trngf" Jul 10 15:55:02.867190 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.867108 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-host-var-lib-cni-multus\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.867190 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.867127 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-multus-conf-dir\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.867190 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.867143 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30cc000d-f3a7-453b-a542-d3f9af19fefb-metrics-certs\") pod \"network-metrics-daemon-b9hg4\" (UID: \"30cc000d-f3a7-453b-a542-d3f9af19fefb\") " pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:02.867190 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.867157 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g85z\" (UniqueName: \"kubernetes.io/projected/d4d9f312-84ef-48eb-be54-c55e7601fa50-kube-api-access-8g85z\") pod \"iptables-alerter-trngf\" (UID: \"d4d9f312-84ef-48eb-be54-c55e7601fa50\") " pod="openshift-network-operator/iptables-alerter-trngf" Jul 10 15:55:02.867190 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.867170 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/67fd65fd-74e1-4c36-914a-b93627e423a7-cni-binary-copy\") pod \"multus-additional-cni-plugins-jdrgl\" (UID: \"67fd65fd-74e1-4c36-914a-b93627e423a7\") " pod="openshift-multus/multus-additional-cni-plugins-jdrgl" Jul 10 15:55:02.867190 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.867187 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9a85fded-c683-4463-b8ad-d09429d9eaf5-multus-daemon-config\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.867751 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.867734 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fg4m9\"" Jul 10 15:55:02.868052 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.868011 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 10 15:55:02.868220 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.868203 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 15:55:02.868378 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.868363 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 10 15:55:02.868689 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.868671 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 10 15:55:02.868689 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.868682 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb54" Jul 10 15:55:02.870219 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.870201 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9j2fq" Jul 10 15:55:02.871250 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.871231 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wwtq4\"" Jul 10 15:55:02.871355 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.871255 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 10 15:55:02.871449 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.871410 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 10 15:55:02.871530 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.871446 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 10 15:55:02.872602 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.872583 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:02.873938 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.873915 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 10 15:55:02.874144 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.874132 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jz8n7\"" Jul 10 15:55:02.874336 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.874321 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 10 15:55:02.874736 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.874718 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-g52mv\"" Jul 10 15:55:02.874879 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.874863 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 10 15:55:02.875082 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.875063 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 10 15:55:02.876124 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.876107 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:02.878385 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.878333 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:02.878464 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:02.878443 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw8tw" podUID="6bfcca1c-4216-4bff-afc4-751789a422f1" Jul 10 15:55:02.878581 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.878544 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 10 15:55:02.879368 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.879343 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 10 15:55:02.879438 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.879399 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 10 15:55:02.880076 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.879617 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 10 15:55:02.880076 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.879813 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7bhng\"" Jul 10 15:55:02.880076 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.879899 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 10 15:55:02.880076 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.880013 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 10 15:55:02.889164 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.889139 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dmmbn" Jul 10 15:55:02.897248 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.897227 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dmmbn" Jul 10 15:55:02.961219 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.958471 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 10 15:55:02.967972 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.967941 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67fd65fd-74e1-4c36-914a-b93627e423a7-system-cni-dir\") pod \"multus-additional-cni-plugins-jdrgl\" (UID: \"67fd65fd-74e1-4c36-914a-b93627e423a7\") " pod="openshift-multus/multus-additional-cni-plugins-jdrgl" Jul 10 15:55:02.967972 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.967977 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/67fd65fd-74e1-4c36-914a-b93627e423a7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jdrgl\" (UID: \"67fd65fd-74e1-4c36-914a-b93627e423a7\") " pod="openshift-multus/multus-additional-cni-plugins-jdrgl" Jul 10 15:55:02.968184 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.967995 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fl24\" (UniqueName: \"kubernetes.io/projected/30cc000d-f3a7-453b-a542-d3f9af19fefb-kube-api-access-2fl24\") pod \"network-metrics-daemon-b9hg4\" (UID: \"30cc000d-f3a7-453b-a542-d3f9af19fefb\") " pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:02.968184 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968013 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-host-kubelet\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:02.968184 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968034 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-var-lib-openvswitch\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:02.968316 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968228 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67fd65fd-74e1-4c36-914a-b93627e423a7-system-cni-dir\") pod \"multus-additional-cni-plugins-jdrgl\" (UID: \"67fd65fd-74e1-4c36-914a-b93627e423a7\") " pod="openshift-multus/multus-additional-cni-plugins-jdrgl" Jul 10 15:55:02.968316 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968257 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-hostroot\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.968316 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968275 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-host-run-multus-certs\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.968316 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968299 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-host-run-multus-certs\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.968316 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968314 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46hxq\" (UniqueName: \"kubernetes.io/projected/2bcb7a5c-1cb1-4c2e-aa53-fd5dad33c1ce-kube-api-access-46hxq\") pod \"node-ca-m94m9\" (UID: \"2bcb7a5c-1cb1-4c2e-aa53-fd5dad33c1ce\") " pod="openshift-image-registry/node-ca-m94m9" Jul 10 15:55:02.968544 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968312 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-hostroot\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.968544 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968328 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-log-socket\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:02.968544 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968342 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-host-cni-netd\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:02.968544 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968357 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9cf90275-c7ec-4b81-a4dd-f647e43768d7-env-overrides\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:02.968544 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968371 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69p6x\" (UniqueName: \"kubernetes.io/projected/bca0b58d-d869-49a0-a7cf-b2987366f814-kube-api-access-69p6x\") pod \"aws-ebs-csi-driver-node-snb54\" (UID: \"bca0b58d-d869-49a0-a7cf-b2987366f814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb54" Jul 10 15:55:02.968544 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968385 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b0c331ff-5e5f-46f2-af72-86afa6e6c6c4-konnectivity-ca\") pod \"konnectivity-agent-w9r4g\" (UID: \"b0c331ff-5e5f-46f2-af72-86afa6e6c6c4\") " pod="kube-system/konnectivity-agent-w9r4g" Jul 10 15:55:02.968544 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968400 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg2lv\" (UniqueName: \"kubernetes.io/projected/67fd65fd-74e1-4c36-914a-b93627e423a7-kube-api-access-dg2lv\") pod \"multus-additional-cni-plugins-jdrgl\" (UID: \"67fd65fd-74e1-4c36-914a-b93627e423a7\") " pod="openshift-multus/multus-additional-cni-plugins-jdrgl" Jul 10 15:55:02.968544 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968413 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-host-run-netns\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.968544 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968442 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-etc-kubernetes\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.968544 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968473 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-host-slash\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:02.968544 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968487 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-run-systemd\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:02.968544 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968501 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bca0b58d-d869-49a0-a7cf-b2987366f814-kubelet-dir\") pod \"aws-ebs-csi-driver-node-snb54\" (UID: \"bca0b58d-d869-49a0-a7cf-b2987366f814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb54" Jul 10 15:55:02.968544 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968522 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b0c331ff-5e5f-46f2-af72-86afa6e6c6c4-agent-certs\") pod \"konnectivity-agent-w9r4g\" (UID: \"b0c331ff-5e5f-46f2-af72-86afa6e6c6c4\") " pod="kube-system/konnectivity-agent-w9r4g" Jul 10 15:55:02.968544 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968544 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4d9f312-84ef-48eb-be54-c55e7601fa50-iptables-alerter-script\") pod \"iptables-alerter-trngf\" (UID: \"d4d9f312-84ef-48eb-be54-c55e7601fa50\") " pod="openshift-network-operator/iptables-alerter-trngf" Jul 10 15:55:02.969188 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968590 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-host-var-lib-cni-multus\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.969188 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968612 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-host-cni-bin\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:02.969188 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968634 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bca0b58d-d869-49a0-a7cf-b2987366f814-registration-dir\") pod \"aws-ebs-csi-driver-node-snb54\" (UID: \"bca0b58d-d869-49a0-a7cf-b2987366f814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb54" Jul 10 15:55:02.969188 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968652 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/67fd65fd-74e1-4c36-914a-b93627e423a7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jdrgl\" (UID: \"67fd65fd-74e1-4c36-914a-b93627e423a7\") " pod="openshift-multus/multus-additional-cni-plugins-jdrgl" Jul 10 15:55:02.969188 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968657 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bca0b58d-d869-49a0-a7cf-b2987366f814-device-dir\") pod \"aws-ebs-csi-driver-node-snb54\" (UID: \"bca0b58d-d869-49a0-a7cf-b2987366f814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb54" Jul 10 15:55:02.969188 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968444 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-host-run-netns\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.969188 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968731 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-etc-kubernetes\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.969188 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968770 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/992584b5-85e4-4c18-aef4-254269d9b483-tmp-dir\") pod \"node-resolver-9j2fq\" (UID: \"992584b5-85e4-4c18-aef4-254269d9b483\") " pod="openshift-dns/node-resolver-9j2fq" Jul 10 15:55:02.969188 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968801 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/67fd65fd-74e1-4c36-914a-b93627e423a7-cni-binary-copy\") pod \"multus-additional-cni-plugins-jdrgl\" (UID: \"67fd65fd-74e1-4c36-914a-b93627e423a7\") " pod="openshift-multus/multus-additional-cni-plugins-jdrgl" Jul 10 15:55:02.969188 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968823 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2bcb7a5c-1cb1-4c2e-aa53-fd5dad33c1ce-serviceca\") pod \"node-ca-m94m9\" (UID: \"2bcb7a5c-1cb1-4c2e-aa53-fd5dad33c1ce\") " pod="openshift-image-registry/node-ca-m94m9" Jul 10 15:55:02.969188 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968845 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9cf90275-c7ec-4b81-a4dd-f647e43768d7-ovnkube-script-lib\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:02.969188 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968900 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-host\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:02.969188 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968935 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b0c331ff-5e5f-46f2-af72-86afa6e6c6c4-konnectivity-ca\") pod \"konnectivity-agent-w9r4g\" (UID: \"b0c331ff-5e5f-46f2-af72-86afa6e6c6c4\") " pod="kube-system/konnectivity-agent-w9r4g" Jul 10 15:55:02.969188 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.968938 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c49cw\" (UniqueName: \"kubernetes.io/projected/9a85fded-c683-4463-b8ad-d09429d9eaf5-kube-api-access-c49cw\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.969188 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969084 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-systemd-units\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:02.969188 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969116 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-node-log\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:02.969188 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969137 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-etc-modprobe-d\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:02.970062 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969157 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-lib-modules\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:02.970062 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969159 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4d9f312-84ef-48eb-be54-c55e7601fa50-iptables-alerter-script\") pod \"iptables-alerter-trngf\" (UID: \"d4d9f312-84ef-48eb-be54-c55e7601fa50\") " pod="openshift-network-operator/iptables-alerter-trngf" Jul 10 15:55:02.970062 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969178 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjc2k\" (UniqueName: \"kubernetes.io/projected/2def3683-a723-4b57-9eeb-a9e86cd3d92b-kube-api-access-jjc2k\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:02.970062 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969207 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-run-ovn\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:02.970062 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969230 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bca0b58d-d869-49a0-a7cf-b2987366f814-socket-dir\") pod \"aws-ebs-csi-driver-node-snb54\" (UID: \"bca0b58d-d869-49a0-a7cf-b2987366f814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb54" Jul 10 15:55:02.970062 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969246 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-run\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:02.970062 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969296 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6bfcca1c-4216-4bff-afc4-751789a422f1-kubelet-config\") pod \"global-pull-secret-syncer-rw8tw\" (UID: \"6bfcca1c-4216-4bff-afc4-751789a422f1\") " pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:02.970062 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969325 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/67fd65fd-74e1-4c36-914a-b93627e423a7-os-release\") pod \"multus-additional-cni-plugins-jdrgl\" (UID: \"67fd65fd-74e1-4c36-914a-b93627e423a7\") " pod="openshift-multus/multus-additional-cni-plugins-jdrgl" Jul 10 15:55:02.970062 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969339 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2def3683-a723-4b57-9eeb-a9e86cd3d92b-tmp\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:02.970062 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969354 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/67fd65fd-74e1-4c36-914a-b93627e423a7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jdrgl\" (UID: \"67fd65fd-74e1-4c36-914a-b93627e423a7\") " pod="openshift-multus/multus-additional-cni-plugins-jdrgl" Jul 10 15:55:02.970062 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969375 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btwpt\" (UniqueName: \"kubernetes.io/projected/a7af48f4-6437-4c48-b20f-731923004f10-kube-api-access-btwpt\") pod \"network-check-target-cmq2z\" (UID: \"a7af48f4-6437-4c48-b20f-731923004f10\") " pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:55:02.970062 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969397 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-cnibin\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.970062 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969415 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-os-release\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.970062 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969429 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-multus-socket-dir-parent\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.970062 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969451 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-host-run-netns\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:02.970062 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969457 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 10 15:55:02.970062 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969472 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfmxp\" (UniqueName: \"kubernetes.io/projected/9cf90275-c7ec-4b81-a4dd-f647e43768d7-kube-api-access-xfmxp\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:02.970821 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969488 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcn8v\" (UniqueName: \"kubernetes.io/projected/992584b5-85e4-4c18-aef4-254269d9b483-kube-api-access-xcn8v\") pod \"node-resolver-9j2fq\" (UID: \"992584b5-85e4-4c18-aef4-254269d9b483\") " pod="openshift-dns/node-resolver-9j2fq" Jul 10 15:55:02.970821 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969502 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-system-cni-dir\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.970821 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969516 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-host-run-k8s-cni-cncf-io\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.970821 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969540 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-var-lib-kubelet\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:02.970821 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969558 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2def3683-a723-4b57-9eeb-a9e86cd3d92b-etc-tuned\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:02.970821 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969600 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-multus-conf-dir\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.970821 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969606 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/67fd65fd-74e1-4c36-914a-b93627e423a7-cni-binary-copy\") pod \"multus-additional-cni-plugins-jdrgl\" (UID: \"67fd65fd-74e1-4c36-914a-b93627e423a7\") " pod="openshift-multus/multus-additional-cni-plugins-jdrgl" Jul 10 15:55:02.970821 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969676 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30cc000d-f3a7-453b-a542-d3f9af19fefb-metrics-certs\") pod \"network-metrics-daemon-b9hg4\" (UID: \"30cc000d-f3a7-453b-a542-d3f9af19fefb\") " pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:02.970821 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969703 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-run-openvswitch\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:02.970821 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969727 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bca0b58d-d869-49a0-a7cf-b2987366f814-etc-selinux\") pod \"aws-ebs-csi-driver-node-snb54\" (UID: \"bca0b58d-d869-49a0-a7cf-b2987366f814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb54" Jul 10 15:55:02.970821 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969744 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-etc-sysconfig\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:02.970821 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969758 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-sys\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:02.970821 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969774 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g85z\" (UniqueName: \"kubernetes.io/projected/d4d9f312-84ef-48eb-be54-c55e7601fa50-kube-api-access-8g85z\") pod \"iptables-alerter-trngf\" (UID: \"d4d9f312-84ef-48eb-be54-c55e7601fa50\") " pod="openshift-network-operator/iptables-alerter-trngf" Jul 10 15:55:02.970821 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969789 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9a85fded-c683-4463-b8ad-d09429d9eaf5-multus-daemon-config\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.970821 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969803 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-etc-openvswitch\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:02.970821 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969831 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-multus-conf-dir\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.970821 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969850 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bca0b58d-d869-49a0-a7cf-b2987366f814-sys-fs\") pod \"aws-ebs-csi-driver-node-snb54\" (UID: \"bca0b58d-d869-49a0-a7cf-b2987366f814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb54" Jul 10 15:55:02.971538 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969866 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-etc-sysctl-d\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:02.971538 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969882 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-etc-sysctl-conf\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:02.971538 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969893 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-host-var-lib-cni-multus\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.971538 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969961 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/67fd65fd-74e1-4c36-914a-b93627e423a7-os-release\") pod \"multus-additional-cni-plugins-jdrgl\" (UID: \"67fd65fd-74e1-4c36-914a-b93627e423a7\") " pod="openshift-multus/multus-additional-cni-plugins-jdrgl" Jul 10 15:55:02.971538 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.969863 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-cnibin\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.971538 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.970117 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-os-release\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.971538 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.970142 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bfcca1c-4216-4bff-afc4-751789a422f1-original-pull-secret\") pod \"global-pull-secret-syncer-rw8tw\" (UID: \"6bfcca1c-4216-4bff-afc4-751789a422f1\") " pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:02.971538 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.970163 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-multus-socket-dir-parent\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.971538 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.970173 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9cf90275-c7ec-4b81-a4dd-f647e43768d7-ovn-node-metrics-cert\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:02.971538 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.970199 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/992584b5-85e4-4c18-aef4-254269d9b483-hosts-file\") pod \"node-resolver-9j2fq\" (UID: \"992584b5-85e4-4c18-aef4-254269d9b483\") " pod="openshift-dns/node-resolver-9j2fq" Jul 10 15:55:02.971538 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.970222 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-etc-kubernetes\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:02.971538 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.970245 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-etc-systemd\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:02.971538 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.970283 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6bfcca1c-4216-4bff-afc4-751789a422f1-dbus\") pod \"global-pull-secret-syncer-rw8tw\" (UID: \"6bfcca1c-4216-4bff-afc4-751789a422f1\") " pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:02.971538 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.970345 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4d9f312-84ef-48eb-be54-c55e7601fa50-host-slash\") pod \"iptables-alerter-trngf\" (UID: \"d4d9f312-84ef-48eb-be54-c55e7601fa50\") " pod="openshift-network-operator/iptables-alerter-trngf" Jul 10 15:55:02.971538 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.970369 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-multus-cni-dir\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.971538 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.970393 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-host-var-lib-kubelet\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.971538 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.970418 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2bcb7a5c-1cb1-4c2e-aa53-fd5dad33c1ce-host\") pod \"node-ca-m94m9\" (UID: \"2bcb7a5c-1cb1-4c2e-aa53-fd5dad33c1ce\") " pod="openshift-image-registry/node-ca-m94m9" Jul 10 15:55:02.972295 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.970443 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:02.972295 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.970468 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9cf90275-c7ec-4b81-a4dd-f647e43768d7-ovnkube-config\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:02.972295 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.970505 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67fd65fd-74e1-4c36-914a-b93627e423a7-cnibin\") pod \"multus-additional-cni-plugins-jdrgl\" (UID: \"67fd65fd-74e1-4c36-914a-b93627e423a7\") " pod="openshift-multus/multus-additional-cni-plugins-jdrgl" Jul 10 15:55:02.972295 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.970531 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67fd65fd-74e1-4c36-914a-b93627e423a7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jdrgl\" (UID: \"67fd65fd-74e1-4c36-914a-b93627e423a7\") " pod="openshift-multus/multus-additional-cni-plugins-jdrgl" Jul 10 15:55:02.972295 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.970554 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a85fded-c683-4463-b8ad-d09429d9eaf5-cni-binary-copy\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.972295 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.970601 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-host-var-lib-cni-bin\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.972295 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.970621 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/67fd65fd-74e1-4c36-914a-b93627e423a7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jdrgl\" (UID: \"67fd65fd-74e1-4c36-914a-b93627e423a7\") " pod="openshift-multus/multus-additional-cni-plugins-jdrgl" Jul 10 15:55:02.972295 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.970683 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-system-cni-dir\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.972295 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:02.970684 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 15:55:02.972295 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.970725 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-host-run-k8s-cni-cncf-io\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.972295 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.970600 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9a85fded-c683-4463-b8ad-d09429d9eaf5-multus-daemon-config\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.972295 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:02.970739 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30cc000d-f3a7-453b-a542-d3f9af19fefb-metrics-certs podName:30cc000d-f3a7-453b-a542-d3f9af19fefb nodeName:}" failed. No retries permitted until 2026-07-10 15:55:03.470725127 +0000 UTC m=+2.903210097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30cc000d-f3a7-453b-a542-d3f9af19fefb-metrics-certs") pod "network-metrics-daemon-b9hg4" (UID: "30cc000d-f3a7-453b-a542-d3f9af19fefb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 15:55:02.972295 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.970626 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-host-run-ovn-kubernetes\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:02.972295 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.970685 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4d9f312-84ef-48eb-be54-c55e7601fa50-host-slash\") pod \"iptables-alerter-trngf\" (UID: \"d4d9f312-84ef-48eb-be54-c55e7601fa50\") " pod="openshift-network-operator/iptables-alerter-trngf" Jul 10 15:55:02.972295 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.970791 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-multus-cni-dir\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.972295 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.970817 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67fd65fd-74e1-4c36-914a-b93627e423a7-cnibin\") pod \"multus-additional-cni-plugins-jdrgl\" (UID: \"67fd65fd-74e1-4c36-914a-b93627e423a7\") " pod="openshift-multus/multus-additional-cni-plugins-jdrgl" Jul 10 15:55:02.972295 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.970846 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-host-var-lib-kubelet\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.973068 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.970897 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a85fded-c683-4463-b8ad-d09429d9eaf5-host-var-lib-cni-bin\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.973068 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.970917 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67fd65fd-74e1-4c36-914a-b93627e423a7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jdrgl\" (UID: \"67fd65fd-74e1-4c36-914a-b93627e423a7\") " pod="openshift-multus/multus-additional-cni-plugins-jdrgl" Jul 10 15:55:02.973068 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.971467 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a85fded-c683-4463-b8ad-d09429d9eaf5-cni-binary-copy\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.973195 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.973097 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b0c331ff-5e5f-46f2-af72-86afa6e6c6c4-agent-certs\") pod \"konnectivity-agent-w9r4g\" (UID: \"b0c331ff-5e5f-46f2-af72-86afa6e6c6c4\") " pod="kube-system/konnectivity-agent-w9r4g" Jul 10 15:55:02.975334 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:02.974769 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 15:55:02.975334 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:02.974790 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 15:55:02.975334 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:02.974802 2562 projected.go:196] Error preparing data for projected volume kube-api-access-btwpt for pod openshift-network-diagnostics/network-check-target-cmq2z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 15:55:02.975334 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:02.974853 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7af48f4-6437-4c48-b20f-731923004f10-kube-api-access-btwpt podName:a7af48f4-6437-4c48-b20f-731923004f10 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:03.474836895 +0000 UTC m=+2.907321881 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-btwpt" (UniqueName: "kubernetes.io/projected/a7af48f4-6437-4c48-b20f-731923004f10-kube-api-access-btwpt") pod "network-check-target-cmq2z" (UID: "a7af48f4-6437-4c48-b20f-731923004f10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 15:55:02.976747 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.976724 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c49cw\" (UniqueName: \"kubernetes.io/projected/9a85fded-c683-4463-b8ad-d09429d9eaf5-kube-api-access-c49cw\") pod \"multus-5pg5m\" (UID: \"9a85fded-c683-4463-b8ad-d09429d9eaf5\") " pod="openshift-multus/multus-5pg5m" Jul 10 15:55:02.976925 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.976907 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fl24\" (UniqueName: \"kubernetes.io/projected/30cc000d-f3a7-453b-a542-d3f9af19fefb-kube-api-access-2fl24\") pod \"network-metrics-daemon-b9hg4\" (UID: \"30cc000d-f3a7-453b-a542-d3f9af19fefb\") " pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:02.978360 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.978127 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg2lv\" (UniqueName: \"kubernetes.io/projected/67fd65fd-74e1-4c36-914a-b93627e423a7-kube-api-access-dg2lv\") pod \"multus-additional-cni-plugins-jdrgl\" (UID: \"67fd65fd-74e1-4c36-914a-b93627e423a7\") " pod="openshift-multus/multus-additional-cni-plugins-jdrgl" Jul 10 15:55:02.980697 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.980672 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g85z\" (UniqueName: \"kubernetes.io/projected/d4d9f312-84ef-48eb-be54-c55e7601fa50-kube-api-access-8g85z\") pod \"iptables-alerter-trngf\" (UID: \"d4d9f312-84ef-48eb-be54-c55e7601fa50\") " pod="openshift-network-operator/iptables-alerter-trngf" Jul 10 15:55:02.989533 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.989469 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-164.ec2.internal" event={"ID":"bf7065f98e0473976e9b61c34610e8e3","Type":"ContainerStarted","Data":"324dee9dc0275a311f36a5836479560892fc1973d7b603665d1d0f4f7b7d16e1"} Jul 10 15:55:02.990813 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:02.990788 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-164.ec2.internal" event={"ID":"1c56d5a6298310aad20712b064e11d42","Type":"ContainerStarted","Data":"5261c54d477b25ad11be5d67e62056b137f6d33ec2833569492265007e17afa2"} Jul 10 15:55:03.071465 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.071429 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9cf90275-c7ec-4b81-a4dd-f647e43768d7-ovnkube-config\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.071668 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.071478 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-host-run-ovn-kubernetes\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.071668 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.071502 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-host-kubelet\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.071668 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.071520 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-var-lib-openvswitch\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.071668 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.071541 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46hxq\" (UniqueName: \"kubernetes.io/projected/2bcb7a5c-1cb1-4c2e-aa53-fd5dad33c1ce-kube-api-access-46hxq\") pod \"node-ca-m94m9\" (UID: \"2bcb7a5c-1cb1-4c2e-aa53-fd5dad33c1ce\") " pod="openshift-image-registry/node-ca-m94m9" Jul 10 15:55:03.071668 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.071563 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-log-socket\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.071668 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.071605 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-host-cni-netd\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.071668 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.071624 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9cf90275-c7ec-4b81-a4dd-f647e43768d7-env-overrides\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.071668 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.071647 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69p6x\" (UniqueName: \"kubernetes.io/projected/bca0b58d-d869-49a0-a7cf-b2987366f814-kube-api-access-69p6x\") pod \"aws-ebs-csi-driver-node-snb54\" (UID: \"bca0b58d-d869-49a0-a7cf-b2987366f814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb54" Jul 10 15:55:03.071668 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.071671 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-host-slash\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.072094 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.071692 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-run-systemd\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.072094 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.071715 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bca0b58d-d869-49a0-a7cf-b2987366f814-kubelet-dir\") pod \"aws-ebs-csi-driver-node-snb54\" (UID: \"bca0b58d-d869-49a0-a7cf-b2987366f814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb54" Jul 10 15:55:03.072094 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.071744 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-host-cni-bin\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.072094 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.071767 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bca0b58d-d869-49a0-a7cf-b2987366f814-registration-dir\") pod \"aws-ebs-csi-driver-node-snb54\" (UID: \"bca0b58d-d869-49a0-a7cf-b2987366f814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb54" Jul 10 15:55:03.072094 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.071790 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bca0b58d-d869-49a0-a7cf-b2987366f814-device-dir\") pod \"aws-ebs-csi-driver-node-snb54\" (UID: \"bca0b58d-d869-49a0-a7cf-b2987366f814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb54" Jul 10 15:55:03.072094 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.071813 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/992584b5-85e4-4c18-aef4-254269d9b483-tmp-dir\") pod \"node-resolver-9j2fq\" (UID: \"992584b5-85e4-4c18-aef4-254269d9b483\") " pod="openshift-dns/node-resolver-9j2fq" Jul 10 15:55:03.072094 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.071837 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2bcb7a5c-1cb1-4c2e-aa53-fd5dad33c1ce-serviceca\") pod \"node-ca-m94m9\" (UID: \"2bcb7a5c-1cb1-4c2e-aa53-fd5dad33c1ce\") " pod="openshift-image-registry/node-ca-m94m9" Jul 10 15:55:03.072094 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.071860 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9cf90275-c7ec-4b81-a4dd-f647e43768d7-ovnkube-script-lib\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.072094 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.071885 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-host\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:03.072094 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.071911 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-systemd-units\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.072094 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.071935 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-node-log\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.072094 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.071959 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-etc-modprobe-d\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:03.072094 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.071982 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-lib-modules\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:03.072094 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.072006 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjc2k\" (UniqueName: \"kubernetes.io/projected/2def3683-a723-4b57-9eeb-a9e86cd3d92b-kube-api-access-jjc2k\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:03.072094 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.072035 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-run-ovn\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.072094 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.072057 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bca0b58d-d869-49a0-a7cf-b2987366f814-socket-dir\") pod \"aws-ebs-csi-driver-node-snb54\" (UID: \"bca0b58d-d869-49a0-a7cf-b2987366f814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb54" Jul 10 15:55:03.072094 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.072079 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-run\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:03.072904 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.072102 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6bfcca1c-4216-4bff-afc4-751789a422f1-kubelet-config\") pod \"global-pull-secret-syncer-rw8tw\" (UID: \"6bfcca1c-4216-4bff-afc4-751789a422f1\") " pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:03.072904 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.072125 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2def3683-a723-4b57-9eeb-a9e86cd3d92b-tmp\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:03.072904 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.072169 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-host-run-netns\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.072904 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.072197 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfmxp\" (UniqueName: \"kubernetes.io/projected/9cf90275-c7ec-4b81-a4dd-f647e43768d7-kube-api-access-xfmxp\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.072904 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.072224 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcn8v\" (UniqueName: \"kubernetes.io/projected/992584b5-85e4-4c18-aef4-254269d9b483-kube-api-access-xcn8v\") pod \"node-resolver-9j2fq\" (UID: \"992584b5-85e4-4c18-aef4-254269d9b483\") " pod="openshift-dns/node-resolver-9j2fq" Jul 10 15:55:03.072904 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.072250 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-var-lib-kubelet\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:03.072904 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.072275 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2def3683-a723-4b57-9eeb-a9e86cd3d92b-etc-tuned\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:03.072904 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.072322 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-run-openvswitch\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.072904 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.072347 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bca0b58d-d869-49a0-a7cf-b2987366f814-etc-selinux\") pod \"aws-ebs-csi-driver-node-snb54\" (UID: \"bca0b58d-d869-49a0-a7cf-b2987366f814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb54" Jul 10 15:55:03.072904 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.072371 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-etc-sysconfig\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:03.072904 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.072395 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-sys\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:03.072904 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.072422 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-etc-openvswitch\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.072904 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.072458 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bca0b58d-d869-49a0-a7cf-b2987366f814-sys-fs\") pod \"aws-ebs-csi-driver-node-snb54\" (UID: \"bca0b58d-d869-49a0-a7cf-b2987366f814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb54" Jul 10 15:55:03.072904 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.072482 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-etc-sysctl-d\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:03.072904 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.072509 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-etc-sysctl-conf\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:03.072904 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.072534 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bfcca1c-4216-4bff-afc4-751789a422f1-original-pull-secret\") pod \"global-pull-secret-syncer-rw8tw\" (UID: \"6bfcca1c-4216-4bff-afc4-751789a422f1\") " pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:03.072904 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.072563 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9cf90275-c7ec-4b81-a4dd-f647e43768d7-ovn-node-metrics-cert\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.073650 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.072609 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/992584b5-85e4-4c18-aef4-254269d9b483-hosts-file\") pod \"node-resolver-9j2fq\" (UID: \"992584b5-85e4-4c18-aef4-254269d9b483\") " pod="openshift-dns/node-resolver-9j2fq" Jul 10 15:55:03.073650 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.072632 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-etc-kubernetes\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:03.073650 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.072656 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-etc-systemd\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:03.073650 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.072679 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6bfcca1c-4216-4bff-afc4-751789a422f1-dbus\") pod \"global-pull-secret-syncer-rw8tw\" (UID: \"6bfcca1c-4216-4bff-afc4-751789a422f1\") " pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:03.073650 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.072708 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2bcb7a5c-1cb1-4c2e-aa53-fd5dad33c1ce-host\") pod \"node-ca-m94m9\" (UID: \"2bcb7a5c-1cb1-4c2e-aa53-fd5dad33c1ce\") " pod="openshift-image-registry/node-ca-m94m9" Jul 10 15:55:03.073650 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.072734 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.073650 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.072831 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.073650 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.073380 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-run-ovn\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.073650 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.073414 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-host-run-ovn-kubernetes\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.073650 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.073427 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-host-cni-netd\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.073650 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.073422 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-host-cni-bin\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.073650 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.073450 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-sys\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:03.073650 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:03.073479 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 15:55:03.073650 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.073486 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-var-lib-openvswitch\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.073650 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.073496 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bca0b58d-d869-49a0-a7cf-b2987366f814-sys-fs\") pod \"aws-ebs-csi-driver-node-snb54\" (UID: \"bca0b58d-d869-49a0-a7cf-b2987366f814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb54" Jul 10 15:55:03.073650 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.073526 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-etc-openvswitch\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.073650 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:03.073538 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bfcca1c-4216-4bff-afc4-751789a422f1-original-pull-secret podName:6bfcca1c-4216-4bff-afc4-751789a422f1 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:03.57351991 +0000 UTC m=+3.006004885 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6bfcca1c-4216-4bff-afc4-751789a422f1-original-pull-secret") pod "global-pull-secret-syncer-rw8tw" (UID: "6bfcca1c-4216-4bff-afc4-751789a422f1") : object "kube-system"/"original-pull-secret" not registered Jul 10 15:55:03.074463 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.073557 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-host-kubelet\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.074463 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.073597 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-run\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:03.074463 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.073607 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bca0b58d-d869-49a0-a7cf-b2987366f814-registration-dir\") pod \"aws-ebs-csi-driver-node-snb54\" (UID: \"bca0b58d-d869-49a0-a7cf-b2987366f814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb54" Jul 10 15:55:03.074463 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.073644 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-etc-sysctl-d\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:03.074463 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.073655 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6bfcca1c-4216-4bff-afc4-751789a422f1-kubelet-config\") pod \"global-pull-secret-syncer-rw8tw\" (UID: \"6bfcca1c-4216-4bff-afc4-751789a422f1\") " pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:03.074463 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.073658 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bca0b58d-d869-49a0-a7cf-b2987366f814-device-dir\") pod \"aws-ebs-csi-driver-node-snb54\" (UID: \"bca0b58d-d869-49a0-a7cf-b2987366f814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb54" Jul 10 15:55:03.074463 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.073765 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-etc-sysctl-conf\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:03.074463 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.073851 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9cf90275-c7ec-4b81-a4dd-f647e43768d7-env-overrides\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.074463 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.073963 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/992584b5-85e4-4c18-aef4-254269d9b483-hosts-file\") pod \"node-resolver-9j2fq\" (UID: \"992584b5-85e4-4c18-aef4-254269d9b483\") " pod="openshift-dns/node-resolver-9j2fq" Jul 10 15:55:03.074463 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.074012 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-log-socket\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.074463 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.074060 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-etc-kubernetes\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:03.074463 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.074072 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/992584b5-85e4-4c18-aef4-254269d9b483-tmp-dir\") pod \"node-resolver-9j2fq\" (UID: \"992584b5-85e4-4c18-aef4-254269d9b483\") " pod="openshift-dns/node-resolver-9j2fq" Jul 10 15:55:03.074463 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.074102 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-etc-systemd\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:03.074463 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.074102 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9cf90275-c7ec-4b81-a4dd-f647e43768d7-ovnkube-config\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.074463 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.074123 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-host-slash\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.074463 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.074125 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2bcb7a5c-1cb1-4c2e-aa53-fd5dad33c1ce-serviceca\") pod \"node-ca-m94m9\" (UID: \"2bcb7a5c-1cb1-4c2e-aa53-fd5dad33c1ce\") " pod="openshift-image-registry/node-ca-m94m9" Jul 10 15:55:03.074463 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.074141 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-run-systemd\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.074463 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.074151 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6bfcca1c-4216-4bff-afc4-751789a422f1-dbus\") pod \"global-pull-secret-syncer-rw8tw\" (UID: \"6bfcca1c-4216-4bff-afc4-751789a422f1\") " pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:03.075498 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.074175 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-host\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:03.075498 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.074194 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-var-lib-kubelet\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:03.075498 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.074223 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-run-openvswitch\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.075498 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.074231 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2bcb7a5c-1cb1-4c2e-aa53-fd5dad33c1ce-host\") pod \"node-ca-m94m9\" (UID: \"2bcb7a5c-1cb1-4c2e-aa53-fd5dad33c1ce\") " pod="openshift-image-registry/node-ca-m94m9" Jul 10 15:55:03.075498 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.074254 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-lib-modules\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:03.075498 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.074257 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-etc-modprobe-d\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:03.075498 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.074283 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-node-log\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.075498 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.074287 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2def3683-a723-4b57-9eeb-a9e86cd3d92b-etc-sysconfig\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:03.075498 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.074301 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-systemd-units\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.075498 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.074336 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bca0b58d-d869-49a0-a7cf-b2987366f814-etc-selinux\") pod \"aws-ebs-csi-driver-node-snb54\" (UID: \"bca0b58d-d869-49a0-a7cf-b2987366f814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb54" Jul 10 15:55:03.075498 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.074176 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bca0b58d-d869-49a0-a7cf-b2987366f814-kubelet-dir\") pod \"aws-ebs-csi-driver-node-snb54\" (UID: \"bca0b58d-d869-49a0-a7cf-b2987366f814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb54" Jul 10 15:55:03.075498 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.073535 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bca0b58d-d869-49a0-a7cf-b2987366f814-socket-dir\") pod \"aws-ebs-csi-driver-node-snb54\" (UID: \"bca0b58d-d869-49a0-a7cf-b2987366f814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb54" Jul 10 15:55:03.075498 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.074449 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9cf90275-c7ec-4b81-a4dd-f647e43768d7-host-run-netns\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.075498 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.074809 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9cf90275-c7ec-4b81-a4dd-f647e43768d7-ovnkube-script-lib\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.076750 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.076721 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2def3683-a723-4b57-9eeb-a9e86cd3d92b-tmp\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:03.076867 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.076847 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9cf90275-c7ec-4b81-a4dd-f647e43768d7-ovn-node-metrics-cert\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.077073 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.077048 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2def3683-a723-4b57-9eeb-a9e86cd3d92b-etc-tuned\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:03.084671 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.084639 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46hxq\" (UniqueName: \"kubernetes.io/projected/2bcb7a5c-1cb1-4c2e-aa53-fd5dad33c1ce-kube-api-access-46hxq\") pod \"node-ca-m94m9\" (UID: \"2bcb7a5c-1cb1-4c2e-aa53-fd5dad33c1ce\") " pod="openshift-image-registry/node-ca-m94m9" Jul 10 15:55:03.090108 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.089981 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfmxp\" (UniqueName: \"kubernetes.io/projected/9cf90275-c7ec-4b81-a4dd-f647e43768d7-kube-api-access-xfmxp\") pod \"ovnkube-node-4p9m2\" (UID: \"9cf90275-c7ec-4b81-a4dd-f647e43768d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.090108 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.089984 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjc2k\" (UniqueName: \"kubernetes.io/projected/2def3683-a723-4b57-9eeb-a9e86cd3d92b-kube-api-access-jjc2k\") pod \"tuned-8zp7m\" (UID: \"2def3683-a723-4b57-9eeb-a9e86cd3d92b\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:03.092054 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.092030 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcn8v\" (UniqueName: \"kubernetes.io/projected/992584b5-85e4-4c18-aef4-254269d9b483-kube-api-access-xcn8v\") pod \"node-resolver-9j2fq\" (UID: \"992584b5-85e4-4c18-aef4-254269d9b483\") " pod="openshift-dns/node-resolver-9j2fq" Jul 10 15:55:03.092659 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.092637 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69p6x\" (UniqueName: \"kubernetes.io/projected/bca0b58d-d869-49a0-a7cf-b2987366f814-kube-api-access-69p6x\") pod \"aws-ebs-csi-driver-node-snb54\" (UID: \"bca0b58d-d869-49a0-a7cf-b2987366f814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb54" Jul 10 15:55:03.163875 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.163837 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5pg5m" Jul 10 15:55:03.176137 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.176101 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w9r4g" Jul 10 15:55:03.185891 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.185861 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-trngf" Jul 10 15:55:03.190837 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.190816 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jdrgl" Jul 10 15:55:03.199555 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.199527 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m94m9" Jul 10 15:55:03.207482 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.207458 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb54" Jul 10 15:55:03.214527 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.214503 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9j2fq" Jul 10 15:55:03.223610 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.223586 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" Jul 10 15:55:03.228622 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.228600 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:03.269709 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.269675 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 15:55:03.475300 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.475260 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btwpt\" (UniqueName: \"kubernetes.io/projected/a7af48f4-6437-4c48-b20f-731923004f10-kube-api-access-btwpt\") pod \"network-check-target-cmq2z\" (UID: \"a7af48f4-6437-4c48-b20f-731923004f10\") " pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:55:03.475451 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.475322 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30cc000d-f3a7-453b-a542-d3f9af19fefb-metrics-certs\") pod \"network-metrics-daemon-b9hg4\" (UID: \"30cc000d-f3a7-453b-a542-d3f9af19fefb\") " pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:03.475451 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:03.475444 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 15:55:03.475592 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:03.475454 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 15:55:03.475592 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:03.475477 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 15:55:03.475592 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:03.475490 2562 projected.go:196] Error preparing data for projected volume kube-api-access-btwpt for pod openshift-network-diagnostics/network-check-target-cmq2z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 15:55:03.475592 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:03.475498 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30cc000d-f3a7-453b-a542-d3f9af19fefb-metrics-certs podName:30cc000d-f3a7-453b-a542-d3f9af19fefb nodeName:}" failed. No retries permitted until 2026-07-10 15:55:04.475484264 +0000 UTC m=+3.907969236 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30cc000d-f3a7-453b-a542-d3f9af19fefb-metrics-certs") pod "network-metrics-daemon-b9hg4" (UID: "30cc000d-f3a7-453b-a542-d3f9af19fefb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 15:55:03.475592 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:03.475545 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7af48f4-6437-4c48-b20f-731923004f10-kube-api-access-btwpt podName:a7af48f4-6437-4c48-b20f-731923004f10 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:04.475526939 +0000 UTC m=+3.908011929 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-btwpt" (UniqueName: "kubernetes.io/projected/a7af48f4-6437-4c48-b20f-731923004f10-kube-api-access-btwpt") pod "network-check-target-cmq2z" (UID: "a7af48f4-6437-4c48-b20f-731923004f10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 15:55:03.575913 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.575859 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bfcca1c-4216-4bff-afc4-751789a422f1-original-pull-secret\") pod \"global-pull-secret-syncer-rw8tw\" (UID: \"6bfcca1c-4216-4bff-afc4-751789a422f1\") " pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:03.576065 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:03.576020 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 15:55:03.576125 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:03.576095 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bfcca1c-4216-4bff-afc4-751789a422f1-original-pull-secret podName:6bfcca1c-4216-4bff-afc4-751789a422f1 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:04.576077569 +0000 UTC m=+4.008562541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6bfcca1c-4216-4bff-afc4-751789a422f1-original-pull-secret") pod "global-pull-secret-syncer-rw8tw" (UID: "6bfcca1c-4216-4bff-afc4-751789a422f1") : object "kube-system"/"original-pull-secret" not registered Jul 10 15:55:03.901035 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.900958 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 15:50:02 +0000 UTC" deadline="2027-12-26 23:54:22.991771959 +0000 UTC" Jul 10 15:55:03.901035 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.901032 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12823h59m19.090743947s" Jul 10 15:55:03.983858 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:03.983814 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:55:03.984040 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:03.983927 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmq2z" podUID="a7af48f4-6437-4c48-b20f-731923004f10" Jul 10 15:55:04.157606 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:04.157560 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cf90275_c7ec_4b81_a4dd_f647e43768d7.slice/crio-c66a4bb35565d966608df38360813e68f16175ae2b5993d9640c63a8dd4c142b WatchSource:0}: Error finding container c66a4bb35565d966608df38360813e68f16175ae2b5993d9640c63a8dd4c142b: Status 404 returned error can't find the container with id c66a4bb35565d966608df38360813e68f16175ae2b5993d9640c63a8dd4c142b Jul 10 15:55:04.173411 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:04.173360 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2def3683_a723_4b57_9eeb_a9e86cd3d92b.slice/crio-899d2c2495e294bdb1dc6d0bd4658761a5505cffbd59d7ec3ddb66157cbe4253 WatchSource:0}: Error finding container 899d2c2495e294bdb1dc6d0bd4658761a5505cffbd59d7ec3ddb66157cbe4253: Status 404 returned error can't find the container with id 899d2c2495e294bdb1dc6d0bd4658761a5505cffbd59d7ec3ddb66157cbe4253 Jul 10 15:55:04.175969 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:04.175896 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod992584b5_85e4_4c18_aef4_254269d9b483.slice/crio-2b99e35564c4f14818cc6b9d54ce279b9938dfd71fc6101590fc82be4647cd55 WatchSource:0}: Error finding container 2b99e35564c4f14818cc6b9d54ce279b9938dfd71fc6101590fc82be4647cd55: Status 404 returned error can't find the container with id 2b99e35564c4f14818cc6b9d54ce279b9938dfd71fc6101590fc82be4647cd55 Jul 10 15:55:04.176154 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:04.176137 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4d9f312_84ef_48eb_be54_c55e7601fa50.slice/crio-ac9ac85c8c820966df8dbba44713c601c40b8a945698eaf857db4fda0f786fca WatchSource:0}: Error finding container ac9ac85c8c820966df8dbba44713c601c40b8a945698eaf857db4fda0f786fca: Status 404 returned error can't find the container with id ac9ac85c8c820966df8dbba44713c601c40b8a945698eaf857db4fda0f786fca Jul 10 15:55:04.177410 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:04.177367 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bcb7a5c_1cb1_4c2e_aa53_fd5dad33c1ce.slice/crio-2a10c325c6816b7f816eb592e282fa167a708ae0308f57c4b7ff8a1ed01436d9 WatchSource:0}: Error finding container 2a10c325c6816b7f816eb592e282fa167a708ae0308f57c4b7ff8a1ed01436d9: Status 404 returned error can't find the container with id 2a10c325c6816b7f816eb592e282fa167a708ae0308f57c4b7ff8a1ed01436d9 Jul 10 15:55:04.179919 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:04.179898 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0c331ff_5e5f_46f2_af72_86afa6e6c6c4.slice/crio-383da8f0254e132b4fd7eb2ec92aa158dc175149a16bae81628ffd7095e69be1 WatchSource:0}: Error finding container 383da8f0254e132b4fd7eb2ec92aa158dc175149a16bae81628ffd7095e69be1: Status 404 returned error can't find the container with id 383da8f0254e132b4fd7eb2ec92aa158dc175149a16bae81628ffd7095e69be1 Jul 10 15:55:04.180954 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:04.180926 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a85fded_c683_4463_b8ad_d09429d9eaf5.slice/crio-01b8916017ba559698283dd93258a36217e6d7b86b2726fefe29b8930958cc44 WatchSource:0}: Error finding container 01b8916017ba559698283dd93258a36217e6d7b86b2726fefe29b8930958cc44: Status 404 returned error can't find the container with id 01b8916017ba559698283dd93258a36217e6d7b86b2726fefe29b8930958cc44 Jul 10 15:55:04.181794 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:04.181774 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67fd65fd_74e1_4c36_914a_b93627e423a7.slice/crio-d404a028502a38df541cbd7f3ea5f8094f3395dd08aa112bfe0be3a7b61f4c67 WatchSource:0}: Error finding container d404a028502a38df541cbd7f3ea5f8094f3395dd08aa112bfe0be3a7b61f4c67: Status 404 returned error can't find the container with id d404a028502a38df541cbd7f3ea5f8094f3395dd08aa112bfe0be3a7b61f4c67 Jul 10 15:55:04.481769 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:04.481737 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btwpt\" (UniqueName: \"kubernetes.io/projected/a7af48f4-6437-4c48-b20f-731923004f10-kube-api-access-btwpt\") pod \"network-check-target-cmq2z\" (UID: \"a7af48f4-6437-4c48-b20f-731923004f10\") " pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:55:04.481769 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:04.481778 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30cc000d-f3a7-453b-a542-d3f9af19fefb-metrics-certs\") pod \"network-metrics-daemon-b9hg4\" (UID: \"30cc000d-f3a7-453b-a542-d3f9af19fefb\") " pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:04.481977 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:04.481907 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 15:55:04.481977 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:04.481924 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 15:55:04.481977 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:04.481930 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 15:55:04.481977 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:04.481942 2562 projected.go:196] Error preparing data for projected volume kube-api-access-btwpt for pod openshift-network-diagnostics/network-check-target-cmq2z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 15:55:04.482091 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:04.481981 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7af48f4-6437-4c48-b20f-731923004f10-kube-api-access-btwpt podName:a7af48f4-6437-4c48-b20f-731923004f10 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:06.481967954 +0000 UTC m=+5.914452925 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-btwpt" (UniqueName: "kubernetes.io/projected/a7af48f4-6437-4c48-b20f-731923004f10-kube-api-access-btwpt") pod "network-check-target-cmq2z" (UID: "a7af48f4-6437-4c48-b20f-731923004f10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 15:55:04.482091 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:04.481996 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30cc000d-f3a7-453b-a542-d3f9af19fefb-metrics-certs podName:30cc000d-f3a7-453b-a542-d3f9af19fefb nodeName:}" failed. No retries permitted until 2026-07-10 15:55:06.481990419 +0000 UTC m=+5.914475391 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30cc000d-f3a7-453b-a542-d3f9af19fefb-metrics-certs") pod "network-metrics-daemon-b9hg4" (UID: "30cc000d-f3a7-453b-a542-d3f9af19fefb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 15:55:04.582505 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:04.582467 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bfcca1c-4216-4bff-afc4-751789a422f1-original-pull-secret\") pod \"global-pull-secret-syncer-rw8tw\" (UID: \"6bfcca1c-4216-4bff-afc4-751789a422f1\") " pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:04.582689 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:04.582620 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 15:55:04.582749 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:04.582692 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bfcca1c-4216-4bff-afc4-751789a422f1-original-pull-secret podName:6bfcca1c-4216-4bff-afc4-751789a422f1 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:06.582674146 +0000 UTC m=+6.015159119 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6bfcca1c-4216-4bff-afc4-751789a422f1-original-pull-secret") pod "global-pull-secret-syncer-rw8tw" (UID: "6bfcca1c-4216-4bff-afc4-751789a422f1") : object "kube-system"/"original-pull-secret" not registered Jul 10 15:55:04.878539 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:04.878459 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 15:55:04.901610 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:04.901498 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 15:50:02 +0000 UTC" deadline="2028-03-21 02:01:28.629482244 +0000 UTC" Jul 10 15:55:04.901610 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:04.901562 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14866h6m23.727924121s" Jul 10 15:55:04.993971 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:04.993931 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:04.994129 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:04.994063 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9hg4" podUID="30cc000d-f3a7-453b-a542-d3f9af19fefb" Jul 10 15:55:04.994473 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:04.994453 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:04.994593 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:04.994555 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw8tw" podUID="6bfcca1c-4216-4bff-afc4-751789a422f1" Jul 10 15:55:05.001788 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:05.001624 2562 generic.go:356] "Generic (PLEG): container finished" podID="1c56d5a6298310aad20712b064e11d42" containerID="861040fb76f0affc7f573117477599227ed400f30b37dc9e137d9f13715c5f2d" exitCode=0 Jul 10 15:55:05.001788 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:05.001715 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-164.ec2.internal" event={"ID":"1c56d5a6298310aad20712b064e11d42","Type":"ContainerDied","Data":"861040fb76f0affc7f573117477599227ed400f30b37dc9e137d9f13715c5f2d"} Jul 10 15:55:05.004638 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:05.004555 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jdrgl" event={"ID":"67fd65fd-74e1-4c36-914a-b93627e423a7","Type":"ContainerStarted","Data":"d404a028502a38df541cbd7f3ea5f8094f3395dd08aa112bfe0be3a7b61f4c67"} Jul 10 15:55:05.009432 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:05.009402 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m94m9" event={"ID":"2bcb7a5c-1cb1-4c2e-aa53-fd5dad33c1ce","Type":"ContainerStarted","Data":"2a10c325c6816b7f816eb592e282fa167a708ae0308f57c4b7ff8a1ed01436d9"} Jul 10 15:55:05.011171 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:05.011140 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" event={"ID":"2def3683-a723-4b57-9eeb-a9e86cd3d92b","Type":"ContainerStarted","Data":"899d2c2495e294bdb1dc6d0bd4658761a5505cffbd59d7ec3ddb66157cbe4253"} Jul 10 15:55:05.014620 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:05.014594 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5pg5m" event={"ID":"9a85fded-c683-4463-b8ad-d09429d9eaf5","Type":"ContainerStarted","Data":"01b8916017ba559698283dd93258a36217e6d7b86b2726fefe29b8930958cc44"} Jul 10 15:55:05.018103 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:05.018074 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-trngf" event={"ID":"d4d9f312-84ef-48eb-be54-c55e7601fa50","Type":"ContainerStarted","Data":"ac9ac85c8c820966df8dbba44713c601c40b8a945698eaf857db4fda0f786fca"} Jul 10 15:55:05.028874 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:05.028842 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9j2fq" event={"ID":"992584b5-85e4-4c18-aef4-254269d9b483","Type":"ContainerStarted","Data":"2b99e35564c4f14818cc6b9d54ce279b9938dfd71fc6101590fc82be4647cd55"} Jul 10 15:55:05.037179 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:05.037121 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w9r4g" event={"ID":"b0c331ff-5e5f-46f2-af72-86afa6e6c6c4","Type":"ContainerStarted","Data":"383da8f0254e132b4fd7eb2ec92aa158dc175149a16bae81628ffd7095e69be1"} Jul 10 15:55:05.049518 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:05.049421 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb54" event={"ID":"bca0b58d-d869-49a0-a7cf-b2987366f814","Type":"ContainerStarted","Data":"6ac83716350b08cad3fcdaa29d70e31c5b60587e25c11da62c5fcce578d8f257"} Jul 10 15:55:05.054298 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:05.054262 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" event={"ID":"9cf90275-c7ec-4b81-a4dd-f647e43768d7","Type":"ContainerStarted","Data":"c66a4bb35565d966608df38360813e68f16175ae2b5993d9640c63a8dd4c142b"} Jul 10 15:55:05.085789 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:05.085735 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-164.ec2.internal" event={"ID":"bf7065f98e0473976e9b61c34610e8e3","Type":"ContainerStarted","Data":"edd240b80766dbcc9450f2ddf3500d744ea70a1642d93bc239498f17ed01a253"} Jul 10 15:55:05.104391 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:05.104317 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-164.ec2.internal" podStartSLOduration=4.104296723 podStartE2EDuration="4.104296723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 15:55:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:55:05.103648223 +0000 UTC m=+4.536133217" watchObservedRunningTime="2026-07-10 15:55:05.104296723 +0000 UTC m=+4.536781718" Jul 10 15:55:05.983588 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:05.983534 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:55:05.984040 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:05.983688 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmq2z" podUID="a7af48f4-6437-4c48-b20f-731923004f10" Jul 10 15:55:06.104739 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:06.104683 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-164.ec2.internal" event={"ID":"1c56d5a6298310aad20712b064e11d42","Type":"ContainerStarted","Data":"062e9e22d852ae96bce9b38ad7ca2e21b0526ab5a420e2a74419f220ef21fbb9"} Jul 10 15:55:06.123971 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:06.123909 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-164.ec2.internal" podStartSLOduration=5.123886575 podStartE2EDuration="5.123886575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 15:55:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:55:06.122791062 +0000 UTC m=+5.555276056" watchObservedRunningTime="2026-07-10 15:55:06.123886575 +0000 UTC m=+5.556371570" Jul 10 15:55:06.501446 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:06.501401 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btwpt\" (UniqueName: \"kubernetes.io/projected/a7af48f4-6437-4c48-b20f-731923004f10-kube-api-access-btwpt\") pod \"network-check-target-cmq2z\" (UID: \"a7af48f4-6437-4c48-b20f-731923004f10\") " pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:55:06.501646 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:06.501459 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30cc000d-f3a7-453b-a542-d3f9af19fefb-metrics-certs\") pod \"network-metrics-daemon-b9hg4\" (UID: \"30cc000d-f3a7-453b-a542-d3f9af19fefb\") " pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:06.501646 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:06.501604 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 15:55:06.501646 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:06.501629 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 15:55:06.501646 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:06.501641 2562 projected.go:196] Error preparing data for projected volume kube-api-access-btwpt for pod openshift-network-diagnostics/network-check-target-cmq2z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 15:55:06.501855 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:06.501675 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 15:55:06.501855 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:06.501701 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7af48f4-6437-4c48-b20f-731923004f10-kube-api-access-btwpt podName:a7af48f4-6437-4c48-b20f-731923004f10 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:10.501682546 +0000 UTC m=+9.934167542 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-btwpt" (UniqueName: "kubernetes.io/projected/a7af48f4-6437-4c48-b20f-731923004f10-kube-api-access-btwpt") pod "network-check-target-cmq2z" (UID: "a7af48f4-6437-4c48-b20f-731923004f10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 15:55:06.501855 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:06.501729 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30cc000d-f3a7-453b-a542-d3f9af19fefb-metrics-certs podName:30cc000d-f3a7-453b-a542-d3f9af19fefb nodeName:}" failed. No retries permitted until 2026-07-10 15:55:10.501711927 +0000 UTC m=+9.934196902 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30cc000d-f3a7-453b-a542-d3f9af19fefb-metrics-certs") pod "network-metrics-daemon-b9hg4" (UID: "30cc000d-f3a7-453b-a542-d3f9af19fefb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 15:55:06.602849 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:06.602805 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bfcca1c-4216-4bff-afc4-751789a422f1-original-pull-secret\") pod \"global-pull-secret-syncer-rw8tw\" (UID: \"6bfcca1c-4216-4bff-afc4-751789a422f1\") " pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:06.603071 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:06.602970 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 15:55:06.603143 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:06.603118 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bfcca1c-4216-4bff-afc4-751789a422f1-original-pull-secret podName:6bfcca1c-4216-4bff-afc4-751789a422f1 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:10.603097457 +0000 UTC m=+10.035582446 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6bfcca1c-4216-4bff-afc4-751789a422f1-original-pull-secret") pod "global-pull-secret-syncer-rw8tw" (UID: "6bfcca1c-4216-4bff-afc4-751789a422f1") : object "kube-system"/"original-pull-secret" not registered Jul 10 15:55:06.987480 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:06.987402 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:06.988122 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:06.987595 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:06.988122 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:06.987598 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw8tw" podUID="6bfcca1c-4216-4bff-afc4-751789a422f1" Jul 10 15:55:06.988122 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:06.987677 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9hg4" podUID="30cc000d-f3a7-453b-a542-d3f9af19fefb" Jul 10 15:55:07.983847 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:07.983806 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:55:07.984005 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:07.983967 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmq2z" podUID="a7af48f4-6437-4c48-b20f-731923004f10" Jul 10 15:55:08.983318 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:08.983099 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:08.983788 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:08.983437 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw8tw" podUID="6bfcca1c-4216-4bff-afc4-751789a422f1" Jul 10 15:55:08.983788 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:08.983477 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:08.983788 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:08.983547 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9hg4" podUID="30cc000d-f3a7-453b-a542-d3f9af19fefb" Jul 10 15:55:09.983263 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:09.983222 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:55:09.983469 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:09.983370 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmq2z" podUID="a7af48f4-6437-4c48-b20f-731923004f10" Jul 10 15:55:10.532545 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:10.532505 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btwpt\" (UniqueName: \"kubernetes.io/projected/a7af48f4-6437-4c48-b20f-731923004f10-kube-api-access-btwpt\") pod \"network-check-target-cmq2z\" (UID: \"a7af48f4-6437-4c48-b20f-731923004f10\") " pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:55:10.532726 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:10.532561 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30cc000d-f3a7-453b-a542-d3f9af19fefb-metrics-certs\") pod \"network-metrics-daemon-b9hg4\" (UID: \"30cc000d-f3a7-453b-a542-d3f9af19fefb\") " pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:10.532726 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:10.532700 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 15:55:10.532726 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:10.532703 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 15:55:10.532833 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:10.532729 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 15:55:10.532833 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:10.532739 2562 projected.go:196] Error preparing data for projected volume kube-api-access-btwpt for pod openshift-network-diagnostics/network-check-target-cmq2z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 15:55:10.532833 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:10.532755 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30cc000d-f3a7-453b-a542-d3f9af19fefb-metrics-certs podName:30cc000d-f3a7-453b-a542-d3f9af19fefb nodeName:}" failed. No retries permitted until 2026-07-10 15:55:18.532741115 +0000 UTC m=+17.965226087 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30cc000d-f3a7-453b-a542-d3f9af19fefb-metrics-certs") pod "network-metrics-daemon-b9hg4" (UID: "30cc000d-f3a7-453b-a542-d3f9af19fefb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 15:55:10.532833 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:10.532779 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7af48f4-6437-4c48-b20f-731923004f10-kube-api-access-btwpt podName:a7af48f4-6437-4c48-b20f-731923004f10 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:18.532766531 +0000 UTC m=+17.965251502 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-btwpt" (UniqueName: "kubernetes.io/projected/a7af48f4-6437-4c48-b20f-731923004f10-kube-api-access-btwpt") pod "network-check-target-cmq2z" (UID: "a7af48f4-6437-4c48-b20f-731923004f10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 15:55:10.633244 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:10.633210 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bfcca1c-4216-4bff-afc4-751789a422f1-original-pull-secret\") pod \"global-pull-secret-syncer-rw8tw\" (UID: \"6bfcca1c-4216-4bff-afc4-751789a422f1\") " pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:10.633419 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:10.633379 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 15:55:10.633482 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:10.633468 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bfcca1c-4216-4bff-afc4-751789a422f1-original-pull-secret podName:6bfcca1c-4216-4bff-afc4-751789a422f1 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:18.633447057 +0000 UTC m=+18.065932032 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6bfcca1c-4216-4bff-afc4-751789a422f1-original-pull-secret") pod "global-pull-secret-syncer-rw8tw" (UID: "6bfcca1c-4216-4bff-afc4-751789a422f1") : object "kube-system"/"original-pull-secret" not registered Jul 10 15:55:10.983867 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:10.983784 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:10.984290 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:10.983949 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw8tw" podUID="6bfcca1c-4216-4bff-afc4-751789a422f1" Jul 10 15:55:10.984378 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:10.984304 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:10.984438 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:10.984423 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9hg4" podUID="30cc000d-f3a7-453b-a542-d3f9af19fefb" Jul 10 15:55:11.983770 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:11.983695 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:55:11.983935 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:11.983845 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmq2z" podUID="a7af48f4-6437-4c48-b20f-731923004f10" Jul 10 15:55:12.983898 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:12.983862 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:12.984074 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:12.983976 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9hg4" podUID="30cc000d-f3a7-453b-a542-d3f9af19fefb" Jul 10 15:55:12.984074 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:12.984027 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:12.984513 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:12.984122 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw8tw" podUID="6bfcca1c-4216-4bff-afc4-751789a422f1" Jul 10 15:55:13.983133 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:13.983098 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:55:13.983310 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:13.983236 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmq2z" podUID="a7af48f4-6437-4c48-b20f-731923004f10" Jul 10 15:55:14.983738 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:14.983702 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:14.983738 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:14.983717 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:14.984167 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:14.983814 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw8tw" podUID="6bfcca1c-4216-4bff-afc4-751789a422f1" Jul 10 15:55:14.984167 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:14.983958 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9hg4" podUID="30cc000d-f3a7-453b-a542-d3f9af19fefb" Jul 10 15:55:15.982997 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:15.982962 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:55:15.983150 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:15.983092 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmq2z" podUID="a7af48f4-6437-4c48-b20f-731923004f10" Jul 10 15:55:16.128178 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:16.128137 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jdrgl" event={"ID":"67fd65fd-74e1-4c36-914a-b93627e423a7","Type":"ContainerStarted","Data":"5e9f7592bf48178bde6a7ed6649784f574122577ad33250e265b7d54a4cc9a0e"} Jul 10 15:55:16.130256 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:16.130049 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m94m9" event={"ID":"2bcb7a5c-1cb1-4c2e-aa53-fd5dad33c1ce","Type":"ContainerStarted","Data":"73262efc709478ac78465f3c64ac1004810a6de8cc511ef1bb28cafd538639db"} Jul 10 15:55:16.131747 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:16.131721 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" event={"ID":"2def3683-a723-4b57-9eeb-a9e86cd3d92b","Type":"ContainerStarted","Data":"72e6855e7e944e0f50effd9242dadbd8cc9341721813c96ba435024190c756bc"} Jul 10 15:55:16.133423 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:16.133393 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9j2fq" event={"ID":"992584b5-85e4-4c18-aef4-254269d9b483","Type":"ContainerStarted","Data":"b6f3c0c1463a64f3560faf9ef0b310934c55ae34189b73033ff728aa75a293e0"} Jul 10 15:55:16.135034 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:16.135007 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w9r4g" event={"ID":"b0c331ff-5e5f-46f2-af72-86afa6e6c6c4","Type":"ContainerStarted","Data":"25ecb224ff734373db9d3749e04e90033cc54ef544a7d48f098898474cb43ef4"} Jul 10 15:55:16.136791 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:16.136756 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb54" event={"ID":"bca0b58d-d869-49a0-a7cf-b2987366f814","Type":"ContainerStarted","Data":"4584cf13870cd1410c6f402f8ea3a9b02082814ae481907701e8798624df54e3"} Jul 10 15:55:16.172922 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:16.172855 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m94m9" podStartSLOduration=4.06014286 podStartE2EDuration="15.172839245s" totalImagesPullingTime="11.112696385s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 15:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:55:16.172367685 +0000 UTC m=+15.604852660" watchObservedRunningTime="2026-07-10 15:55:16.172839245 +0000 UTC m=+15.605324239" Jul 10 15:55:16.188327 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:16.188268 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-w9r4g" podStartSLOduration=5.127802536 podStartE2EDuration="16.188254192s" totalImagesPullingTime="11.060451656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:55:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:55:16.187997685 +0000 UTC m=+15.620482683" watchObservedRunningTime="2026-07-10 15:55:16.188254192 +0000 UTC m=+15.620739185" Jul 10 15:55:16.209219 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:16.209155 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9j2fq" podStartSLOduration=4.123234002 podStartE2EDuration="15.209133915s" totalImagesPullingTime="11.085899913s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 15:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:55:16.208421219 +0000 UTC m=+15.640906214" watchObservedRunningTime="2026-07-10 15:55:16.209133915 +0000 UTC m=+15.641618909" Jul 10 15:55:16.983757 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:16.983677 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:16.984006 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:16.983689 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:16.984006 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:16.983809 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw8tw" podUID="6bfcca1c-4216-4bff-afc4-751789a422f1" Jul 10 15:55:16.984006 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:16.983905 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9hg4" podUID="30cc000d-f3a7-453b-a542-d3f9af19fefb" Jul 10 15:55:17.140678 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:17.140603 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-trngf" event={"ID":"d4d9f312-84ef-48eb-be54-c55e7601fa50","Type":"ContainerStarted","Data":"86eb3bce1672149a6629a4e4521f73f5e5115695d8a0fd820b0e5cc6c920ca48"} Jul 10 15:55:17.162417 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:17.162371 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8zp7m" podStartSLOduration=5.0684090489999996 podStartE2EDuration="16.162354331s" totalImagesPullingTime="11.093945282s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 15:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:55:16.229884581 +0000 UTC m=+15.662369577" watchObservedRunningTime="2026-07-10 15:55:17.162354331 +0000 UTC m=+16.594839325" Jul 10 15:55:17.162743 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:17.162712 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-trngf" podStartSLOduration=5.0700908590000004 podStartE2EDuration="16.162703466s" totalImagesPullingTime="11.092612607s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 15:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:55:17.162275046 +0000 UTC m=+16.594760039" watchObservedRunningTime="2026-07-10 15:55:17.162703466 +0000 UTC m=+16.595188460" Jul 10 15:55:17.983382 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:17.983344 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:55:17.983606 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:17.983484 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmq2z" podUID="a7af48f4-6437-4c48-b20f-731923004f10" Jul 10 15:55:18.356353 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:18.356265 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-w9r4g" Jul 10 15:55:18.357081 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:18.357018 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-w9r4g" Jul 10 15:55:18.598818 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:18.598783 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btwpt\" (UniqueName: \"kubernetes.io/projected/a7af48f4-6437-4c48-b20f-731923004f10-kube-api-access-btwpt\") pod \"network-check-target-cmq2z\" (UID: \"a7af48f4-6437-4c48-b20f-731923004f10\") " pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:55:18.598818 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:18.598832 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30cc000d-f3a7-453b-a542-d3f9af19fefb-metrics-certs\") pod \"network-metrics-daemon-b9hg4\" (UID: \"30cc000d-f3a7-453b-a542-d3f9af19fefb\") " pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:18.599099 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:18.598945 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 15:55:18.599099 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:18.598966 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 15:55:18.599099 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:18.598990 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 15:55:18.599099 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:18.598995 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30cc000d-f3a7-453b-a542-d3f9af19fefb-metrics-certs podName:30cc000d-f3a7-453b-a542-d3f9af19fefb nodeName:}" failed. No retries permitted until 2026-07-10 15:55:34.598981219 +0000 UTC m=+34.031466191 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30cc000d-f3a7-453b-a542-d3f9af19fefb-metrics-certs") pod "network-metrics-daemon-b9hg4" (UID: "30cc000d-f3a7-453b-a542-d3f9af19fefb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 15:55:18.599099 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:18.599002 2562 projected.go:196] Error preparing data for projected volume kube-api-access-btwpt for pod openshift-network-diagnostics/network-check-target-cmq2z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 15:55:18.599099 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:18.599057 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7af48f4-6437-4c48-b20f-731923004f10-kube-api-access-btwpt podName:a7af48f4-6437-4c48-b20f-731923004f10 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:34.599039158 +0000 UTC m=+34.031524149 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-btwpt" (UniqueName: "kubernetes.io/projected/a7af48f4-6437-4c48-b20f-731923004f10-kube-api-access-btwpt") pod "network-check-target-cmq2z" (UID: "a7af48f4-6437-4c48-b20f-731923004f10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 15:55:18.699983 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:18.699893 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bfcca1c-4216-4bff-afc4-751789a422f1-original-pull-secret\") pod \"global-pull-secret-syncer-rw8tw\" (UID: \"6bfcca1c-4216-4bff-afc4-751789a422f1\") " pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:18.700149 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:18.700035 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 15:55:18.700149 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:18.700107 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bfcca1c-4216-4bff-afc4-751789a422f1-original-pull-secret podName:6bfcca1c-4216-4bff-afc4-751789a422f1 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:34.700088051 +0000 UTC m=+34.132573048 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6bfcca1c-4216-4bff-afc4-751789a422f1-original-pull-secret") pod "global-pull-secret-syncer-rw8tw" (UID: "6bfcca1c-4216-4bff-afc4-751789a422f1") : object "kube-system"/"original-pull-secret" not registered Jul 10 15:55:18.983421 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:18.983325 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:18.983421 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:18.983366 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:18.983668 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:18.983462 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw8tw" podUID="6bfcca1c-4216-4bff-afc4-751789a422f1" Jul 10 15:55:18.983668 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:18.983587 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9hg4" podUID="30cc000d-f3a7-453b-a542-d3f9af19fefb" Jul 10 15:55:19.145709 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:19.145668 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-w9r4g" Jul 10 15:55:19.146414 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:19.146389 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-w9r4g" Jul 10 15:55:19.983473 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:19.983429 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:55:19.983962 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:19.983557 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmq2z" podUID="a7af48f4-6437-4c48-b20f-731923004f10" Jul 10 15:55:20.148928 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:20.148890 2562 generic.go:356] "Generic (PLEG): container finished" podID="67fd65fd-74e1-4c36-914a-b93627e423a7" containerID="5e9f7592bf48178bde6a7ed6649784f574122577ad33250e265b7d54a4cc9a0e" exitCode=0 Jul 10 15:55:20.149107 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:20.148971 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jdrgl" event={"ID":"67fd65fd-74e1-4c36-914a-b93627e423a7","Type":"ContainerDied","Data":"5e9f7592bf48178bde6a7ed6649784f574122577ad33250e265b7d54a4cc9a0e"} Jul 10 15:55:20.984860 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:20.984825 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:20.985319 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:20.984967 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw8tw" podUID="6bfcca1c-4216-4bff-afc4-751789a422f1" Jul 10 15:55:20.985319 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:20.985024 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:20.985319 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:20.985144 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9hg4" podUID="30cc000d-f3a7-453b-a542-d3f9af19fefb" Jul 10 15:55:21.983715 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:21.983673 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:55:21.983911 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:21.983809 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmq2z" podUID="a7af48f4-6437-4c48-b20f-731923004f10" Jul 10 15:55:22.983734 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:22.983697 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:22.984286 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:22.983699 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:22.984286 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:22.983831 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw8tw" podUID="6bfcca1c-4216-4bff-afc4-751789a422f1" Jul 10 15:55:22.984286 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:22.983891 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9hg4" podUID="30cc000d-f3a7-453b-a542-d3f9af19fefb" Jul 10 15:55:23.985149 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:23.983281 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:55:23.985149 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:23.983403 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmq2z" podUID="a7af48f4-6437-4c48-b20f-731923004f10" Jul 10 15:55:24.056698 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:24.056435 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 10 15:55:24.159175 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:24.158757 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5pg5m" event={"ID":"9a85fded-c683-4463-b8ad-d09429d9eaf5","Type":"ContainerStarted","Data":"37dd0a451b3b1eca5d6bb5a68a844b377f379d2e6b526cc5e2c41abd914ce334"} Jul 10 15:55:24.160807 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:24.160780 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb54" event={"ID":"bca0b58d-d869-49a0-a7cf-b2987366f814","Type":"ContainerStarted","Data":"00dd5a3deeba408d045a57c6a31bc3d95b9752baf0d22098986c6ad2287ad713"} Jul 10 15:55:24.162917 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:24.162894 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" event={"ID":"9cf90275-c7ec-4b81-a4dd-f647e43768d7","Type":"ContainerStarted","Data":"a9d7028a903e7ade2751a34db54147fe15eec46de3596ada6eda15ec55d0484e"} Jul 10 15:55:24.163040 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:24.162976 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" event={"ID":"9cf90275-c7ec-4b81-a4dd-f647e43768d7","Type":"ContainerStarted","Data":"6e7ca2fdad7c8c0639f3de547411c6af6a5f0b72754c3a72c7ee5d5555abf3f7"} Jul 10 15:55:24.163040 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:24.163029 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" event={"ID":"9cf90275-c7ec-4b81-a4dd-f647e43768d7","Type":"ContainerStarted","Data":"a11ee07717bd718f2b426d7e7483f8aed89d5e39c63247e61968121f4ad646ca"} Jul 10 15:55:24.177555 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:24.177504 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5pg5m" podStartSLOduration=4.509424534 podStartE2EDuration="24.177484114s" totalImagesPullingTime="19.66805958s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 15:55:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:55:24.177172984 +0000 UTC m=+23.609657979" watchObservedRunningTime="2026-07-10 15:55:24.177484114 +0000 UTC m=+23.609969110" Jul 10 15:55:24.936412 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:24.936284 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T15:55:24.056669281Z","UUID":"4cca7494-5e9c-4385-bb1d-5bda0e68d05b","Handler":null,"Name":"","Endpoint":""} Jul 10 15:55:24.937983 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:24.937960 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 10 15:55:24.938109 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:24.938003 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 10 15:55:24.983505 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:24.983471 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:24.983673 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:24.983479 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:24.983673 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:24.983636 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9hg4" podUID="30cc000d-f3a7-453b-a542-d3f9af19fefb" Jul 10 15:55:24.983673 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:24.983662 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw8tw" podUID="6bfcca1c-4216-4bff-afc4-751789a422f1" Jul 10 15:55:25.170229 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:25.170190 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" event={"ID":"9cf90275-c7ec-4b81-a4dd-f647e43768d7","Type":"ContainerStarted","Data":"2481bc734a7b1397a5fe95427e78773b16db53a058452b4a507074abdda8f61e"} Jul 10 15:55:25.171180 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:25.170294 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" event={"ID":"9cf90275-c7ec-4b81-a4dd-f647e43768d7","Type":"ContainerStarted","Data":"d010d1382d7f16da664fda454430cd503a874bf5894382932257f644be35afee"} Jul 10 15:55:25.171180 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:25.170348 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" event={"ID":"9cf90275-c7ec-4b81-a4dd-f647e43768d7","Type":"ContainerStarted","Data":"0d0c27440696e3ff379f2cbf179753b78f6d19c2b07efb77eabe7720033e137b"} Jul 10 15:55:25.982873 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:25.982784 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:55:25.983135 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:25.982917 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmq2z" podUID="a7af48f4-6437-4c48-b20f-731923004f10" Jul 10 15:55:26.174535 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:26.174503 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb54" event={"ID":"bca0b58d-d869-49a0-a7cf-b2987366f814","Type":"ContainerStarted","Data":"4f122f34035ecd45e26aa9ec751adcb222d99917e3ca37f4afe8909bdb5157cc"} Jul 10 15:55:26.195066 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:26.195020 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb54" podStartSLOduration=4.162424608 podStartE2EDuration="25.195007605s" totalImagesPullingTime="21.032582997s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 15:55:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:55:26.194773587 +0000 UTC m=+25.627258580" watchObservedRunningTime="2026-07-10 15:55:26.195007605 +0000 UTC m=+25.627492599" Jul 10 15:55:26.983730 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:26.983690 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:26.983935 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:26.983701 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:26.983935 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:26.983856 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw8tw" podUID="6bfcca1c-4216-4bff-afc4-751789a422f1" Jul 10 15:55:26.983935 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:26.983903 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9hg4" podUID="30cc000d-f3a7-453b-a542-d3f9af19fefb" Jul 10 15:55:27.179585 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:27.179531 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" event={"ID":"9cf90275-c7ec-4b81-a4dd-f647e43768d7","Type":"ContainerStarted","Data":"9d731caea06515b3c752fe1c74e1aff615c0c567e325e60d85c5ccd891c5ceec"} Jul 10 15:55:27.983193 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:27.983159 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:55:27.983370 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:27.983275 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmq2z" podUID="a7af48f4-6437-4c48-b20f-731923004f10" Jul 10 15:55:28.983921 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:28.983675 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:28.984279 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:28.983726 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:28.984279 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:28.984038 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw8tw" podUID="6bfcca1c-4216-4bff-afc4-751789a422f1" Jul 10 15:55:28.984279 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:28.984108 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9hg4" podUID="30cc000d-f3a7-453b-a542-d3f9af19fefb" Jul 10 15:55:29.186607 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:29.186558 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" event={"ID":"9cf90275-c7ec-4b81-a4dd-f647e43768d7","Type":"ContainerStarted","Data":"6b08a91b4ad4055af50adcc4fcc3958d5da0bdc51be270106e91b3350039ff9d"} Jul 10 15:55:29.187009 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:29.186986 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:29.187091 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:29.187060 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:29.202413 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:29.202382 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:29.215924 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:29.215862 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" podStartSLOduration=8.503273638 podStartE2EDuration="28.215840379s" totalImagesPullingTime="19.712566741s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 15:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:55:29.21522407 +0000 UTC m=+28.647709065" watchObservedRunningTime="2026-07-10 15:55:29.215840379 +0000 UTC m=+28.648325374" Jul 10 15:55:29.982947 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:29.982912 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:55:29.983175 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:29.983016 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmq2z" podUID="a7af48f4-6437-4c48-b20f-731923004f10" Jul 10 15:55:30.192135 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:30.192102 2562 generic.go:356] "Generic (PLEG): container finished" podID="67fd65fd-74e1-4c36-914a-b93627e423a7" containerID="ee61f489819589b88fa540c28e4094310b1b403676743e783283e73a162da24f" exitCode=0 Jul 10 15:55:30.192495 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:30.192175 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jdrgl" event={"ID":"67fd65fd-74e1-4c36-914a-b93627e423a7","Type":"ContainerDied","Data":"ee61f489819589b88fa540c28e4094310b1b403676743e783283e73a162da24f"} Jul 10 15:55:30.192644 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:30.192618 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:30.207904 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:30.207882 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:55:30.984218 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:30.984184 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:30.984407 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:30.984293 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw8tw" podUID="6bfcca1c-4216-4bff-afc4-751789a422f1" Jul 10 15:55:30.984407 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:30.984334 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:30.984520 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:30.984440 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9hg4" podUID="30cc000d-f3a7-453b-a542-d3f9af19fefb" Jul 10 15:55:31.106428 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:31.106392 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b9hg4"] Jul 10 15:55:31.109980 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:31.109944 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rw8tw"] Jul 10 15:55:31.110510 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:31.110492 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cmq2z"] Jul 10 15:55:31.110617 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:31.110604 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:55:31.110713 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:31.110695 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmq2z" podUID="a7af48f4-6437-4c48-b20f-731923004f10" Jul 10 15:55:31.194657 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:31.194628 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:31.194657 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:31.194650 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:31.195239 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:31.194766 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw8tw" podUID="6bfcca1c-4216-4bff-afc4-751789a422f1" Jul 10 15:55:31.195239 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:31.194843 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9hg4" podUID="30cc000d-f3a7-453b-a542-d3f9af19fefb" Jul 10 15:55:32.198704 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:32.198508 2562 generic.go:356] "Generic (PLEG): container finished" podID="67fd65fd-74e1-4c36-914a-b93627e423a7" containerID="baad8989b02a0aa8762aa324b3bb90adbb58586487d6cbe9a37b6fd1d50550dd" exitCode=0 Jul 10 15:55:32.199074 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:32.198595 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jdrgl" event={"ID":"67fd65fd-74e1-4c36-914a-b93627e423a7","Type":"ContainerDied","Data":"baad8989b02a0aa8762aa324b3bb90adbb58586487d6cbe9a37b6fd1d50550dd"} Jul 10 15:55:32.983525 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:32.983495 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:55:32.983699 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:32.983501 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:32.983699 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:32.983621 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmq2z" podUID="a7af48f4-6437-4c48-b20f-731923004f10" Jul 10 15:55:32.983699 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:32.983627 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:32.983861 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:32.983722 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9hg4" podUID="30cc000d-f3a7-453b-a542-d3f9af19fefb" Jul 10 15:55:32.983861 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:32.983818 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw8tw" podUID="6bfcca1c-4216-4bff-afc4-751789a422f1" Jul 10 15:55:34.206449 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:34.206416 2562 generic.go:356] "Generic (PLEG): container finished" podID="67fd65fd-74e1-4c36-914a-b93627e423a7" containerID="02205c522e29d4218b7ab7b3d94f73711fb742915b0b786520daa6d2f85bdba9" exitCode=0 Jul 10 15:55:34.207260 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:34.206468 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jdrgl" event={"ID":"67fd65fd-74e1-4c36-914a-b93627e423a7","Type":"ContainerDied","Data":"02205c522e29d4218b7ab7b3d94f73711fb742915b0b786520daa6d2f85bdba9"} Jul 10 15:55:34.615204 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:34.615171 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btwpt\" (UniqueName: \"kubernetes.io/projected/a7af48f4-6437-4c48-b20f-731923004f10-kube-api-access-btwpt\") pod \"network-check-target-cmq2z\" (UID: \"a7af48f4-6437-4c48-b20f-731923004f10\") " pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:55:34.615408 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:34.615214 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30cc000d-f3a7-453b-a542-d3f9af19fefb-metrics-certs\") pod \"network-metrics-daemon-b9hg4\" (UID: \"30cc000d-f3a7-453b-a542-d3f9af19fefb\") " pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:34.615408 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:34.615341 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 15:55:34.615408 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:34.615379 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 15:55:34.615408 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:34.615399 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30cc000d-f3a7-453b-a542-d3f9af19fefb-metrics-certs podName:30cc000d-f3a7-453b-a542-d3f9af19fefb nodeName:}" failed. No retries permitted until 2026-07-10 15:56:06.61538297 +0000 UTC m=+66.047867964 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30cc000d-f3a7-453b-a542-d3f9af19fefb-metrics-certs") pod "network-metrics-daemon-b9hg4" (UID: "30cc000d-f3a7-453b-a542-d3f9af19fefb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 15:55:34.615408 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:34.615403 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 15:55:34.615632 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:34.615418 2562 projected.go:196] Error preparing data for projected volume kube-api-access-btwpt for pod openshift-network-diagnostics/network-check-target-cmq2z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 15:55:34.615632 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:34.615471 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7af48f4-6437-4c48-b20f-731923004f10-kube-api-access-btwpt podName:a7af48f4-6437-4c48-b20f-731923004f10 nodeName:}" failed. No retries permitted until 2026-07-10 15:56:06.615454118 +0000 UTC m=+66.047939110 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-btwpt" (UniqueName: "kubernetes.io/projected/a7af48f4-6437-4c48-b20f-731923004f10-kube-api-access-btwpt") pod "network-check-target-cmq2z" (UID: "a7af48f4-6437-4c48-b20f-731923004f10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 15:55:34.716526 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:34.716486 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bfcca1c-4216-4bff-afc4-751789a422f1-original-pull-secret\") pod \"global-pull-secret-syncer-rw8tw\" (UID: \"6bfcca1c-4216-4bff-afc4-751789a422f1\") " pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:34.716723 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:34.716628 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 15:55:34.716723 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:34.716688 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bfcca1c-4216-4bff-afc4-751789a422f1-original-pull-secret podName:6bfcca1c-4216-4bff-afc4-751789a422f1 nodeName:}" failed. No retries permitted until 2026-07-10 15:56:06.716673935 +0000 UTC m=+66.149158907 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6bfcca1c-4216-4bff-afc4-751789a422f1-original-pull-secret") pod "global-pull-secret-syncer-rw8tw" (UID: "6bfcca1c-4216-4bff-afc4-751789a422f1") : object "kube-system"/"original-pull-secret" not registered Jul 10 15:55:34.983953 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:34.983861 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:34.984111 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:34.983864 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:55:34.984111 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:34.983993 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw8tw" podUID="6bfcca1c-4216-4bff-afc4-751789a422f1" Jul 10 15:55:34.984111 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:34.984056 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmq2z" podUID="a7af48f4-6437-4c48-b20f-731923004f10" Jul 10 15:55:34.984111 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:34.983867 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:34.984303 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:34.984135 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9hg4" podUID="30cc000d-f3a7-453b-a542-d3f9af19fefb" Jul 10 15:55:36.386997 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.386970 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-164.ec2.internal" event="NodeReady" Jul 10 15:55:36.387348 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.387111 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 10 15:55:36.430181 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.430148 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-d4547c7c-5ggsk"] Jul 10 15:55:36.433539 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.433522 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:55:36.436444 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.436425 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 10 15:55:36.436530 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.436458 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dtz22\"" Jul 10 15:55:36.437027 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.437005 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 10 15:55:36.437127 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.437112 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 10 15:55:36.442440 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.442423 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 10 15:55:36.448178 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.448150 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zt4rl"] Jul 10 15:55:36.451919 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.451900 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d4547c7c-5ggsk"] Jul 10 15:55:36.452008 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.451996 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zt4rl" Jul 10 15:55:36.454833 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.454812 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 10 15:55:36.454929 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.454842 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 10 15:55:36.455026 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.455008 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lmp9p"] Jul 10 15:55:36.455449 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.455432 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nh8x5\"" Jul 10 15:55:36.458777 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.458761 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lmp9p" Jul 10 15:55:36.461327 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.461307 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zk7gp\"" Jul 10 15:55:36.461816 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.461791 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 10 15:55:36.461884 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.461874 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 10 15:55:36.462128 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.461987 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 10 15:55:36.463428 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.463377 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zt4rl"] Jul 10 15:55:36.469220 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.469201 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lmp9p"] Jul 10 15:55:36.532775 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.532739 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkr9d\" (UniqueName: \"kubernetes.io/projected/48d56fc3-18e8-4b9e-9a0c-9709df62dc73-kube-api-access-mkr9d\") pod \"ingress-canary-lmp9p\" (UID: \"48d56fc3-18e8-4b9e-9a0c-9709df62dc73\") " pod="openshift-ingress-canary/ingress-canary-lmp9p" Jul 10 15:55:36.532959 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.532783 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6z8v\" (UniqueName: \"kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-kube-api-access-c6z8v\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:55:36.532959 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.532810 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/690ed568-a2ec-4a7c-8d75-c11e65ef8733-ca-trust-extracted\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:55:36.532959 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.532832 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-metrics-tls\") pod \"dns-default-zt4rl\" (UID: \"3b56a757-fb1d-4ec7-ad8c-4ea916d2657b\") " pod="openshift-dns/dns-default-zt4rl" Jul 10 15:55:36.532959 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.532852 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-tmp-dir\") pod \"dns-default-zt4rl\" (UID: \"3b56a757-fb1d-4ec7-ad8c-4ea916d2657b\") " pod="openshift-dns/dns-default-zt4rl" Jul 10 15:55:36.532959 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.532880 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpn47\" (UniqueName: \"kubernetes.io/projected/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-kube-api-access-kpn47\") pod \"dns-default-zt4rl\" (UID: \"3b56a757-fb1d-4ec7-ad8c-4ea916d2657b\") " pod="openshift-dns/dns-default-zt4rl" Jul 10 15:55:36.532959 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.532926 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-tls\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:55:36.533165 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.532982 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/690ed568-a2ec-4a7c-8d75-c11e65ef8733-image-registry-private-configuration\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:55:36.533165 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.533001 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/690ed568-a2ec-4a7c-8d75-c11e65ef8733-installation-pull-secrets\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:55:36.533165 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.533026 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/690ed568-a2ec-4a7c-8d75-c11e65ef8733-trusted-ca\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:55:36.533165 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.533054 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-certificates\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:55:36.533165 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.533069 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-bound-sa-token\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:55:36.533165 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.533094 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-config-volume\") pod \"dns-default-zt4rl\" (UID: \"3b56a757-fb1d-4ec7-ad8c-4ea916d2657b\") " pod="openshift-dns/dns-default-zt4rl" Jul 10 15:55:36.533165 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.533114 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48d56fc3-18e8-4b9e-9a0c-9709df62dc73-cert\") pod \"ingress-canary-lmp9p\" (UID: \"48d56fc3-18e8-4b9e-9a0c-9709df62dc73\") " pod="openshift-ingress-canary/ingress-canary-lmp9p" Jul 10 15:55:36.634096 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.634016 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/690ed568-a2ec-4a7c-8d75-c11e65ef8733-trusted-ca\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:55:36.634096 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.634072 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-certificates\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:55:36.634286 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.634206 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-bound-sa-token\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:55:36.634286 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.634242 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-config-volume\") pod \"dns-default-zt4rl\" (UID: \"3b56a757-fb1d-4ec7-ad8c-4ea916d2657b\") " pod="openshift-dns/dns-default-zt4rl" Jul 10 15:55:36.634286 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.634275 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48d56fc3-18e8-4b9e-9a0c-9709df62dc73-cert\") pod \"ingress-canary-lmp9p\" (UID: \"48d56fc3-18e8-4b9e-9a0c-9709df62dc73\") " pod="openshift-ingress-canary/ingress-canary-lmp9p" Jul 10 15:55:36.634427 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.634297 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkr9d\" (UniqueName: \"kubernetes.io/projected/48d56fc3-18e8-4b9e-9a0c-9709df62dc73-kube-api-access-mkr9d\") pod \"ingress-canary-lmp9p\" (UID: \"48d56fc3-18e8-4b9e-9a0c-9709df62dc73\") " pod="openshift-ingress-canary/ingress-canary-lmp9p" Jul 10 15:55:36.634427 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.634367 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6z8v\" (UniqueName: \"kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-kube-api-access-c6z8v\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:55:36.634427 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.634393 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/690ed568-a2ec-4a7c-8d75-c11e65ef8733-ca-trust-extracted\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:55:36.634561 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.634425 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-metrics-tls\") pod \"dns-default-zt4rl\" (UID: \"3b56a757-fb1d-4ec7-ad8c-4ea916d2657b\") " pod="openshift-dns/dns-default-zt4rl" Jul 10 15:55:36.634561 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.634449 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-tmp-dir\") pod \"dns-default-zt4rl\" (UID: \"3b56a757-fb1d-4ec7-ad8c-4ea916d2657b\") " pod="openshift-dns/dns-default-zt4rl" Jul 10 15:55:36.634561 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.634476 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpn47\" (UniqueName: \"kubernetes.io/projected/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-kube-api-access-kpn47\") pod \"dns-default-zt4rl\" (UID: \"3b56a757-fb1d-4ec7-ad8c-4ea916d2657b\") " pod="openshift-dns/dns-default-zt4rl" Jul 10 15:55:36.634561 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.634498 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-tls\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:55:36.634561 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.634554 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/690ed568-a2ec-4a7c-8d75-c11e65ef8733-image-registry-private-configuration\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:55:36.634829 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.634606 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/690ed568-a2ec-4a7c-8d75-c11e65ef8733-installation-pull-secrets\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:55:36.634884 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.634849 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-certificates\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:55:36.634965 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.634936 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-config-volume\") pod \"dns-default-zt4rl\" (UID: \"3b56a757-fb1d-4ec7-ad8c-4ea916d2657b\") " pod="openshift-dns/dns-default-zt4rl" Jul 10 15:55:36.635025 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.634963 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/690ed568-a2ec-4a7c-8d75-c11e65ef8733-ca-trust-extracted\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:55:36.635025 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:36.634946 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 15:55:36.635153 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:36.635136 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-metrics-tls podName:3b56a757-fb1d-4ec7-ad8c-4ea916d2657b nodeName:}" failed. No retries permitted until 2026-07-10 15:55:37.135115821 +0000 UTC m=+36.567600792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-metrics-tls") pod "dns-default-zt4rl" (UID: "3b56a757-fb1d-4ec7-ad8c-4ea916d2657b") : secret "dns-default-metrics-tls" not found Jul 10 15:55:36.635235 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.635143 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-tmp-dir\") pod \"dns-default-zt4rl\" (UID: \"3b56a757-fb1d-4ec7-ad8c-4ea916d2657b\") " pod="openshift-dns/dns-default-zt4rl" Jul 10 15:55:36.635235 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:36.635006 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 15:55:36.635235 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:36.635189 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d4547c7c-5ggsk: secret "image-registry-tls" not found Jul 10 15:55:36.635235 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:36.635219 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-tls podName:690ed568-a2ec-4a7c-8d75-c11e65ef8733 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:37.135210036 +0000 UTC m=+36.567695022 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-tls") pod "image-registry-d4547c7c-5ggsk" (UID: "690ed568-a2ec-4a7c-8d75-c11e65ef8733") : secret "image-registry-tls" not found Jul 10 15:55:36.635848 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.635821 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/690ed568-a2ec-4a7c-8d75-c11e65ef8733-trusted-ca\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:55:36.639300 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.639274 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/690ed568-a2ec-4a7c-8d75-c11e65ef8733-installation-pull-secrets\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:55:36.639300 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.639289 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48d56fc3-18e8-4b9e-9a0c-9709df62dc73-cert\") pod \"ingress-canary-lmp9p\" (UID: \"48d56fc3-18e8-4b9e-9a0c-9709df62dc73\") " pod="openshift-ingress-canary/ingress-canary-lmp9p" Jul 10 15:55:36.639468 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.639289 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/690ed568-a2ec-4a7c-8d75-c11e65ef8733-image-registry-private-configuration\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:55:36.653040 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.653019 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-bound-sa-token\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:55:36.665460 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.665433 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6z8v\" (UniqueName: \"kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-kube-api-access-c6z8v\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:55:36.665710 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.665682 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpn47\" (UniqueName: \"kubernetes.io/projected/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-kube-api-access-kpn47\") pod \"dns-default-zt4rl\" (UID: \"3b56a757-fb1d-4ec7-ad8c-4ea916d2657b\") " pod="openshift-dns/dns-default-zt4rl" Jul 10 15:55:36.665841 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.665711 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkr9d\" (UniqueName: \"kubernetes.io/projected/48d56fc3-18e8-4b9e-9a0c-9709df62dc73-kube-api-access-mkr9d\") pod \"ingress-canary-lmp9p\" (UID: \"48d56fc3-18e8-4b9e-9a0c-9709df62dc73\") " pod="openshift-ingress-canary/ingress-canary-lmp9p" Jul 10 15:55:36.769165 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.769125 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lmp9p" Jul 10 15:55:36.922749 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.922463 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lmp9p"] Jul 10 15:55:36.926256 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:55:36.926229 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48d56fc3_18e8_4b9e_9a0c_9709df62dc73.slice/crio-6f511aa8b7bd3548379eed9b72b1ce5e28c103235e13fd680139e3470c51824f WatchSource:0}: Error finding container 6f511aa8b7bd3548379eed9b72b1ce5e28c103235e13fd680139e3470c51824f: Status 404 returned error can't find the container with id 6f511aa8b7bd3548379eed9b72b1ce5e28c103235e13fd680139e3470c51824f Jul 10 15:55:36.983051 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.983021 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:55:36.983237 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.983157 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:55:36.983662 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.983021 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:55:36.986155 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.986135 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 15:55:36.986260 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.986185 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 15:55:36.986320 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.986145 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8rkdc\"" Jul 10 15:55:36.986441 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.986421 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 15:55:36.986509 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.986459 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 15:55:36.986587 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:36.986421 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2tf4w\"" Jul 10 15:55:37.138848 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:37.138815 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-tls\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:55:37.139031 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:37.138934 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-metrics-tls\") pod \"dns-default-zt4rl\" (UID: \"3b56a757-fb1d-4ec7-ad8c-4ea916d2657b\") " pod="openshift-dns/dns-default-zt4rl" Jul 10 15:55:37.139031 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:37.138968 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 15:55:37.139031 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:37.138986 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d4547c7c-5ggsk: secret "image-registry-tls" not found Jul 10 15:55:37.139172 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:37.139036 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 15:55:37.139172 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:37.139042 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-tls podName:690ed568-a2ec-4a7c-8d75-c11e65ef8733 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:38.13902636 +0000 UTC m=+37.571511332 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-tls") pod "image-registry-d4547c7c-5ggsk" (UID: "690ed568-a2ec-4a7c-8d75-c11e65ef8733") : secret "image-registry-tls" not found Jul 10 15:55:37.139172 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:37.139108 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-metrics-tls podName:3b56a757-fb1d-4ec7-ad8c-4ea916d2657b nodeName:}" failed. No retries permitted until 2026-07-10 15:55:38.139090854 +0000 UTC m=+37.571575845 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-metrics-tls") pod "dns-default-zt4rl" (UID: "3b56a757-fb1d-4ec7-ad8c-4ea916d2657b") : secret "dns-default-metrics-tls" not found Jul 10 15:55:37.216914 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:37.216792 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lmp9p" event={"ID":"48d56fc3-18e8-4b9e-9a0c-9709df62dc73","Type":"ContainerStarted","Data":"6f511aa8b7bd3548379eed9b72b1ce5e28c103235e13fd680139e3470c51824f"} Jul 10 15:55:38.148886 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:38.148849 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-metrics-tls\") pod \"dns-default-zt4rl\" (UID: \"3b56a757-fb1d-4ec7-ad8c-4ea916d2657b\") " pod="openshift-dns/dns-default-zt4rl" Jul 10 15:55:38.148886 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:38.148893 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-tls\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:55:38.149359 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:38.149007 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 15:55:38.149359 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:38.149006 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 15:55:38.149359 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:38.149022 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d4547c7c-5ggsk: secret "image-registry-tls" not found Jul 10 15:55:38.149359 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:38.149085 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-metrics-tls podName:3b56a757-fb1d-4ec7-ad8c-4ea916d2657b nodeName:}" failed. No retries permitted until 2026-07-10 15:55:40.149066917 +0000 UTC m=+39.581551897 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-metrics-tls") pod "dns-default-zt4rl" (UID: "3b56a757-fb1d-4ec7-ad8c-4ea916d2657b") : secret "dns-default-metrics-tls" not found Jul 10 15:55:38.149359 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:38.149155 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-tls podName:690ed568-a2ec-4a7c-8d75-c11e65ef8733 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:40.149134967 +0000 UTC m=+39.581619939 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-tls") pod "image-registry-d4547c7c-5ggsk" (UID: "690ed568-a2ec-4a7c-8d75-c11e65ef8733") : secret "image-registry-tls" not found Jul 10 15:55:40.167615 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:40.167556 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-metrics-tls\") pod \"dns-default-zt4rl\" (UID: \"3b56a757-fb1d-4ec7-ad8c-4ea916d2657b\") " pod="openshift-dns/dns-default-zt4rl" Jul 10 15:55:40.168193 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:40.167643 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-tls\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:55:40.168193 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:40.167685 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 15:55:40.168193 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:40.167749 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 15:55:40.168193 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:40.167761 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-metrics-tls podName:3b56a757-fb1d-4ec7-ad8c-4ea916d2657b nodeName:}" failed. No retries permitted until 2026-07-10 15:55:44.167741153 +0000 UTC m=+43.600226126 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-metrics-tls") pod "dns-default-zt4rl" (UID: "3b56a757-fb1d-4ec7-ad8c-4ea916d2657b") : secret "dns-default-metrics-tls" not found Jul 10 15:55:40.168193 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:40.167765 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d4547c7c-5ggsk: secret "image-registry-tls" not found Jul 10 15:55:40.168193 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:40.167816 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-tls podName:690ed568-a2ec-4a7c-8d75-c11e65ef8733 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:44.167800642 +0000 UTC m=+43.600285619 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-tls") pod "image-registry-d4547c7c-5ggsk" (UID: "690ed568-a2ec-4a7c-8d75-c11e65ef8733") : secret "image-registry-tls" not found Jul 10 15:55:42.230588 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:42.230336 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lmp9p" event={"ID":"48d56fc3-18e8-4b9e-9a0c-9709df62dc73","Type":"ContainerStarted","Data":"c7ebaa6bc96e5c02a3ebb7007a93a36d6702cb38d6389efd1e6de22ca35f7a34"} Jul 10 15:55:42.232934 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:42.232914 2562 generic.go:356] "Generic (PLEG): container finished" podID="67fd65fd-74e1-4c36-914a-b93627e423a7" containerID="f1c390b3512f7508ca7be9f612962ac102f393d836c99a180c1277a9d622c03d" exitCode=0 Jul 10 15:55:42.233046 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:42.232946 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jdrgl" event={"ID":"67fd65fd-74e1-4c36-914a-b93627e423a7","Type":"ContainerDied","Data":"f1c390b3512f7508ca7be9f612962ac102f393d836c99a180c1277a9d622c03d"} Jul 10 15:55:42.247696 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:42.247654 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lmp9p" podStartSLOduration=1.945514138 podStartE2EDuration="6.247640674s" totalImagesPullingTime="4.302126536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:55:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:55:42.247358191 +0000 UTC m=+41.679843190" watchObservedRunningTime="2026-07-10 15:55:42.247640674 +0000 UTC m=+41.680125668" Jul 10 15:55:43.238042 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:43.238009 2562 generic.go:356] "Generic (PLEG): container finished" podID="67fd65fd-74e1-4c36-914a-b93627e423a7" containerID="00f52b71ec71e70cf4c08d8f0afd37438f4a151ce5bae2ac4b9b30f082afffa1" exitCode=0 Jul 10 15:55:43.238527 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:43.238082 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jdrgl" event={"ID":"67fd65fd-74e1-4c36-914a-b93627e423a7","Type":"ContainerDied","Data":"00f52b71ec71e70cf4c08d8f0afd37438f4a151ce5bae2ac4b9b30f082afffa1"} Jul 10 15:55:44.200565 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:44.200522 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-metrics-tls\") pod \"dns-default-zt4rl\" (UID: \"3b56a757-fb1d-4ec7-ad8c-4ea916d2657b\") " pod="openshift-dns/dns-default-zt4rl" Jul 10 15:55:44.200782 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:44.200592 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-tls\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:55:44.200782 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:44.200677 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 15:55:44.200782 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:44.200755 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-metrics-tls podName:3b56a757-fb1d-4ec7-ad8c-4ea916d2657b nodeName:}" failed. No retries permitted until 2026-07-10 15:55:52.200738779 +0000 UTC m=+51.633223751 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-metrics-tls") pod "dns-default-zt4rl" (UID: "3b56a757-fb1d-4ec7-ad8c-4ea916d2657b") : secret "dns-default-metrics-tls" not found Jul 10 15:55:44.200782 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:44.200756 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 15:55:44.200782 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:44.200776 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d4547c7c-5ggsk: secret "image-registry-tls" not found Jul 10 15:55:44.200984 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:44.200836 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-tls podName:690ed568-a2ec-4a7c-8d75-c11e65ef8733 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:52.200817636 +0000 UTC m=+51.633302608 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-tls") pod "image-registry-d4547c7c-5ggsk" (UID: "690ed568-a2ec-4a7c-8d75-c11e65ef8733") : secret "image-registry-tls" not found Jul 10 15:55:44.243635 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:44.243601 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jdrgl" event={"ID":"67fd65fd-74e1-4c36-914a-b93627e423a7","Type":"ContainerStarted","Data":"f4db9cdd61e68ca22fb9ad4a9f879c9a0805b1bab3bc544eeccad0ede36461ae"} Jul 10 15:55:44.268914 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:44.268863 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jdrgl" podStartSLOduration=14.132573373 podStartE2EDuration="43.268846546s" totalImagesPullingTime="29.136273173s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 15:55:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:55:44.267612759 +0000 UTC m=+43.700097755" watchObservedRunningTime="2026-07-10 15:55:44.268846546 +0000 UTC m=+43.701331540" Jul 10 15:55:49.570940 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:49.570902 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxz2"] Jul 10 15:55:49.582829 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:49.582789 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxz2" Jul 10 15:55:49.585262 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:49.585234 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 10 15:55:49.585391 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:49.585287 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qngt7\"" Jul 10 15:55:49.586344 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:49.586330 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 10 15:55:49.586417 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:49.586357 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 10 15:55:49.589323 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:49.589299 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxz2"] Jul 10 15:55:49.741465 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:49.741425 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n96dr\" (UniqueName: \"kubernetes.io/projected/3bf6bcc3-b691-4059-bc5f-5aad0b910fd2-kube-api-access-n96dr\") pod \"cluster-samples-operator-65db858894-hlxz2\" (UID: \"3bf6bcc3-b691-4059-bc5f-5aad0b910fd2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxz2" Jul 10 15:55:49.741705 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:49.741500 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bf6bcc3-b691-4059-bc5f-5aad0b910fd2-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hlxz2\" (UID: \"3bf6bcc3-b691-4059-bc5f-5aad0b910fd2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxz2" Jul 10 15:55:49.842230 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:49.842134 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n96dr\" (UniqueName: \"kubernetes.io/projected/3bf6bcc3-b691-4059-bc5f-5aad0b910fd2-kube-api-access-n96dr\") pod \"cluster-samples-operator-65db858894-hlxz2\" (UID: \"3bf6bcc3-b691-4059-bc5f-5aad0b910fd2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxz2" Jul 10 15:55:49.842230 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:49.842193 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bf6bcc3-b691-4059-bc5f-5aad0b910fd2-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hlxz2\" (UID: \"3bf6bcc3-b691-4059-bc5f-5aad0b910fd2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxz2" Jul 10 15:55:49.842454 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:49.842291 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 15:55:49.842454 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:49.842357 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bf6bcc3-b691-4059-bc5f-5aad0b910fd2-samples-operator-tls podName:3bf6bcc3-b691-4059-bc5f-5aad0b910fd2 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:50.342339474 +0000 UTC m=+49.774824447 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3bf6bcc3-b691-4059-bc5f-5aad0b910fd2-samples-operator-tls") pod "cluster-samples-operator-65db858894-hlxz2" (UID: "3bf6bcc3-b691-4059-bc5f-5aad0b910fd2") : secret "samples-operator-tls" not found Jul 10 15:55:49.854203 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:49.854180 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n96dr\" (UniqueName: \"kubernetes.io/projected/3bf6bcc3-b691-4059-bc5f-5aad0b910fd2-kube-api-access-n96dr\") pod \"cluster-samples-operator-65db858894-hlxz2\" (UID: \"3bf6bcc3-b691-4059-bc5f-5aad0b910fd2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxz2" Jul 10 15:55:50.345356 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:50.345318 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bf6bcc3-b691-4059-bc5f-5aad0b910fd2-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hlxz2\" (UID: \"3bf6bcc3-b691-4059-bc5f-5aad0b910fd2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxz2" Jul 10 15:55:50.345519 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:50.345442 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 15:55:50.345519 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:50.345506 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bf6bcc3-b691-4059-bc5f-5aad0b910fd2-samples-operator-tls podName:3bf6bcc3-b691-4059-bc5f-5aad0b910fd2 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:51.345491965 +0000 UTC m=+50.777976938 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3bf6bcc3-b691-4059-bc5f-5aad0b910fd2-samples-operator-tls") pod "cluster-samples-operator-65db858894-hlxz2" (UID: "3bf6bcc3-b691-4059-bc5f-5aad0b910fd2") : secret "samples-operator-tls" not found Jul 10 15:55:51.352630 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:51.352588 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bf6bcc3-b691-4059-bc5f-5aad0b910fd2-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hlxz2\" (UID: \"3bf6bcc3-b691-4059-bc5f-5aad0b910fd2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxz2" Jul 10 15:55:51.353037 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:51.352745 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 15:55:51.353037 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:51.352829 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bf6bcc3-b691-4059-bc5f-5aad0b910fd2-samples-operator-tls podName:3bf6bcc3-b691-4059-bc5f-5aad0b910fd2 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:53.352812093 +0000 UTC m=+52.785297065 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3bf6bcc3-b691-4059-bc5f-5aad0b910fd2-samples-operator-tls") pod "cluster-samples-operator-65db858894-hlxz2" (UID: "3bf6bcc3-b691-4059-bc5f-5aad0b910fd2") : secret "samples-operator-tls" not found Jul 10 15:55:52.258930 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:52.258896 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-metrics-tls\") pod \"dns-default-zt4rl\" (UID: \"3b56a757-fb1d-4ec7-ad8c-4ea916d2657b\") " pod="openshift-dns/dns-default-zt4rl" Jul 10 15:55:52.259120 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:52.258940 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-tls\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:55:52.259120 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:52.259036 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 15:55:52.259120 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:52.259036 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 15:55:52.259120 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:52.259048 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d4547c7c-5ggsk: secret "image-registry-tls" not found Jul 10 15:55:52.259120 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:52.259109 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-tls podName:690ed568-a2ec-4a7c-8d75-c11e65ef8733 nodeName:}" failed. No retries permitted until 2026-07-10 15:56:08.259093279 +0000 UTC m=+67.691578270 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-tls") pod "image-registry-d4547c7c-5ggsk" (UID: "690ed568-a2ec-4a7c-8d75-c11e65ef8733") : secret "image-registry-tls" not found Jul 10 15:55:52.259307 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:52.259177 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-metrics-tls podName:3b56a757-fb1d-4ec7-ad8c-4ea916d2657b nodeName:}" failed. No retries permitted until 2026-07-10 15:56:08.259160649 +0000 UTC m=+67.691645626 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-metrics-tls") pod "dns-default-zt4rl" (UID: "3b56a757-fb1d-4ec7-ad8c-4ea916d2657b") : secret "dns-default-metrics-tls" not found Jul 10 15:55:53.367763 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:53.367721 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bf6bcc3-b691-4059-bc5f-5aad0b910fd2-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hlxz2\" (UID: \"3bf6bcc3-b691-4059-bc5f-5aad0b910fd2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxz2" Jul 10 15:55:53.368214 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:53.367870 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 15:55:53.368214 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:53.367936 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bf6bcc3-b691-4059-bc5f-5aad0b910fd2-samples-operator-tls podName:3bf6bcc3-b691-4059-bc5f-5aad0b910fd2 nodeName:}" failed. No retries permitted until 2026-07-10 15:55:57.367920177 +0000 UTC m=+56.800405148 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3bf6bcc3-b691-4059-bc5f-5aad0b910fd2-samples-operator-tls") pod "cluster-samples-operator-65db858894-hlxz2" (UID: "3bf6bcc3-b691-4059-bc5f-5aad0b910fd2") : secret "samples-operator-tls" not found Jul 10 15:55:56.117785 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:56.117750 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jnx2h"] Jul 10 15:55:56.120869 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:56.120844 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jnx2h" Jul 10 15:55:56.124287 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:56.124268 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 10 15:55:56.125543 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:56.125526 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 10 15:55:56.125680 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:56.125652 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-k6kc2\"" Jul 10 15:55:56.125896 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:56.125871 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 10 15:55:56.129877 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:56.129862 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 10 15:55:56.154126 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:56.154096 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jnx2h"] Jul 10 15:55:56.286763 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:56.286718 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jnx2h\" (UID: \"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa\") " pod="openshift-insights/insights-runtime-extractor-jnx2h" Jul 10 15:55:56.286763 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:56.286764 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndzkf\" (UniqueName: \"kubernetes.io/projected/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-kube-api-access-ndzkf\") pod \"insights-runtime-extractor-jnx2h\" (UID: \"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa\") " pod="openshift-insights/insights-runtime-extractor-jnx2h" Jul 10 15:55:56.286969 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:56.286882 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-crio-socket\") pod \"insights-runtime-extractor-jnx2h\" (UID: \"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa\") " pod="openshift-insights/insights-runtime-extractor-jnx2h" Jul 10 15:55:56.286969 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:56.286936 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jnx2h\" (UID: \"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa\") " pod="openshift-insights/insights-runtime-extractor-jnx2h" Jul 10 15:55:56.286969 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:56.286958 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-data-volume\") pod \"insights-runtime-extractor-jnx2h\" (UID: \"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa\") " pod="openshift-insights/insights-runtime-extractor-jnx2h" Jul 10 15:55:56.387332 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:56.387244 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jnx2h\" (UID: \"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa\") " pod="openshift-insights/insights-runtime-extractor-jnx2h" Jul 10 15:55:56.387332 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:56.387283 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-data-volume\") pod \"insights-runtime-extractor-jnx2h\" (UID: \"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa\") " pod="openshift-insights/insights-runtime-extractor-jnx2h" Jul 10 15:55:56.387332 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:56.387305 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jnx2h\" (UID: \"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa\") " pod="openshift-insights/insights-runtime-extractor-jnx2h" Jul 10 15:55:56.387332 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:56.387321 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndzkf\" (UniqueName: \"kubernetes.io/projected/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-kube-api-access-ndzkf\") pod \"insights-runtime-extractor-jnx2h\" (UID: \"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa\") " pod="openshift-insights/insights-runtime-extractor-jnx2h" Jul 10 15:55:56.387612 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:56.387368 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 15:55:56.387612 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:56.387382 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-crio-socket\") pod \"insights-runtime-extractor-jnx2h\" (UID: \"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa\") " pod="openshift-insights/insights-runtime-extractor-jnx2h" Jul 10 15:55:56.387612 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:56.387434 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 15:55:56.387612 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:56.387447 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-kube-rbac-proxy-cm podName:f8d26c3e-e5d8-41f5-99f9-549e804fbeaa nodeName:}" failed. No retries permitted until 2026-07-10 15:55:56.88742547 +0000 UTC m=+56.319910463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jnx2h" (UID: "f8d26c3e-e5d8-41f5-99f9-549e804fbeaa") : configmap "kube-rbac-proxy" not found Jul 10 15:55:56.387612 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:56.387511 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-insights-runtime-extractor-tls podName:f8d26c3e-e5d8-41f5-99f9-549e804fbeaa nodeName:}" failed. No retries permitted until 2026-07-10 15:55:56.887491485 +0000 UTC m=+56.319976460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jnx2h" (UID: "f8d26c3e-e5d8-41f5-99f9-549e804fbeaa") : secret "insights-runtime-extractor-tls" not found Jul 10 15:55:56.387612 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:56.387557 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-crio-socket\") pod \"insights-runtime-extractor-jnx2h\" (UID: \"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa\") " pod="openshift-insights/insights-runtime-extractor-jnx2h" Jul 10 15:55:56.387862 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:56.387652 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-data-volume\") pod \"insights-runtime-extractor-jnx2h\" (UID: \"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa\") " pod="openshift-insights/insights-runtime-extractor-jnx2h" Jul 10 15:55:56.401771 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:56.401753 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndzkf\" (UniqueName: \"kubernetes.io/projected/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-kube-api-access-ndzkf\") pod \"insights-runtime-extractor-jnx2h\" (UID: \"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa\") " pod="openshift-insights/insights-runtime-extractor-jnx2h" Jul 10 15:55:56.890735 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:56.890705 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jnx2h\" (UID: \"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa\") " pod="openshift-insights/insights-runtime-extractor-jnx2h" Jul 10 15:55:56.890904 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:56.890749 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jnx2h\" (UID: \"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa\") " pod="openshift-insights/insights-runtime-extractor-jnx2h" Jul 10 15:55:56.890904 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:56.890829 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 15:55:56.890904 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:56.890846 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 15:55:56.890904 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:56.890893 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-kube-rbac-proxy-cm podName:f8d26c3e-e5d8-41f5-99f9-549e804fbeaa nodeName:}" failed. No retries permitted until 2026-07-10 15:55:57.890877581 +0000 UTC m=+57.323362553 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jnx2h" (UID: "f8d26c3e-e5d8-41f5-99f9-549e804fbeaa") : configmap "kube-rbac-proxy" not found Jul 10 15:55:56.891034 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:56.890906 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-insights-runtime-extractor-tls podName:f8d26c3e-e5d8-41f5-99f9-549e804fbeaa nodeName:}" failed. No retries permitted until 2026-07-10 15:55:57.890900523 +0000 UTC m=+57.323385495 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jnx2h" (UID: "f8d26c3e-e5d8-41f5-99f9-549e804fbeaa") : secret "insights-runtime-extractor-tls" not found Jul 10 15:55:57.393832 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:57.393795 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bf6bcc3-b691-4059-bc5f-5aad0b910fd2-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hlxz2\" (UID: \"3bf6bcc3-b691-4059-bc5f-5aad0b910fd2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxz2" Jul 10 15:55:57.394176 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:57.393956 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 15:55:57.394176 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:57.394026 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bf6bcc3-b691-4059-bc5f-5aad0b910fd2-samples-operator-tls podName:3bf6bcc3-b691-4059-bc5f-5aad0b910fd2 nodeName:}" failed. No retries permitted until 2026-07-10 15:56:05.39400805 +0000 UTC m=+64.826493034 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3bf6bcc3-b691-4059-bc5f-5aad0b910fd2-samples-operator-tls") pod "cluster-samples-operator-65db858894-hlxz2" (UID: "3bf6bcc3-b691-4059-bc5f-5aad0b910fd2") : secret "samples-operator-tls" not found Jul 10 15:55:57.898086 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:57.898037 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jnx2h\" (UID: \"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa\") " pod="openshift-insights/insights-runtime-extractor-jnx2h" Jul 10 15:55:57.898086 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:57.898091 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jnx2h\" (UID: \"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa\") " pod="openshift-insights/insights-runtime-extractor-jnx2h" Jul 10 15:55:57.898307 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:57.898167 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 15:55:57.898307 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:57.898231 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 15:55:57.898307 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:57.898256 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-kube-rbac-proxy-cm podName:f8d26c3e-e5d8-41f5-99f9-549e804fbeaa nodeName:}" failed. No retries permitted until 2026-07-10 15:55:59.8982397 +0000 UTC m=+59.330724671 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jnx2h" (UID: "f8d26c3e-e5d8-41f5-99f9-549e804fbeaa") : configmap "kube-rbac-proxy" not found Jul 10 15:55:57.898307 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:57.898273 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-insights-runtime-extractor-tls podName:f8d26c3e-e5d8-41f5-99f9-549e804fbeaa nodeName:}" failed. No retries permitted until 2026-07-10 15:55:59.898262497 +0000 UTC m=+59.330747470 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jnx2h" (UID: "f8d26c3e-e5d8-41f5-99f9-549e804fbeaa") : secret "insights-runtime-extractor-tls" not found Jul 10 15:55:57.991081 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:57.991050 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-k4mj7"] Jul 10 15:55:57.993306 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:57.993290 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-k4mj7" Jul 10 15:55:57.995914 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:57.995889 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 10 15:55:57.996040 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:57.995982 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-gpq2j\"" Jul 10 15:55:57.997081 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:57.997060 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 10 15:55:57.997175 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:57.997062 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 10 15:55:57.997175 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:57.997114 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 10 15:55:58.004141 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:58.004121 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-k4mj7"] Jul 10 15:55:58.099419 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:58.099366 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/31539787-43c9-40e7-880d-a1003fd90913-signing-cabundle\") pod \"service-ca-79f68b9f4f-k4mj7\" (UID: \"31539787-43c9-40e7-880d-a1003fd90913\") " pod="openshift-service-ca/service-ca-79f68b9f4f-k4mj7" Jul 10 15:55:58.099650 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:58.099472 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf8mc\" (UniqueName: \"kubernetes.io/projected/31539787-43c9-40e7-880d-a1003fd90913-kube-api-access-pf8mc\") pod \"service-ca-79f68b9f4f-k4mj7\" (UID: \"31539787-43c9-40e7-880d-a1003fd90913\") " pod="openshift-service-ca/service-ca-79f68b9f4f-k4mj7" Jul 10 15:55:58.099650 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:58.099526 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/31539787-43c9-40e7-880d-a1003fd90913-signing-key\") pod \"service-ca-79f68b9f4f-k4mj7\" (UID: \"31539787-43c9-40e7-880d-a1003fd90913\") " pod="openshift-service-ca/service-ca-79f68b9f4f-k4mj7" Jul 10 15:55:58.200351 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:58.200264 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/31539787-43c9-40e7-880d-a1003fd90913-signing-key\") pod \"service-ca-79f68b9f4f-k4mj7\" (UID: \"31539787-43c9-40e7-880d-a1003fd90913\") " pod="openshift-service-ca/service-ca-79f68b9f4f-k4mj7" Jul 10 15:55:58.200351 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:58.200340 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/31539787-43c9-40e7-880d-a1003fd90913-signing-cabundle\") pod \"service-ca-79f68b9f4f-k4mj7\" (UID: \"31539787-43c9-40e7-880d-a1003fd90913\") " pod="openshift-service-ca/service-ca-79f68b9f4f-k4mj7" Jul 10 15:55:58.200552 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:58.200399 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf8mc\" (UniqueName: \"kubernetes.io/projected/31539787-43c9-40e7-880d-a1003fd90913-kube-api-access-pf8mc\") pod \"service-ca-79f68b9f4f-k4mj7\" (UID: \"31539787-43c9-40e7-880d-a1003fd90913\") " pod="openshift-service-ca/service-ca-79f68b9f4f-k4mj7" Jul 10 15:55:58.201114 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:58.201089 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/31539787-43c9-40e7-880d-a1003fd90913-signing-cabundle\") pod \"service-ca-79f68b9f4f-k4mj7\" (UID: \"31539787-43c9-40e7-880d-a1003fd90913\") " pod="openshift-service-ca/service-ca-79f68b9f4f-k4mj7" Jul 10 15:55:58.202799 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:58.202780 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/31539787-43c9-40e7-880d-a1003fd90913-signing-key\") pod \"service-ca-79f68b9f4f-k4mj7\" (UID: \"31539787-43c9-40e7-880d-a1003fd90913\") " pod="openshift-service-ca/service-ca-79f68b9f4f-k4mj7" Jul 10 15:55:58.209217 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:58.209196 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf8mc\" (UniqueName: \"kubernetes.io/projected/31539787-43c9-40e7-880d-a1003fd90913-kube-api-access-pf8mc\") pod \"service-ca-79f68b9f4f-k4mj7\" (UID: \"31539787-43c9-40e7-880d-a1003fd90913\") " pod="openshift-service-ca/service-ca-79f68b9f4f-k4mj7" Jul 10 15:55:58.301921 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:58.301894 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-k4mj7" Jul 10 15:55:58.442352 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:58.442325 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-k4mj7"] Jul 10 15:55:58.691984 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:58.691956 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9j2fq_992584b5-85e4-4c18-aef4-254269d9b483/dns-node-resolver/0.log" Jul 10 15:55:59.282622 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:59.282560 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-k4mj7" event={"ID":"31539787-43c9-40e7-880d-a1003fd90913","Type":"ContainerStarted","Data":"a64d449bba99cdc032db97f067f04d30c60bb7cd3f257ef8180cbda1ac48580b"} Jul 10 15:55:59.916707 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:59.916673 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jnx2h\" (UID: \"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa\") " pod="openshift-insights/insights-runtime-extractor-jnx2h" Jul 10 15:55:59.917120 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:55:59.916718 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jnx2h\" (UID: \"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa\") " pod="openshift-insights/insights-runtime-extractor-jnx2h" Jul 10 15:55:59.917120 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:59.916801 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 15:55:59.917120 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:59.916868 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 15:55:59.917120 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:59.916880 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-kube-rbac-proxy-cm podName:f8d26c3e-e5d8-41f5-99f9-549e804fbeaa nodeName:}" failed. No retries permitted until 2026-07-10 15:56:03.916861196 +0000 UTC m=+63.349346182 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jnx2h" (UID: "f8d26c3e-e5d8-41f5-99f9-549e804fbeaa") : configmap "kube-rbac-proxy" not found Jul 10 15:55:59.917120 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:55:59.916910 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-insights-runtime-extractor-tls podName:f8d26c3e-e5d8-41f5-99f9-549e804fbeaa nodeName:}" failed. No retries permitted until 2026-07-10 15:56:03.916900963 +0000 UTC m=+63.349385935 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jnx2h" (UID: "f8d26c3e-e5d8-41f5-99f9-549e804fbeaa") : secret "insights-runtime-extractor-tls" not found Jul 10 15:56:00.094705 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:00.094665 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m94m9_2bcb7a5c-1cb1-4c2e-aa53-fd5dad33c1ce/node-ca/0.log" Jul 10 15:56:00.889445 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:00.889392 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lmp9p_48d56fc3-18e8-4b9e-9a0c-9709df62dc73/serve-healthcheck-canary/0.log" Jul 10 15:56:01.288614 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:01.288564 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-k4mj7" event={"ID":"31539787-43c9-40e7-880d-a1003fd90913","Type":"ContainerStarted","Data":"404c4f187c1ef22cb0d2802287f6f951068798291ab03eec0e68346b201f4308"} Jul 10 15:56:01.307177 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:01.307123 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-k4mj7" podStartSLOduration=2.2947002579999998 podStartE2EDuration="4.307107956s" totalImagesPullingTime="2.012407698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:55:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:01.30607681 +0000 UTC m=+60.738561804" watchObservedRunningTime="2026-07-10 15:56:01.307107956 +0000 UTC m=+60.739592981" Jul 10 15:56:02.217649 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:02.217615 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4p9m2" Jul 10 15:56:03.952851 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:03.952807 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jnx2h\" (UID: \"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa\") " pod="openshift-insights/insights-runtime-extractor-jnx2h" Jul 10 15:56:03.953270 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:03.952859 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jnx2h\" (UID: \"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa\") " pod="openshift-insights/insights-runtime-extractor-jnx2h" Jul 10 15:56:03.953270 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:56:03.952923 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 15:56:03.953270 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:56:03.952981 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 15:56:03.953270 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:56:03.952999 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-kube-rbac-proxy-cm podName:f8d26c3e-e5d8-41f5-99f9-549e804fbeaa nodeName:}" failed. No retries permitted until 2026-07-10 15:56:11.952981533 +0000 UTC m=+71.385466506 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jnx2h" (UID: "f8d26c3e-e5d8-41f5-99f9-549e804fbeaa") : configmap "kube-rbac-proxy" not found Jul 10 15:56:03.953270 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:56:03.953036 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-insights-runtime-extractor-tls podName:f8d26c3e-e5d8-41f5-99f9-549e804fbeaa nodeName:}" failed. No retries permitted until 2026-07-10 15:56:11.953020393 +0000 UTC m=+71.385505385 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jnx2h" (UID: "f8d26c3e-e5d8-41f5-99f9-549e804fbeaa") : secret "insights-runtime-extractor-tls" not found Jul 10 15:56:05.461825 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:05.461787 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bf6bcc3-b691-4059-bc5f-5aad0b910fd2-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hlxz2\" (UID: \"3bf6bcc3-b691-4059-bc5f-5aad0b910fd2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxz2" Jul 10 15:56:05.464269 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:05.464247 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bf6bcc3-b691-4059-bc5f-5aad0b910fd2-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hlxz2\" (UID: \"3bf6bcc3-b691-4059-bc5f-5aad0b910fd2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxz2" Jul 10 15:56:05.500901 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:05.500875 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qngt7\"" Jul 10 15:56:05.509048 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:05.509022 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxz2" Jul 10 15:56:05.633478 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:05.633444 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxz2"] Jul 10 15:56:06.300974 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:06.300933 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxz2" event={"ID":"3bf6bcc3-b691-4059-bc5f-5aad0b910fd2","Type":"ContainerStarted","Data":"a5e143c0ab4150ba23812e87b0010070cad466142e0e5ddd73d76e2ffa63efa7"} Jul 10 15:56:06.669436 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:06.669336 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btwpt\" (UniqueName: \"kubernetes.io/projected/a7af48f4-6437-4c48-b20f-731923004f10-kube-api-access-btwpt\") pod \"network-check-target-cmq2z\" (UID: \"a7af48f4-6437-4c48-b20f-731923004f10\") " pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:56:06.669436 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:06.669385 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30cc000d-f3a7-453b-a542-d3f9af19fefb-metrics-certs\") pod \"network-metrics-daemon-b9hg4\" (UID: \"30cc000d-f3a7-453b-a542-d3f9af19fefb\") " pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:56:06.672425 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:06.672402 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 15:56:06.672531 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:06.672422 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 15:56:06.679597 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:56:06.679564 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 10 15:56:06.679676 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:56:06.679665 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30cc000d-f3a7-453b-a542-d3f9af19fefb-metrics-certs podName:30cc000d-f3a7-453b-a542-d3f9af19fefb nodeName:}" failed. No retries permitted until 2026-07-10 15:57:10.679647197 +0000 UTC m=+130.112132169 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30cc000d-f3a7-453b-a542-d3f9af19fefb-metrics-certs") pod "network-metrics-daemon-b9hg4" (UID: "30cc000d-f3a7-453b-a542-d3f9af19fefb") : secret "metrics-daemon-secret" not found Jul 10 15:56:06.682373 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:06.682358 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 15:56:06.692337 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:06.692313 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btwpt\" (UniqueName: \"kubernetes.io/projected/a7af48f4-6437-4c48-b20f-731923004f10-kube-api-access-btwpt\") pod \"network-check-target-cmq2z\" (UID: \"a7af48f4-6437-4c48-b20f-731923004f10\") " pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:56:06.705881 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:06.705856 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2tf4w\"" Jul 10 15:56:06.713200 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:06.713180 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:56:06.771240 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:06.770806 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bfcca1c-4216-4bff-afc4-751789a422f1-original-pull-secret\") pod \"global-pull-secret-syncer-rw8tw\" (UID: \"6bfcca1c-4216-4bff-afc4-751789a422f1\") " pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:56:06.774083 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:06.773829 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 15:56:06.786628 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:06.786599 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bfcca1c-4216-4bff-afc4-751789a422f1-original-pull-secret\") pod \"global-pull-secret-syncer-rw8tw\" (UID: \"6bfcca1c-4216-4bff-afc4-751789a422f1\") " pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:56:06.853449 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:06.853418 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cmq2z"] Jul 10 15:56:06.856657 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:56:06.856624 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7af48f4_6437_4c48_b20f_731923004f10.slice/crio-516e4502f24c43d247ebc482f0013f3524b0bd6012434ad027a5efa4ce114ff7 WatchSource:0}: Error finding container 516e4502f24c43d247ebc482f0013f3524b0bd6012434ad027a5efa4ce114ff7: Status 404 returned error can't find the container with id 516e4502f24c43d247ebc482f0013f3524b0bd6012434ad027a5efa4ce114ff7 Jul 10 15:56:07.008959 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:07.008876 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw8tw" Jul 10 15:56:07.138234 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:07.138201 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rw8tw"] Jul 10 15:56:07.140934 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:56:07.140908 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bfcca1c_4216_4bff_afc4_751789a422f1.slice/crio-fa4a55f9577a35428e7dba73580889d78ed1b97075a34890d41491a63a884ab8 WatchSource:0}: Error finding container fa4a55f9577a35428e7dba73580889d78ed1b97075a34890d41491a63a884ab8: Status 404 returned error can't find the container with id fa4a55f9577a35428e7dba73580889d78ed1b97075a34890d41491a63a884ab8 Jul 10 15:56:07.305235 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:07.305196 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cmq2z" event={"ID":"a7af48f4-6437-4c48-b20f-731923004f10","Type":"ContainerStarted","Data":"516e4502f24c43d247ebc482f0013f3524b0bd6012434ad027a5efa4ce114ff7"} Jul 10 15:56:07.306334 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:07.306305 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rw8tw" event={"ID":"6bfcca1c-4216-4bff-afc4-751789a422f1","Type":"ContainerStarted","Data":"fa4a55f9577a35428e7dba73580889d78ed1b97075a34890d41491a63a884ab8"} Jul 10 15:56:08.284521 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:08.284477 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-metrics-tls\") pod \"dns-default-zt4rl\" (UID: \"3b56a757-fb1d-4ec7-ad8c-4ea916d2657b\") " pod="openshift-dns/dns-default-zt4rl" Jul 10 15:56:08.285021 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:08.284548 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-tls\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:56:08.290292 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:08.290261 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b56a757-fb1d-4ec7-ad8c-4ea916d2657b-metrics-tls\") pod \"dns-default-zt4rl\" (UID: \"3b56a757-fb1d-4ec7-ad8c-4ea916d2657b\") " pod="openshift-dns/dns-default-zt4rl" Jul 10 15:56:08.292074 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:08.292051 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-tls\") pod \"image-registry-d4547c7c-5ggsk\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:56:08.546720 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:08.546522 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dtz22\"" Jul 10 15:56:08.554600 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:08.554543 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:56:08.565070 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:08.565045 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nh8x5\"" Jul 10 15:56:08.573047 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:08.572807 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zt4rl" Jul 10 15:56:08.764177 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:08.763949 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d4547c7c-5ggsk"] Jul 10 15:56:08.766931 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:56:08.766905 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod690ed568_a2ec_4a7c_8d75_c11e65ef8733.slice/crio-2b4151ba34fa4e9ff0c3da8222c922558bef6f4e04dcc5895521a47c66ced9cf WatchSource:0}: Error finding container 2b4151ba34fa4e9ff0c3da8222c922558bef6f4e04dcc5895521a47c66ced9cf: Status 404 returned error can't find the container with id 2b4151ba34fa4e9ff0c3da8222c922558bef6f4e04dcc5895521a47c66ced9cf Jul 10 15:56:08.780261 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:08.780227 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zt4rl"] Jul 10 15:56:08.787637 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:56:08.787605 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b56a757_fb1d_4ec7_ad8c_4ea916d2657b.slice/crio-05f491817618efbfc33e5b51d16b220e216709cd46d3df2fb50651e79a8f22bc WatchSource:0}: Error finding container 05f491817618efbfc33e5b51d16b220e216709cd46d3df2fb50651e79a8f22bc: Status 404 returned error can't find the container with id 05f491817618efbfc33e5b51d16b220e216709cd46d3df2fb50651e79a8f22bc Jul 10 15:56:09.315225 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:09.314962 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" event={"ID":"690ed568-a2ec-4a7c-8d75-c11e65ef8733","Type":"ContainerStarted","Data":"14a279bfe79a0d004e1fa6f6619923f4ace95473f6c07d4fe7dbd802bddbbbe7"} Jul 10 15:56:09.315225 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:09.315023 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" event={"ID":"690ed568-a2ec-4a7c-8d75-c11e65ef8733","Type":"ContainerStarted","Data":"2b4151ba34fa4e9ff0c3da8222c922558bef6f4e04dcc5895521a47c66ced9cf"} Jul 10 15:56:09.315225 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:09.315046 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:56:09.317811 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:09.317776 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxz2" event={"ID":"3bf6bcc3-b691-4059-bc5f-5aad0b910fd2","Type":"ContainerStarted","Data":"b48b505711be1c20973a7d78b035fedc4d49ca7e9ce33145e318aa23a02e7b71"} Jul 10 15:56:09.317939 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:09.317826 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxz2" event={"ID":"3bf6bcc3-b691-4059-bc5f-5aad0b910fd2","Type":"ContainerStarted","Data":"5d4d8a642909253371d8071493d4c61137f02d888d2ade8ed80b55863bfac63a"} Jul 10 15:56:09.319069 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:09.319048 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zt4rl" event={"ID":"3b56a757-fb1d-4ec7-ad8c-4ea916d2657b","Type":"ContainerStarted","Data":"05f491817618efbfc33e5b51d16b220e216709cd46d3df2fb50651e79a8f22bc"} Jul 10 15:56:09.338990 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:09.338931 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" podStartSLOduration=68.338912839 podStartE2EDuration="1m8.338912839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:55:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:09.337754867 +0000 UTC m=+68.770239862" watchObservedRunningTime="2026-07-10 15:56:09.338912839 +0000 UTC m=+68.771397827" Jul 10 15:56:12.015684 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:12.015638 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jnx2h\" (UID: \"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa\") " pod="openshift-insights/insights-runtime-extractor-jnx2h" Jul 10 15:56:12.016192 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:12.015699 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jnx2h\" (UID: \"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa\") " pod="openshift-insights/insights-runtime-extractor-jnx2h" Jul 10 15:56:12.016192 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:56:12.015854 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 15:56:12.016192 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:56:12.015939 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-insights-runtime-extractor-tls podName:f8d26c3e-e5d8-41f5-99f9-549e804fbeaa nodeName:}" failed. No retries permitted until 2026-07-10 15:56:28.015916996 +0000 UTC m=+87.448401992 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jnx2h" (UID: "f8d26c3e-e5d8-41f5-99f9-549e804fbeaa") : secret "insights-runtime-extractor-tls" not found Jul 10 15:56:12.016305 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:12.016269 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jnx2h\" (UID: \"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa\") " pod="openshift-insights/insights-runtime-extractor-jnx2h" Jul 10 15:56:13.332918 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:13.332879 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cmq2z" event={"ID":"a7af48f4-6437-4c48-b20f-731923004f10","Type":"ContainerStarted","Data":"9fc39d80c66c384b28a26463faef56af881c3daad1421d1d88d0b3f2f9f4e7c5"} Jul 10 15:56:13.333375 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:13.332940 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:56:13.334273 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:13.334253 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rw8tw" event={"ID":"6bfcca1c-4216-4bff-afc4-751789a422f1","Type":"ContainerStarted","Data":"d981d0cd202a6ad83c187ee9707d6f7207a3acff0edc43c06e78020aca97b619"} Jul 10 15:56:13.335865 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:13.335842 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zt4rl" event={"ID":"3b56a757-fb1d-4ec7-ad8c-4ea916d2657b","Type":"ContainerStarted","Data":"574371066ddc478f70ef7d12898d7158da962dc833562fc4521ed0548525db79"} Jul 10 15:56:13.335936 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:13.335891 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zt4rl" event={"ID":"3b56a757-fb1d-4ec7-ad8c-4ea916d2657b","Type":"ContainerStarted","Data":"0948c6bd497a908e5c19c210cf81da35d611a24a64cbd9a621b1e0861315b97b"} Jul 10 15:56:13.335936 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:13.335920 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zt4rl" Jul 10 15:56:13.351551 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:13.351509 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxz2" podStartSLOduration=21.594104041 podStartE2EDuration="24.351495419s" totalImagesPullingTime="2.757391378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:55:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:09.357503671 +0000 UTC m=+68.789988666" watchObservedRunningTime="2026-07-10 15:56:13.351495419 +0000 UTC m=+72.783980458" Jul 10 15:56:13.351885 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:13.351861 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cmq2z" podStartSLOduration=66.2972452 podStartE2EDuration="1m12.351854936s" totalImagesPullingTime="6.054609736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:13.350887286 +0000 UTC m=+72.783372280" watchObservedRunningTime="2026-07-10 15:56:13.351854936 +0000 UTC m=+72.784339931" Jul 10 15:56:13.367279 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:13.367237 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rw8tw" podStartSLOduration=66.582785913 podStartE2EDuration="1m12.367223896s" totalImagesPullingTime="5.784437983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 15:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:13.367006382 +0000 UTC m=+72.799491380" watchObservedRunningTime="2026-07-10 15:56:13.367223896 +0000 UTC m=+72.799708890" Jul 10 15:56:13.385414 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:13.385371 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zt4rl" podStartSLOduration=33.258508125 podStartE2EDuration="37.385358326s" totalImagesPullingTime="4.126850201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:55:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:13.384956677 +0000 UTC m=+72.817441672" watchObservedRunningTime="2026-07-10 15:56:13.385358326 +0000 UTC m=+72.817843319" Jul 10 15:56:22.240272 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.240141 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-678f47577f-rqzkj"] Jul 10 15:56:22.243078 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.243061 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-678f47577f-rqzkj" Jul 10 15:56:22.253172 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.253150 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 10 15:56:22.253284 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.253152 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 10 15:56:22.267006 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.266983 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 10 15:56:22.267278 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.267260 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 10 15:56:22.285732 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.285704 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-678f47577f-rqzkj"] Jul 10 15:56:22.286915 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.286892 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z7qx\" (UniqueName: \"kubernetes.io/projected/c45726e5-0bb8-40bc-a632-658103a1df3d-kube-api-access-8z7qx\") pod \"klusterlet-addon-workmgr-678f47577f-rqzkj\" (UID: \"c45726e5-0bb8-40bc-a632-658103a1df3d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-678f47577f-rqzkj" Jul 10 15:56:22.287043 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.286919 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c45726e5-0bb8-40bc-a632-658103a1df3d-tmp\") pod \"klusterlet-addon-workmgr-678f47577f-rqzkj\" (UID: \"c45726e5-0bb8-40bc-a632-658103a1df3d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-678f47577f-rqzkj" Jul 10 15:56:22.287043 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.286951 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c45726e5-0bb8-40bc-a632-658103a1df3d-klusterlet-config\") pod \"klusterlet-addon-workmgr-678f47577f-rqzkj\" (UID: \"c45726e5-0bb8-40bc-a632-658103a1df3d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-678f47577f-rqzkj" Jul 10 15:56:22.338316 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.338280 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-pllvl"] Jul 10 15:56:22.341203 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.341180 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-pllvl" Jul 10 15:56:22.346136 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.346117 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-rbsx6\"" Jul 10 15:56:22.348779 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.348762 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 10 15:56:22.352423 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.352409 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 10 15:56:22.381334 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.381303 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-pllvl"] Jul 10 15:56:22.388144 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.388115 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqg6k\" (UniqueName: \"kubernetes.io/projected/6ac43d12-b6fd-4a8d-b41d-ecd8f9e60dba-kube-api-access-jqg6k\") pod \"downloads-68c9cbb497-pllvl\" (UID: \"6ac43d12-b6fd-4a8d-b41d-ecd8f9e60dba\") " pod="openshift-console/downloads-68c9cbb497-pllvl" Jul 10 15:56:22.388251 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.388173 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z7qx\" (UniqueName: \"kubernetes.io/projected/c45726e5-0bb8-40bc-a632-658103a1df3d-kube-api-access-8z7qx\") pod \"klusterlet-addon-workmgr-678f47577f-rqzkj\" (UID: \"c45726e5-0bb8-40bc-a632-658103a1df3d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-678f47577f-rqzkj" Jul 10 15:56:22.388251 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.388196 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c45726e5-0bb8-40bc-a632-658103a1df3d-tmp\") pod \"klusterlet-addon-workmgr-678f47577f-rqzkj\" (UID: \"c45726e5-0bb8-40bc-a632-658103a1df3d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-678f47577f-rqzkj" Jul 10 15:56:22.388251 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.388238 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c45726e5-0bb8-40bc-a632-658103a1df3d-klusterlet-config\") pod \"klusterlet-addon-workmgr-678f47577f-rqzkj\" (UID: \"c45726e5-0bb8-40bc-a632-658103a1df3d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-678f47577f-rqzkj" Jul 10 15:56:22.388628 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.388611 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c45726e5-0bb8-40bc-a632-658103a1df3d-tmp\") pod \"klusterlet-addon-workmgr-678f47577f-rqzkj\" (UID: \"c45726e5-0bb8-40bc-a632-658103a1df3d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-678f47577f-rqzkj" Jul 10 15:56:22.391000 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.390982 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c45726e5-0bb8-40bc-a632-658103a1df3d-klusterlet-config\") pod \"klusterlet-addon-workmgr-678f47577f-rqzkj\" (UID: \"c45726e5-0bb8-40bc-a632-658103a1df3d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-678f47577f-rqzkj" Jul 10 15:56:22.426878 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.426844 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z7qx\" (UniqueName: \"kubernetes.io/projected/c45726e5-0bb8-40bc-a632-658103a1df3d-kube-api-access-8z7qx\") pod \"klusterlet-addon-workmgr-678f47577f-rqzkj\" (UID: \"c45726e5-0bb8-40bc-a632-658103a1df3d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-678f47577f-rqzkj" Jul 10 15:56:22.489294 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.489256 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqg6k\" (UniqueName: \"kubernetes.io/projected/6ac43d12-b6fd-4a8d-b41d-ecd8f9e60dba-kube-api-access-jqg6k\") pod \"downloads-68c9cbb497-pllvl\" (UID: \"6ac43d12-b6fd-4a8d-b41d-ecd8f9e60dba\") " pod="openshift-console/downloads-68c9cbb497-pllvl" Jul 10 15:56:22.504956 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.504888 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqg6k\" (UniqueName: \"kubernetes.io/projected/6ac43d12-b6fd-4a8d-b41d-ecd8f9e60dba-kube-api-access-jqg6k\") pod \"downloads-68c9cbb497-pllvl\" (UID: \"6ac43d12-b6fd-4a8d-b41d-ecd8f9e60dba\") " pod="openshift-console/downloads-68c9cbb497-pllvl" Jul 10 15:56:22.551591 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.551539 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-678f47577f-rqzkj" Jul 10 15:56:22.649660 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.649627 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-pllvl" Jul 10 15:56:22.690494 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.690471 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-678f47577f-rqzkj"] Jul 10 15:56:22.693229 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:56:22.693207 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc45726e5_0bb8_40bc_a632_658103a1df3d.slice/crio-bd676f0ba597d06ce892853f3192a942821ded9d8f5958ef34ab18bb82197ed7 WatchSource:0}: Error finding container bd676f0ba597d06ce892853f3192a942821ded9d8f5958ef34ab18bb82197ed7: Status 404 returned error can't find the container with id bd676f0ba597d06ce892853f3192a942821ded9d8f5958ef34ab18bb82197ed7 Jul 10 15:56:22.790327 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.790279 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-pllvl"] Jul 10 15:56:22.792191 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:56:22.792167 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ac43d12_b6fd_4a8d_b41d_ecd8f9e60dba.slice/crio-9c1cb28f89337da7461bceb8231274a3d1090b45a8f47c43092a82a06c52ca3f WatchSource:0}: Error finding container 9c1cb28f89337da7461bceb8231274a3d1090b45a8f47c43092a82a06c52ca3f: Status 404 returned error can't find the container with id 9c1cb28f89337da7461bceb8231274a3d1090b45a8f47c43092a82a06c52ca3f Jul 10 15:56:22.973077 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.973046 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75dc5577bb-lqvsq"] Jul 10 15:56:22.977105 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.977088 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75dc5577bb-lqvsq" Jul 10 15:56:22.981007 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.980981 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 10 15:56:22.981007 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.981003 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 10 15:56:22.981281 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.981266 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 10 15:56:22.981402 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.981358 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 10 15:56:22.981475 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.981459 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9szlq\"" Jul 10 15:56:22.982098 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.982085 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 10 15:56:22.988372 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:22.988350 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75dc5577bb-lqvsq"] Jul 10 15:56:23.093903 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:23.093808 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d066bec7-44fb-42de-b31b-1bf5b1208a08-console-serving-cert\") pod \"console-75dc5577bb-lqvsq\" (UID: \"d066bec7-44fb-42de-b31b-1bf5b1208a08\") " pod="openshift-console/console-75dc5577bb-lqvsq" Jul 10 15:56:23.093903 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:23.093847 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d066bec7-44fb-42de-b31b-1bf5b1208a08-oauth-serving-cert\") pod \"console-75dc5577bb-lqvsq\" (UID: \"d066bec7-44fb-42de-b31b-1bf5b1208a08\") " pod="openshift-console/console-75dc5577bb-lqvsq" Jul 10 15:56:23.094136 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:23.093972 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d066bec7-44fb-42de-b31b-1bf5b1208a08-console-oauth-config\") pod \"console-75dc5577bb-lqvsq\" (UID: \"d066bec7-44fb-42de-b31b-1bf5b1208a08\") " pod="openshift-console/console-75dc5577bb-lqvsq" Jul 10 15:56:23.094136 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:23.094013 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d066bec7-44fb-42de-b31b-1bf5b1208a08-console-config\") pod \"console-75dc5577bb-lqvsq\" (UID: \"d066bec7-44fb-42de-b31b-1bf5b1208a08\") " pod="openshift-console/console-75dc5577bb-lqvsq" Jul 10 15:56:23.094136 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:23.094041 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d066bec7-44fb-42de-b31b-1bf5b1208a08-service-ca\") pod \"console-75dc5577bb-lqvsq\" (UID: \"d066bec7-44fb-42de-b31b-1bf5b1208a08\") " pod="openshift-console/console-75dc5577bb-lqvsq" Jul 10 15:56:23.094136 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:23.094082 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbjz7\" (UniqueName: \"kubernetes.io/projected/d066bec7-44fb-42de-b31b-1bf5b1208a08-kube-api-access-pbjz7\") pod \"console-75dc5577bb-lqvsq\" (UID: \"d066bec7-44fb-42de-b31b-1bf5b1208a08\") " pod="openshift-console/console-75dc5577bb-lqvsq" Jul 10 15:56:23.194601 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:23.194557 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d066bec7-44fb-42de-b31b-1bf5b1208a08-console-serving-cert\") pod \"console-75dc5577bb-lqvsq\" (UID: \"d066bec7-44fb-42de-b31b-1bf5b1208a08\") " pod="openshift-console/console-75dc5577bb-lqvsq" Jul 10 15:56:23.194601 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:23.194603 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d066bec7-44fb-42de-b31b-1bf5b1208a08-oauth-serving-cert\") pod \"console-75dc5577bb-lqvsq\" (UID: \"d066bec7-44fb-42de-b31b-1bf5b1208a08\") " pod="openshift-console/console-75dc5577bb-lqvsq" Jul 10 15:56:23.194839 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:23.194777 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d066bec7-44fb-42de-b31b-1bf5b1208a08-console-oauth-config\") pod \"console-75dc5577bb-lqvsq\" (UID: \"d066bec7-44fb-42de-b31b-1bf5b1208a08\") " pod="openshift-console/console-75dc5577bb-lqvsq" Jul 10 15:56:23.194839 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:23.194807 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d066bec7-44fb-42de-b31b-1bf5b1208a08-console-config\") pod \"console-75dc5577bb-lqvsq\" (UID: \"d066bec7-44fb-42de-b31b-1bf5b1208a08\") " pod="openshift-console/console-75dc5577bb-lqvsq" Jul 10 15:56:23.194839 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:23.194826 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d066bec7-44fb-42de-b31b-1bf5b1208a08-service-ca\") pod \"console-75dc5577bb-lqvsq\" (UID: \"d066bec7-44fb-42de-b31b-1bf5b1208a08\") " pod="openshift-console/console-75dc5577bb-lqvsq" Jul 10 15:56:23.194986 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:23.194857 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbjz7\" (UniqueName: \"kubernetes.io/projected/d066bec7-44fb-42de-b31b-1bf5b1208a08-kube-api-access-pbjz7\") pod \"console-75dc5577bb-lqvsq\" (UID: \"d066bec7-44fb-42de-b31b-1bf5b1208a08\") " pod="openshift-console/console-75dc5577bb-lqvsq" Jul 10 15:56:23.195334 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:23.195303 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d066bec7-44fb-42de-b31b-1bf5b1208a08-oauth-serving-cert\") pod \"console-75dc5577bb-lqvsq\" (UID: \"d066bec7-44fb-42de-b31b-1bf5b1208a08\") " pod="openshift-console/console-75dc5577bb-lqvsq" Jul 10 15:56:23.195718 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:23.195699 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d066bec7-44fb-42de-b31b-1bf5b1208a08-console-config\") pod \"console-75dc5577bb-lqvsq\" (UID: \"d066bec7-44fb-42de-b31b-1bf5b1208a08\") " pod="openshift-console/console-75dc5577bb-lqvsq" Jul 10 15:56:23.195802 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:23.195787 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d066bec7-44fb-42de-b31b-1bf5b1208a08-service-ca\") pod \"console-75dc5577bb-lqvsq\" (UID: \"d066bec7-44fb-42de-b31b-1bf5b1208a08\") " pod="openshift-console/console-75dc5577bb-lqvsq" Jul 10 15:56:23.197151 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:23.197130 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d066bec7-44fb-42de-b31b-1bf5b1208a08-console-serving-cert\") pod \"console-75dc5577bb-lqvsq\" (UID: \"d066bec7-44fb-42de-b31b-1bf5b1208a08\") " pod="openshift-console/console-75dc5577bb-lqvsq" Jul 10 15:56:23.197232 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:23.197194 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d066bec7-44fb-42de-b31b-1bf5b1208a08-console-oauth-config\") pod \"console-75dc5577bb-lqvsq\" (UID: \"d066bec7-44fb-42de-b31b-1bf5b1208a08\") " pod="openshift-console/console-75dc5577bb-lqvsq" Jul 10 15:56:23.206783 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:23.206764 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbjz7\" (UniqueName: \"kubernetes.io/projected/d066bec7-44fb-42de-b31b-1bf5b1208a08-kube-api-access-pbjz7\") pod \"console-75dc5577bb-lqvsq\" (UID: \"d066bec7-44fb-42de-b31b-1bf5b1208a08\") " pod="openshift-console/console-75dc5577bb-lqvsq" Jul 10 15:56:23.286420 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:23.286377 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75dc5577bb-lqvsq" Jul 10 15:56:23.343997 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:23.343926 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zt4rl" Jul 10 15:56:23.379626 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:23.379310 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-678f47577f-rqzkj" event={"ID":"c45726e5-0bb8-40bc-a632-658103a1df3d","Type":"ContainerStarted","Data":"bd676f0ba597d06ce892853f3192a942821ded9d8f5958ef34ab18bb82197ed7"} Jul 10 15:56:23.380886 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:23.380854 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-pllvl" event={"ID":"6ac43d12-b6fd-4a8d-b41d-ecd8f9e60dba","Type":"ContainerStarted","Data":"9c1cb28f89337da7461bceb8231274a3d1090b45a8f47c43092a82a06c52ca3f"} Jul 10 15:56:23.433794 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:23.433521 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75dc5577bb-lqvsq"] Jul 10 15:56:23.436163 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:56:23.436131 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd066bec7_44fb_42de_b31b_1bf5b1208a08.slice/crio-cfe71316299c69622cfd946e4b3c020ae9aa53305a688e8fa307d184cfe00ff9 WatchSource:0}: Error finding container cfe71316299c69622cfd946e4b3c020ae9aa53305a688e8fa307d184cfe00ff9: Status 404 returned error can't find the container with id cfe71316299c69622cfd946e4b3c020ae9aa53305a688e8fa307d184cfe00ff9 Jul 10 15:56:23.975529 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:23.975491 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-6cjz4"] Jul 10 15:56:23.979173 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:23.979140 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-6cjz4" Jul 10 15:56:23.989846 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:23.989822 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 10 15:56:23.991293 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:23.991272 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gb7mt\"" Jul 10 15:56:23.997858 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:23.997831 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-6cjz4"] Jul 10 15:56:24.002502 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:24.002396 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/984cef67-7804-4ef8-84a4-34d0998c644b-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-6cjz4\" (UID: \"984cef67-7804-4ef8-84a4-34d0998c644b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-6cjz4" Jul 10 15:56:24.103419 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:24.103384 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/984cef67-7804-4ef8-84a4-34d0998c644b-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-6cjz4\" (UID: \"984cef67-7804-4ef8-84a4-34d0998c644b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-6cjz4" Jul 10 15:56:24.107411 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:24.107359 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/984cef67-7804-4ef8-84a4-34d0998c644b-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-6cjz4\" (UID: \"984cef67-7804-4ef8-84a4-34d0998c644b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-6cjz4" Jul 10 15:56:24.292166 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:24.292111 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-6cjz4" Jul 10 15:56:24.388077 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:24.388034 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75dc5577bb-lqvsq" event={"ID":"d066bec7-44fb-42de-b31b-1bf5b1208a08","Type":"ContainerStarted","Data":"cfe71316299c69622cfd946e4b3c020ae9aa53305a688e8fa307d184cfe00ff9"} Jul 10 15:56:24.462643 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:24.462604 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-6cjz4"] Jul 10 15:56:24.466861 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:56:24.466813 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod984cef67_7804_4ef8_84a4_34d0998c644b.slice/crio-4d8cf04a68fa8b55c5363acd8995ddb1cad73a4878eba07a2d4a4d7f00faf4ee WatchSource:0}: Error finding container 4d8cf04a68fa8b55c5363acd8995ddb1cad73a4878eba07a2d4a4d7f00faf4ee: Status 404 returned error can't find the container with id 4d8cf04a68fa8b55c5363acd8995ddb1cad73a4878eba07a2d4a4d7f00faf4ee Jul 10 15:56:25.394361 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:25.394321 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-6cjz4" event={"ID":"984cef67-7804-4ef8-84a4-34d0998c644b","Type":"ContainerStarted","Data":"4d8cf04a68fa8b55c5363acd8995ddb1cad73a4878eba07a2d4a4d7f00faf4ee"} Jul 10 15:56:26.749305 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:26.749270 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55bf7fcd64-mp722"] Jul 10 15:56:26.752700 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:26.752677 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55bf7fcd64-mp722" Jul 10 15:56:26.764121 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:26.764098 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 10 15:56:26.765167 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:26.765147 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55bf7fcd64-mp722"] Jul 10 15:56:26.829845 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:26.829810 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c95b841c-6d89-4697-b372-336aa13af110-console-oauth-config\") pod \"console-55bf7fcd64-mp722\" (UID: \"c95b841c-6d89-4697-b372-336aa13af110\") " pod="openshift-console/console-55bf7fcd64-mp722" Jul 10 15:56:26.830031 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:26.829850 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c95b841c-6d89-4697-b372-336aa13af110-trusted-ca-bundle\") pod \"console-55bf7fcd64-mp722\" (UID: \"c95b841c-6d89-4697-b372-336aa13af110\") " pod="openshift-console/console-55bf7fcd64-mp722" Jul 10 15:56:26.830031 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:26.829941 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txjbj\" (UniqueName: \"kubernetes.io/projected/c95b841c-6d89-4697-b372-336aa13af110-kube-api-access-txjbj\") pod \"console-55bf7fcd64-mp722\" (UID: \"c95b841c-6d89-4697-b372-336aa13af110\") " pod="openshift-console/console-55bf7fcd64-mp722" Jul 10 15:56:26.830031 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:26.830000 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c95b841c-6d89-4697-b372-336aa13af110-service-ca\") pod \"console-55bf7fcd64-mp722\" (UID: \"c95b841c-6d89-4697-b372-336aa13af110\") " pod="openshift-console/console-55bf7fcd64-mp722" Jul 10 15:56:26.830161 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:26.830054 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c95b841c-6d89-4697-b372-336aa13af110-console-config\") pod \"console-55bf7fcd64-mp722\" (UID: \"c95b841c-6d89-4697-b372-336aa13af110\") " pod="openshift-console/console-55bf7fcd64-mp722" Jul 10 15:56:26.830161 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:26.830087 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c95b841c-6d89-4697-b372-336aa13af110-oauth-serving-cert\") pod \"console-55bf7fcd64-mp722\" (UID: \"c95b841c-6d89-4697-b372-336aa13af110\") " pod="openshift-console/console-55bf7fcd64-mp722" Jul 10 15:56:26.830161 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:26.830111 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c95b841c-6d89-4697-b372-336aa13af110-console-serving-cert\") pod \"console-55bf7fcd64-mp722\" (UID: \"c95b841c-6d89-4697-b372-336aa13af110\") " pod="openshift-console/console-55bf7fcd64-mp722" Jul 10 15:56:26.930829 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:26.930794 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c95b841c-6d89-4697-b372-336aa13af110-console-oauth-config\") pod \"console-55bf7fcd64-mp722\" (UID: \"c95b841c-6d89-4697-b372-336aa13af110\") " pod="openshift-console/console-55bf7fcd64-mp722" Jul 10 15:56:26.931007 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:26.930837 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c95b841c-6d89-4697-b372-336aa13af110-trusted-ca-bundle\") pod \"console-55bf7fcd64-mp722\" (UID: \"c95b841c-6d89-4697-b372-336aa13af110\") " pod="openshift-console/console-55bf7fcd64-mp722" Jul 10 15:56:26.931007 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:26.930865 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txjbj\" (UniqueName: \"kubernetes.io/projected/c95b841c-6d89-4697-b372-336aa13af110-kube-api-access-txjbj\") pod \"console-55bf7fcd64-mp722\" (UID: \"c95b841c-6d89-4697-b372-336aa13af110\") " pod="openshift-console/console-55bf7fcd64-mp722" Jul 10 15:56:26.931007 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:26.930910 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c95b841c-6d89-4697-b372-336aa13af110-service-ca\") pod \"console-55bf7fcd64-mp722\" (UID: \"c95b841c-6d89-4697-b372-336aa13af110\") " pod="openshift-console/console-55bf7fcd64-mp722" Jul 10 15:56:26.931007 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:26.930967 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c95b841c-6d89-4697-b372-336aa13af110-console-config\") pod \"console-55bf7fcd64-mp722\" (UID: \"c95b841c-6d89-4697-b372-336aa13af110\") " pod="openshift-console/console-55bf7fcd64-mp722" Jul 10 15:56:26.931007 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:26.930996 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c95b841c-6d89-4697-b372-336aa13af110-oauth-serving-cert\") pod \"console-55bf7fcd64-mp722\" (UID: \"c95b841c-6d89-4697-b372-336aa13af110\") " pod="openshift-console/console-55bf7fcd64-mp722" Jul 10 15:56:26.931257 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:26.931024 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c95b841c-6d89-4697-b372-336aa13af110-console-serving-cert\") pod \"console-55bf7fcd64-mp722\" (UID: \"c95b841c-6d89-4697-b372-336aa13af110\") " pod="openshift-console/console-55bf7fcd64-mp722" Jul 10 15:56:26.932082 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:26.932052 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c95b841c-6d89-4697-b372-336aa13af110-console-config\") pod \"console-55bf7fcd64-mp722\" (UID: \"c95b841c-6d89-4697-b372-336aa13af110\") " pod="openshift-console/console-55bf7fcd64-mp722" Jul 10 15:56:26.932691 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:26.932661 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c95b841c-6d89-4697-b372-336aa13af110-oauth-serving-cert\") pod \"console-55bf7fcd64-mp722\" (UID: \"c95b841c-6d89-4697-b372-336aa13af110\") " pod="openshift-console/console-55bf7fcd64-mp722" Jul 10 15:56:26.933188 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:26.933165 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c95b841c-6d89-4697-b372-336aa13af110-trusted-ca-bundle\") pod \"console-55bf7fcd64-mp722\" (UID: \"c95b841c-6d89-4697-b372-336aa13af110\") " pod="openshift-console/console-55bf7fcd64-mp722" Jul 10 15:56:26.933279 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:26.933248 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c95b841c-6d89-4697-b372-336aa13af110-service-ca\") pod \"console-55bf7fcd64-mp722\" (UID: \"c95b841c-6d89-4697-b372-336aa13af110\") " pod="openshift-console/console-55bf7fcd64-mp722" Jul 10 15:56:26.933912 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:26.933870 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c95b841c-6d89-4697-b372-336aa13af110-console-oauth-config\") pod \"console-55bf7fcd64-mp722\" (UID: \"c95b841c-6d89-4697-b372-336aa13af110\") " pod="openshift-console/console-55bf7fcd64-mp722" Jul 10 15:56:26.934080 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:26.934054 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c95b841c-6d89-4697-b372-336aa13af110-console-serving-cert\") pod \"console-55bf7fcd64-mp722\" (UID: \"c95b841c-6d89-4697-b372-336aa13af110\") " pod="openshift-console/console-55bf7fcd64-mp722" Jul 10 15:56:26.943147 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:26.943112 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txjbj\" (UniqueName: \"kubernetes.io/projected/c95b841c-6d89-4697-b372-336aa13af110-kube-api-access-txjbj\") pod \"console-55bf7fcd64-mp722\" (UID: \"c95b841c-6d89-4697-b372-336aa13af110\") " pod="openshift-console/console-55bf7fcd64-mp722" Jul 10 15:56:27.066439 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:27.066167 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55bf7fcd64-mp722" Jul 10 15:56:28.040450 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:28.040412 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jnx2h\" (UID: \"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa\") " pod="openshift-insights/insights-runtime-extractor-jnx2h" Jul 10 15:56:28.043008 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:28.042978 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8d26c3e-e5d8-41f5-99f9-549e804fbeaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jnx2h\" (UID: \"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa\") " pod="openshift-insights/insights-runtime-extractor-jnx2h" Jul 10 15:56:28.232735 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:28.232696 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-k6kc2\"" Jul 10 15:56:28.240730 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:28.240703 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jnx2h" Jul 10 15:56:28.560821 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:28.560455 2562 patch_prober.go:28] interesting pod/image-registry-d4547c7c-5ggsk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 10 15:56:28.560821 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:28.560538 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" podUID="690ed568-a2ec-4a7c-8d75-c11e65ef8733" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 15:56:29.396045 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:29.395387 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55bf7fcd64-mp722"] Jul 10 15:56:29.402211 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:56:29.402177 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc95b841c_6d89_4697_b372_336aa13af110.slice/crio-989d25306c639926713876275a50c78ddbd381b87c1727db89d4210e7ea7e6ef WatchSource:0}: Error finding container 989d25306c639926713876275a50c78ddbd381b87c1727db89d4210e7ea7e6ef: Status 404 returned error can't find the container with id 989d25306c639926713876275a50c78ddbd381b87c1727db89d4210e7ea7e6ef Jul 10 15:56:29.414560 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:29.414150 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-678f47577f-rqzkj" event={"ID":"c45726e5-0bb8-40bc-a632-658103a1df3d","Type":"ContainerStarted","Data":"f9bec0cc4ede2a979ea8f4a3f50b1c57323a2f08ae14b1ba9fd64dedfc764b1e"} Jul 10 15:56:29.414560 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:29.414392 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-678f47577f-rqzkj" Jul 10 15:56:29.416015 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:29.415969 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-678f47577f-rqzkj" Jul 10 15:56:29.417998 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:29.417823 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75dc5577bb-lqvsq" event={"ID":"d066bec7-44fb-42de-b31b-1bf5b1208a08","Type":"ContainerStarted","Data":"0e69865c18d418e83053fc5deec056e92c01d50d104cdabdc14e686150c847ae"} Jul 10 15:56:29.419606 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:29.419507 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55bf7fcd64-mp722" event={"ID":"c95b841c-6d89-4697-b372-336aa13af110","Type":"ContainerStarted","Data":"989d25306c639926713876275a50c78ddbd381b87c1727db89d4210e7ea7e6ef"} Jul 10 15:56:29.423269 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:29.421340 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-6cjz4" event={"ID":"984cef67-7804-4ef8-84a4-34d0998c644b","Type":"ContainerStarted","Data":"8a38468c89efbcd75677edbde1ebef62d55723830d9242458219fceb7957231b"} Jul 10 15:56:29.423498 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:29.423440 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-6cjz4" Jul 10 15:56:29.430601 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:29.430492 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-6cjz4" Jul 10 15:56:29.436446 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:29.435644 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-678f47577f-rqzkj" podStartSLOduration=0.935663902 podStartE2EDuration="7.435625665s" totalImagesPullingTime="6.499961763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:56:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:29.432684003 +0000 UTC m=+88.865168997" watchObservedRunningTime="2026-07-10 15:56:29.435625665 +0000 UTC m=+88.868110663" Jul 10 15:56:29.451900 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:29.451829 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75dc5577bb-lqvsq" podStartSLOduration=1.684814378 podStartE2EDuration="7.451778441s" totalImagesPullingTime="5.766964063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:56:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:29.450870984 +0000 UTC m=+88.883355977" watchObservedRunningTime="2026-07-10 15:56:29.451778441 +0000 UTC m=+88.884263437" Jul 10 15:56:29.469600 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:29.469532 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-6cjz4" podStartSLOduration=1.741645597 podStartE2EDuration="6.469513955s" totalImagesPullingTime="4.727868358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:29.46863439 +0000 UTC m=+88.901119384" watchObservedRunningTime="2026-07-10 15:56:29.469513955 +0000 UTC m=+88.901998949" Jul 10 15:56:29.609198 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:29.609159 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jnx2h"] Jul 10 15:56:29.612345 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:56:29.612318 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8d26c3e_e5d8_41f5_99f9_549e804fbeaa.slice/crio-a9b5671a9886c6fa0186dd18f49d148f8f3144f2a13d4d2b11046f152cf6779b WatchSource:0}: Error finding container a9b5671a9886c6fa0186dd18f49d148f8f3144f2a13d4d2b11046f152cf6779b: Status 404 returned error can't find the container with id a9b5671a9886c6fa0186dd18f49d148f8f3144f2a13d4d2b11046f152cf6779b Jul 10 15:56:30.045488 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:30.045455 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-vs6n2"] Jul 10 15:56:30.049118 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:30.049095 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-vs6n2" Jul 10 15:56:30.052543 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:30.052517 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 10 15:56:30.054021 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:30.053760 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-flq87\"" Jul 10 15:56:30.054021 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:30.053858 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 10 15:56:30.054021 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:30.053881 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 10 15:56:30.054021 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:30.053764 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 10 15:56:30.054296 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:30.054074 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 10 15:56:30.061113 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:30.061086 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-vs6n2"] Jul 10 15:56:30.162458 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:30.162414 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ee69e146-3cd0-41db-8827-6918843ff5ec-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-vs6n2\" (UID: \"ee69e146-3cd0-41db-8827-6918843ff5ec\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vs6n2" Jul 10 15:56:30.162637 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:30.162476 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjj2g\" (UniqueName: \"kubernetes.io/projected/ee69e146-3cd0-41db-8827-6918843ff5ec-kube-api-access-gjj2g\") pod \"prometheus-operator-64785b6675-vs6n2\" (UID: \"ee69e146-3cd0-41db-8827-6918843ff5ec\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vs6n2" Jul 10 15:56:30.162637 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:30.162545 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee69e146-3cd0-41db-8827-6918843ff5ec-metrics-client-ca\") pod \"prometheus-operator-64785b6675-vs6n2\" (UID: \"ee69e146-3cd0-41db-8827-6918843ff5ec\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vs6n2" Jul 10 15:56:30.162735 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:30.162658 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee69e146-3cd0-41db-8827-6918843ff5ec-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-vs6n2\" (UID: \"ee69e146-3cd0-41db-8827-6918843ff5ec\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vs6n2" Jul 10 15:56:30.263277 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:30.263234 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee69e146-3cd0-41db-8827-6918843ff5ec-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-vs6n2\" (UID: \"ee69e146-3cd0-41db-8827-6918843ff5ec\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vs6n2" Jul 10 15:56:30.263453 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:30.263340 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ee69e146-3cd0-41db-8827-6918843ff5ec-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-vs6n2\" (UID: \"ee69e146-3cd0-41db-8827-6918843ff5ec\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vs6n2" Jul 10 15:56:30.263453 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:30.263399 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjj2g\" (UniqueName: \"kubernetes.io/projected/ee69e146-3cd0-41db-8827-6918843ff5ec-kube-api-access-gjj2g\") pod \"prometheus-operator-64785b6675-vs6n2\" (UID: \"ee69e146-3cd0-41db-8827-6918843ff5ec\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vs6n2" Jul 10 15:56:30.263453 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:30.263438 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee69e146-3cd0-41db-8827-6918843ff5ec-metrics-client-ca\") pod \"prometheus-operator-64785b6675-vs6n2\" (UID: \"ee69e146-3cd0-41db-8827-6918843ff5ec\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vs6n2" Jul 10 15:56:30.264204 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:30.264168 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee69e146-3cd0-41db-8827-6918843ff5ec-metrics-client-ca\") pod \"prometheus-operator-64785b6675-vs6n2\" (UID: \"ee69e146-3cd0-41db-8827-6918843ff5ec\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vs6n2" Jul 10 15:56:30.271460 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:30.271436 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee69e146-3cd0-41db-8827-6918843ff5ec-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-vs6n2\" (UID: \"ee69e146-3cd0-41db-8827-6918843ff5ec\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vs6n2" Jul 10 15:56:30.271612 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:30.271456 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ee69e146-3cd0-41db-8827-6918843ff5ec-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-vs6n2\" (UID: \"ee69e146-3cd0-41db-8827-6918843ff5ec\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vs6n2" Jul 10 15:56:30.273962 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:30.273928 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjj2g\" (UniqueName: \"kubernetes.io/projected/ee69e146-3cd0-41db-8827-6918843ff5ec-kube-api-access-gjj2g\") pod \"prometheus-operator-64785b6675-vs6n2\" (UID: \"ee69e146-3cd0-41db-8827-6918843ff5ec\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vs6n2" Jul 10 15:56:30.329371 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:30.329279 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:56:30.361789 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:30.361757 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-vs6n2" Jul 10 15:56:30.431082 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:30.431044 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jnx2h" event={"ID":"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa","Type":"ContainerStarted","Data":"a9b5671a9886c6fa0186dd18f49d148f8f3144f2a13d4d2b11046f152cf6779b"} Jul 10 15:56:30.435547 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:30.435518 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55bf7fcd64-mp722" event={"ID":"c95b841c-6d89-4697-b372-336aa13af110","Type":"ContainerStarted","Data":"11a5a09320a854b2c1f92730994fbc9898f02bed5fe15749ecd93fd994321e18"} Jul 10 15:56:30.540635 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:30.540504 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55bf7fcd64-mp722" podStartSLOduration=4.540483258 podStartE2EDuration="4.540483258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:56:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:30.464174471 +0000 UTC m=+89.896659465" watchObservedRunningTime="2026-07-10 15:56:30.540483258 +0000 UTC m=+89.972968253" Jul 10 15:56:30.541404 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:30.541379 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-vs6n2"] Jul 10 15:56:30.545623 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:56:30.545548 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee69e146_3cd0_41db_8827_6918843ff5ec.slice/crio-98665324b8d3995c090d389a1cff28d0c9b594d9f0b91fb6d67914c10705409f WatchSource:0}: Error finding container 98665324b8d3995c090d389a1cff28d0c9b594d9f0b91fb6d67914c10705409f: Status 404 returned error can't find the container with id 98665324b8d3995c090d389a1cff28d0c9b594d9f0b91fb6d67914c10705409f Jul 10 15:56:31.444316 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:31.444072 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-vs6n2" event={"ID":"ee69e146-3cd0-41db-8827-6918843ff5ec","Type":"ContainerStarted","Data":"98665324b8d3995c090d389a1cff28d0c9b594d9f0b91fb6d67914c10705409f"} Jul 10 15:56:33.286991 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:33.286959 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75dc5577bb-lqvsq" Jul 10 15:56:33.287687 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:33.287101 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75dc5577bb-lqvsq" Jul 10 15:56:33.293292 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:33.293267 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75dc5577bb-lqvsq" Jul 10 15:56:33.457411 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:33.457348 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75dc5577bb-lqvsq" Jul 10 15:56:35.461871 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:35.461771 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-vs6n2" event={"ID":"ee69e146-3cd0-41db-8827-6918843ff5ec","Type":"ContainerStarted","Data":"34c074445f89f4d260708c2b59c8c1e8e8057fad98f35cbc0704c50bf9806499"} Jul 10 15:56:35.461871 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:35.461852 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-vs6n2" event={"ID":"ee69e146-3cd0-41db-8827-6918843ff5ec","Type":"ContainerStarted","Data":"7a2792582537cef4e46c886bc4a5914a067dc742d9257d0165b945fb377a1a18"} Jul 10 15:56:35.464033 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:35.463997 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jnx2h" event={"ID":"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa","Type":"ContainerStarted","Data":"2e4f88b65ff76eba1dfe11bdcf2568528ef2f51c698dc11037a5be4e00c7ac99"} Jul 10 15:56:35.464162 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:35.464050 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jnx2h" event={"ID":"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa","Type":"ContainerStarted","Data":"ac0da0219c3f76775339dc433dc0674a6f6b04f47512e603664fde96b4163890"} Jul 10 15:56:35.482323 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:35.482264 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-vs6n2" podStartSLOduration=1.571723005 podStartE2EDuration="5.48224656s" totalImagesPullingTime="3.910523555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:56:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:35.482028737 +0000 UTC m=+94.914513731" watchObservedRunningTime="2026-07-10 15:56:35.48224656 +0000 UTC m=+94.914731552" Jul 10 15:56:37.066926 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.066885 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55bf7fcd64-mp722" Jul 10 15:56:37.067369 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.066962 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55bf7fcd64-mp722" Jul 10 15:56:37.072478 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.072451 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55bf7fcd64-mp722" Jul 10 15:56:37.433480 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.433389 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-cmmk5"] Jul 10 15:56:37.437037 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.437013 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-cmmk5" Jul 10 15:56:37.441135 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.440613 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-drvl9\"" Jul 10 15:56:37.441135 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.440977 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 10 15:56:37.441770 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.441474 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 10 15:56:37.441770 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.441712 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 10 15:56:37.452172 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.452136 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-cmmk5"] Jul 10 15:56:37.472099 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.472061 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9qhdn"] Jul 10 15:56:37.476779 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.476755 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9qhdn" Jul 10 15:56:37.480234 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.479616 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 10 15:56:37.482146 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.481722 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 10 15:56:37.482146 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.481784 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nn7fg\"" Jul 10 15:56:37.482146 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.482044 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 10 15:56:37.485259 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.485122 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55bf7fcd64-mp722" Jul 10 15:56:37.536849 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.536814 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/355ba7a5-930f-49d7-b8a4-6e64bf8f11ec-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-cmmk5\" (UID: \"355ba7a5-930f-49d7-b8a4-6e64bf8f11ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cmmk5" Jul 10 15:56:37.537118 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.537090 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/355ba7a5-930f-49d7-b8a4-6e64bf8f11ec-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-cmmk5\" (UID: \"355ba7a5-930f-49d7-b8a4-6e64bf8f11ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cmmk5" Jul 10 15:56:37.537297 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.537261 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/355ba7a5-930f-49d7-b8a4-6e64bf8f11ec-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-cmmk5\" (UID: \"355ba7a5-930f-49d7-b8a4-6e64bf8f11ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cmmk5" Jul 10 15:56:37.537412 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.537386 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/355ba7a5-930f-49d7-b8a4-6e64bf8f11ec-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-cmmk5\" (UID: \"355ba7a5-930f-49d7-b8a4-6e64bf8f11ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cmmk5" Jul 10 15:56:37.537495 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.537478 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/355ba7a5-930f-49d7-b8a4-6e64bf8f11ec-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-cmmk5\" (UID: \"355ba7a5-930f-49d7-b8a4-6e64bf8f11ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cmmk5" Jul 10 15:56:37.539462 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.539328 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvqmc\" (UniqueName: \"kubernetes.io/projected/355ba7a5-930f-49d7-b8a4-6e64bf8f11ec-kube-api-access-jvqmc\") pod \"kube-state-metrics-785778ff74-cmmk5\" (UID: \"355ba7a5-930f-49d7-b8a4-6e64bf8f11ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cmmk5" Jul 10 15:56:37.639242 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.639204 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75dc5577bb-lqvsq"] Jul 10 15:56:37.639898 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.639864 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/57aa6454-baf4-4c62-8497-484be0ced21a-node-exporter-wtmp\") pod \"node-exporter-9qhdn\" (UID: \"57aa6454-baf4-4c62-8497-484be0ced21a\") " pod="openshift-monitoring/node-exporter-9qhdn" Jul 10 15:56:37.640059 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.639921 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/355ba7a5-930f-49d7-b8a4-6e64bf8f11ec-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-cmmk5\" (UID: \"355ba7a5-930f-49d7-b8a4-6e64bf8f11ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cmmk5" Jul 10 15:56:37.640059 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.639955 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/57aa6454-baf4-4c62-8497-484be0ced21a-node-exporter-tls\") pod \"node-exporter-9qhdn\" (UID: \"57aa6454-baf4-4c62-8497-484be0ced21a\") " pod="openshift-monitoring/node-exporter-9qhdn" Jul 10 15:56:37.640059 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.640002 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/355ba7a5-930f-49d7-b8a4-6e64bf8f11ec-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-cmmk5\" (UID: \"355ba7a5-930f-49d7-b8a4-6e64bf8f11ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cmmk5" Jul 10 15:56:37.640059 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.640030 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/355ba7a5-930f-49d7-b8a4-6e64bf8f11ec-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-cmmk5\" (UID: \"355ba7a5-930f-49d7-b8a4-6e64bf8f11ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cmmk5" Jul 10 15:56:37.640256 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.640076 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/57aa6454-baf4-4c62-8497-484be0ced21a-node-exporter-accelerators-collector-config\") pod \"node-exporter-9qhdn\" (UID: \"57aa6454-baf4-4c62-8497-484be0ced21a\") " pod="openshift-monitoring/node-exporter-9qhdn" Jul 10 15:56:37.640256 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.640122 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57aa6454-baf4-4c62-8497-484be0ced21a-metrics-client-ca\") pod \"node-exporter-9qhdn\" (UID: \"57aa6454-baf4-4c62-8497-484be0ced21a\") " pod="openshift-monitoring/node-exporter-9qhdn" Jul 10 15:56:37.640256 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.640161 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57aa6454-baf4-4c62-8497-484be0ced21a-sys\") pod \"node-exporter-9qhdn\" (UID: \"57aa6454-baf4-4c62-8497-484be0ced21a\") " pod="openshift-monitoring/node-exporter-9qhdn" Jul 10 15:56:37.640256 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.640186 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57aa6454-baf4-4c62-8497-484be0ced21a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9qhdn\" (UID: \"57aa6454-baf4-4c62-8497-484be0ced21a\") " pod="openshift-monitoring/node-exporter-9qhdn" Jul 10 15:56:37.640256 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.640218 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/355ba7a5-930f-49d7-b8a4-6e64bf8f11ec-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-cmmk5\" (UID: \"355ba7a5-930f-49d7-b8a4-6e64bf8f11ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cmmk5" Jul 10 15:56:37.640507 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.640290 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/355ba7a5-930f-49d7-b8a4-6e64bf8f11ec-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-cmmk5\" (UID: \"355ba7a5-930f-49d7-b8a4-6e64bf8f11ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cmmk5" Jul 10 15:56:37.640507 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.640316 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvqmc\" (UniqueName: \"kubernetes.io/projected/355ba7a5-930f-49d7-b8a4-6e64bf8f11ec-kube-api-access-jvqmc\") pod \"kube-state-metrics-785778ff74-cmmk5\" (UID: \"355ba7a5-930f-49d7-b8a4-6e64bf8f11ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cmmk5" Jul 10 15:56:37.640507 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.640370 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/57aa6454-baf4-4c62-8497-484be0ced21a-node-exporter-textfile\") pod \"node-exporter-9qhdn\" (UID: \"57aa6454-baf4-4c62-8497-484be0ced21a\") " pod="openshift-monitoring/node-exporter-9qhdn" Jul 10 15:56:37.640507 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.640404 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwlxp\" (UniqueName: \"kubernetes.io/projected/57aa6454-baf4-4c62-8497-484be0ced21a-kube-api-access-qwlxp\") pod \"node-exporter-9qhdn\" (UID: \"57aa6454-baf4-4c62-8497-484be0ced21a\") " pod="openshift-monitoring/node-exporter-9qhdn" Jul 10 15:56:37.640507 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.640460 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/57aa6454-baf4-4c62-8497-484be0ced21a-root\") pod \"node-exporter-9qhdn\" (UID: \"57aa6454-baf4-4c62-8497-484be0ced21a\") " pod="openshift-monitoring/node-exporter-9qhdn" Jul 10 15:56:37.641515 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.641348 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/355ba7a5-930f-49d7-b8a4-6e64bf8f11ec-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-cmmk5\" (UID: \"355ba7a5-930f-49d7-b8a4-6e64bf8f11ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cmmk5" Jul 10 15:56:37.641818 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.641734 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/355ba7a5-930f-49d7-b8a4-6e64bf8f11ec-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-cmmk5\" (UID: \"355ba7a5-930f-49d7-b8a4-6e64bf8f11ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cmmk5" Jul 10 15:56:37.642187 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.642162 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/355ba7a5-930f-49d7-b8a4-6e64bf8f11ec-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-cmmk5\" (UID: \"355ba7a5-930f-49d7-b8a4-6e64bf8f11ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cmmk5" Jul 10 15:56:37.644006 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.643983 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/355ba7a5-930f-49d7-b8a4-6e64bf8f11ec-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-cmmk5\" (UID: \"355ba7a5-930f-49d7-b8a4-6e64bf8f11ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cmmk5" Jul 10 15:56:37.646106 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.646063 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/355ba7a5-930f-49d7-b8a4-6e64bf8f11ec-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-cmmk5\" (UID: \"355ba7a5-930f-49d7-b8a4-6e64bf8f11ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cmmk5" Jul 10 15:56:37.679035 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.678999 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvqmc\" (UniqueName: \"kubernetes.io/projected/355ba7a5-930f-49d7-b8a4-6e64bf8f11ec-kube-api-access-jvqmc\") pod \"kube-state-metrics-785778ff74-cmmk5\" (UID: \"355ba7a5-930f-49d7-b8a4-6e64bf8f11ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cmmk5" Jul 10 15:56:37.741104 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.741008 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/57aa6454-baf4-4c62-8497-484be0ced21a-node-exporter-accelerators-collector-config\") pod \"node-exporter-9qhdn\" (UID: \"57aa6454-baf4-4c62-8497-484be0ced21a\") " pod="openshift-monitoring/node-exporter-9qhdn" Jul 10 15:56:37.741104 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.741058 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57aa6454-baf4-4c62-8497-484be0ced21a-metrics-client-ca\") pod \"node-exporter-9qhdn\" (UID: \"57aa6454-baf4-4c62-8497-484be0ced21a\") " pod="openshift-monitoring/node-exporter-9qhdn" Jul 10 15:56:37.741104 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.741096 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57aa6454-baf4-4c62-8497-484be0ced21a-sys\") pod \"node-exporter-9qhdn\" (UID: \"57aa6454-baf4-4c62-8497-484be0ced21a\") " pod="openshift-monitoring/node-exporter-9qhdn" Jul 10 15:56:37.741469 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.741125 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57aa6454-baf4-4c62-8497-484be0ced21a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9qhdn\" (UID: \"57aa6454-baf4-4c62-8497-484be0ced21a\") " pod="openshift-monitoring/node-exporter-9qhdn" Jul 10 15:56:37.741469 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.741182 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/57aa6454-baf4-4c62-8497-484be0ced21a-node-exporter-textfile\") pod \"node-exporter-9qhdn\" (UID: \"57aa6454-baf4-4c62-8497-484be0ced21a\") " pod="openshift-monitoring/node-exporter-9qhdn" Jul 10 15:56:37.741469 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.741204 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwlxp\" (UniqueName: \"kubernetes.io/projected/57aa6454-baf4-4c62-8497-484be0ced21a-kube-api-access-qwlxp\") pod \"node-exporter-9qhdn\" (UID: \"57aa6454-baf4-4c62-8497-484be0ced21a\") " pod="openshift-monitoring/node-exporter-9qhdn" Jul 10 15:56:37.741469 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.741244 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/57aa6454-baf4-4c62-8497-484be0ced21a-root\") pod \"node-exporter-9qhdn\" (UID: \"57aa6454-baf4-4c62-8497-484be0ced21a\") " pod="openshift-monitoring/node-exporter-9qhdn" Jul 10 15:56:37.741469 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.741277 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/57aa6454-baf4-4c62-8497-484be0ced21a-node-exporter-wtmp\") pod \"node-exporter-9qhdn\" (UID: \"57aa6454-baf4-4c62-8497-484be0ced21a\") " pod="openshift-monitoring/node-exporter-9qhdn" Jul 10 15:56:37.741469 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.741322 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/57aa6454-baf4-4c62-8497-484be0ced21a-node-exporter-tls\") pod \"node-exporter-9qhdn\" (UID: \"57aa6454-baf4-4c62-8497-484be0ced21a\") " pod="openshift-monitoring/node-exporter-9qhdn" Jul 10 15:56:37.741880 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.741839 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/57aa6454-baf4-4c62-8497-484be0ced21a-node-exporter-accelerators-collector-config\") pod \"node-exporter-9qhdn\" (UID: \"57aa6454-baf4-4c62-8497-484be0ced21a\") " pod="openshift-monitoring/node-exporter-9qhdn" Jul 10 15:56:37.741880 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.741862 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57aa6454-baf4-4c62-8497-484be0ced21a-sys\") pod \"node-exporter-9qhdn\" (UID: \"57aa6454-baf4-4c62-8497-484be0ced21a\") " pod="openshift-monitoring/node-exporter-9qhdn" Jul 10 15:56:37.742067 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.742024 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/57aa6454-baf4-4c62-8497-484be0ced21a-node-exporter-wtmp\") pod \"node-exporter-9qhdn\" (UID: \"57aa6454-baf4-4c62-8497-484be0ced21a\") " pod="openshift-monitoring/node-exporter-9qhdn" Jul 10 15:56:37.742122 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.742064 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/57aa6454-baf4-4c62-8497-484be0ced21a-root\") pod \"node-exporter-9qhdn\" (UID: \"57aa6454-baf4-4c62-8497-484be0ced21a\") " pod="openshift-monitoring/node-exporter-9qhdn" Jul 10 15:56:37.742421 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.742290 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57aa6454-baf4-4c62-8497-484be0ced21a-metrics-client-ca\") pod \"node-exporter-9qhdn\" (UID: \"57aa6454-baf4-4c62-8497-484be0ced21a\") " pod="openshift-monitoring/node-exporter-9qhdn" Jul 10 15:56:37.742620 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.742591 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/57aa6454-baf4-4c62-8497-484be0ced21a-node-exporter-textfile\") pod \"node-exporter-9qhdn\" (UID: \"57aa6454-baf4-4c62-8497-484be0ced21a\") " pod="openshift-monitoring/node-exporter-9qhdn" Jul 10 15:56:37.744729 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.744704 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57aa6454-baf4-4c62-8497-484be0ced21a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9qhdn\" (UID: \"57aa6454-baf4-4c62-8497-484be0ced21a\") " pod="openshift-monitoring/node-exporter-9qhdn" Jul 10 15:56:37.744857 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.744837 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/57aa6454-baf4-4c62-8497-484be0ced21a-node-exporter-tls\") pod \"node-exporter-9qhdn\" (UID: \"57aa6454-baf4-4c62-8497-484be0ced21a\") " pod="openshift-monitoring/node-exporter-9qhdn" Jul 10 15:56:37.750995 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.750958 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwlxp\" (UniqueName: \"kubernetes.io/projected/57aa6454-baf4-4c62-8497-484be0ced21a-kube-api-access-qwlxp\") pod \"node-exporter-9qhdn\" (UID: \"57aa6454-baf4-4c62-8497-484be0ced21a\") " pod="openshift-monitoring/node-exporter-9qhdn" Jul 10 15:56:37.753786 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.753762 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-cmmk5" Jul 10 15:56:37.790113 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:37.790072 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9qhdn" Jul 10 15:56:38.472066 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.472025 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 15:56:38.476182 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.476157 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.480626 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.480227 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 10 15:56:38.480626 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.480281 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 10 15:56:38.480626 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.480350 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 10 15:56:38.480859 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.480763 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jjprh\"" Jul 10 15:56:38.481734 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.481131 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 10 15:56:38.481734 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.481265 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 10 15:56:38.481734 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.481417 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 10 15:56:38.481734 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.481447 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 10 15:56:38.481734 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.481455 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 10 15:56:38.482378 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.482359 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 10 15:56:38.500490 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.500466 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 15:56:38.550203 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.550171 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16f68e38-0805-4827-bec3-6f7782a34505-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.550363 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.550210 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/16f68e38-0805-4827-bec3-6f7782a34505-config-out\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.550363 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.550247 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/16f68e38-0805-4827-bec3-6f7782a34505-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.550363 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.550273 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/16f68e38-0805-4827-bec3-6f7782a34505-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.550363 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.550292 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/16f68e38-0805-4827-bec3-6f7782a34505-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.550564 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.550373 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/16f68e38-0805-4827-bec3-6f7782a34505-config-volume\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.550564 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.550420 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/16f68e38-0805-4827-bec3-6f7782a34505-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.550564 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.550469 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtjrm\" (UniqueName: \"kubernetes.io/projected/16f68e38-0805-4827-bec3-6f7782a34505-kube-api-access-xtjrm\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.550564 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.550499 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/16f68e38-0805-4827-bec3-6f7782a34505-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.550564 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.550523 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/16f68e38-0805-4827-bec3-6f7782a34505-web-config\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.550564 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.550545 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/16f68e38-0805-4827-bec3-6f7782a34505-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.550894 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.550616 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16f68e38-0805-4827-bec3-6f7782a34505-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.550894 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.550659 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/16f68e38-0805-4827-bec3-6f7782a34505-tls-assets\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.651682 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.651642 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtjrm\" (UniqueName: \"kubernetes.io/projected/16f68e38-0805-4827-bec3-6f7782a34505-kube-api-access-xtjrm\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.651900 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.651701 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/16f68e38-0805-4827-bec3-6f7782a34505-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.651900 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.651729 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/16f68e38-0805-4827-bec3-6f7782a34505-web-config\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.651900 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.651751 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/16f68e38-0805-4827-bec3-6f7782a34505-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.651900 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.651819 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16f68e38-0805-4827-bec3-6f7782a34505-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.651900 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.651857 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/16f68e38-0805-4827-bec3-6f7782a34505-tls-assets\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.652172 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.651934 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16f68e38-0805-4827-bec3-6f7782a34505-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.652172 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.651989 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/16f68e38-0805-4827-bec3-6f7782a34505-config-out\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.652172 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.652029 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/16f68e38-0805-4827-bec3-6f7782a34505-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.652172 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.652112 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/16f68e38-0805-4827-bec3-6f7782a34505-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.652172 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.652141 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/16f68e38-0805-4827-bec3-6f7782a34505-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.652413 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.652194 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/16f68e38-0805-4827-bec3-6f7782a34505-config-volume\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.652413 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.652217 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/16f68e38-0805-4827-bec3-6f7782a34505-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.652926 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.652902 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/16f68e38-0805-4827-bec3-6f7782a34505-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.656375 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.656324 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16f68e38-0805-4827-bec3-6f7782a34505-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.656786 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.656742 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16f68e38-0805-4827-bec3-6f7782a34505-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.657327 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.657283 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/16f68e38-0805-4827-bec3-6f7782a34505-tls-assets\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.657722 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.657698 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/16f68e38-0805-4827-bec3-6f7782a34505-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.657854 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.657829 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/16f68e38-0805-4827-bec3-6f7782a34505-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.658392 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.658366 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/16f68e38-0805-4827-bec3-6f7782a34505-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.658487 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.658400 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/16f68e38-0805-4827-bec3-6f7782a34505-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.658543 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.658497 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/16f68e38-0805-4827-bec3-6f7782a34505-config-volume\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.658614 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.658584 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/16f68e38-0805-4827-bec3-6f7782a34505-config-out\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.659120 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.659098 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/16f68e38-0805-4827-bec3-6f7782a34505-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.659194 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.659168 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/16f68e38-0805-4827-bec3-6f7782a34505-web-config\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.663214 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.663195 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtjrm\" (UniqueName: \"kubernetes.io/projected/16f68e38-0805-4827-bec3-6f7782a34505-kube-api-access-xtjrm\") pod \"alertmanager-main-0\" (UID: \"16f68e38-0805-4827-bec3-6f7782a34505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:38.789590 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:38.789528 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 15:56:41.974283 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:41.974241 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-fc56d5dbc-lmmww"] Jul 10 15:56:42.044101 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.044064 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-fc56d5dbc-lmmww"] Jul 10 15:56:42.044283 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.044230 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" Jul 10 15:56:42.048414 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.048201 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 10 15:56:42.048414 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.048222 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-nfvw4\"" Jul 10 15:56:42.048414 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.048242 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 10 15:56:42.048414 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.048287 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 10 15:56:42.048414 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.048245 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 10 15:56:42.048839 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.048646 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-erk8pme3nadd1\"" Jul 10 15:56:42.181938 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.181903 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65c9df797c-jkr2h"] Jul 10 15:56:42.186483 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.186451 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9-metrics-server-audit-profiles\") pod \"metrics-server-fc56d5dbc-lmmww\" (UID: \"6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9\") " pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" Jul 10 15:56:42.186645 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.186497 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9-client-ca-bundle\") pod \"metrics-server-fc56d5dbc-lmmww\" (UID: \"6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9\") " pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" Jul 10 15:56:42.186645 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.186627 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-fc56d5dbc-lmmww\" (UID: \"6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9\") " pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" Jul 10 15:56:42.186734 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.186665 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9-secret-metrics-server-client-certs\") pod \"metrics-server-fc56d5dbc-lmmww\" (UID: \"6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9\") " pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" Jul 10 15:56:42.186734 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.186693 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9-audit-log\") pod \"metrics-server-fc56d5dbc-lmmww\" (UID: \"6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9\") " pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" Jul 10 15:56:42.186837 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.186746 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv94v\" (UniqueName: \"kubernetes.io/projected/6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9-kube-api-access-bv94v\") pod \"metrics-server-fc56d5dbc-lmmww\" (UID: \"6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9\") " pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" Jul 10 15:56:42.186837 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.186796 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9-secret-metrics-server-tls\") pod \"metrics-server-fc56d5dbc-lmmww\" (UID: \"6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9\") " pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" Jul 10 15:56:42.225407 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.225275 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65c9df797c-jkr2h"] Jul 10 15:56:42.225639 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.225428 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65c9df797c-jkr2h" Jul 10 15:56:42.287643 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.287607 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-fc56d5dbc-lmmww\" (UID: \"6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9\") " pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" Jul 10 15:56:42.287819 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.287657 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9-secret-metrics-server-client-certs\") pod \"metrics-server-fc56d5dbc-lmmww\" (UID: \"6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9\") " pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" Jul 10 15:56:42.287819 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.287697 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9-audit-log\") pod \"metrics-server-fc56d5dbc-lmmww\" (UID: \"6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9\") " pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" Jul 10 15:56:42.287819 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.287726 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv94v\" (UniqueName: \"kubernetes.io/projected/6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9-kube-api-access-bv94v\") pod \"metrics-server-fc56d5dbc-lmmww\" (UID: \"6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9\") " pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" Jul 10 15:56:42.287819 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.287776 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9-secret-metrics-server-tls\") pod \"metrics-server-fc56d5dbc-lmmww\" (UID: \"6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9\") " pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" Jul 10 15:56:42.287819 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.287815 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9-metrics-server-audit-profiles\") pod \"metrics-server-fc56d5dbc-lmmww\" (UID: \"6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9\") " pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" Jul 10 15:56:42.288051 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.287842 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9-client-ca-bundle\") pod \"metrics-server-fc56d5dbc-lmmww\" (UID: \"6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9\") " pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" Jul 10 15:56:42.288450 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.288385 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-fc56d5dbc-lmmww\" (UID: \"6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9\") " pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" Jul 10 15:56:42.288450 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.288433 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9-audit-log\") pod \"metrics-server-fc56d5dbc-lmmww\" (UID: \"6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9\") " pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" Jul 10 15:56:42.289011 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.288952 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9-metrics-server-audit-profiles\") pod \"metrics-server-fc56d5dbc-lmmww\" (UID: \"6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9\") " pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" Jul 10 15:56:42.290993 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.290964 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9-secret-metrics-server-tls\") pod \"metrics-server-fc56d5dbc-lmmww\" (UID: \"6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9\") " pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" Jul 10 15:56:42.291165 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.291141 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9-client-ca-bundle\") pod \"metrics-server-fc56d5dbc-lmmww\" (UID: \"6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9\") " pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" Jul 10 15:56:42.291234 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.291218 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9-secret-metrics-server-client-certs\") pod \"metrics-server-fc56d5dbc-lmmww\" (UID: \"6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9\") " pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" Jul 10 15:56:42.303356 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.303330 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv94v\" (UniqueName: \"kubernetes.io/projected/6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9-kube-api-access-bv94v\") pod \"metrics-server-fc56d5dbc-lmmww\" (UID: \"6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9\") " pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" Jul 10 15:56:42.356558 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.356518 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" Jul 10 15:56:42.389142 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.389110 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2jll\" (UniqueName: \"kubernetes.io/projected/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-kube-api-access-j2jll\") pod \"console-65c9df797c-jkr2h\" (UID: \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\") " pod="openshift-console/console-65c9df797c-jkr2h" Jul 10 15:56:42.389313 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.389152 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-console-config\") pod \"console-65c9df797c-jkr2h\" (UID: \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\") " pod="openshift-console/console-65c9df797c-jkr2h" Jul 10 15:56:42.389313 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.389192 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-oauth-serving-cert\") pod \"console-65c9df797c-jkr2h\" (UID: \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\") " pod="openshift-console/console-65c9df797c-jkr2h" Jul 10 15:56:42.389313 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.389265 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-console-serving-cert\") pod \"console-65c9df797c-jkr2h\" (UID: \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\") " pod="openshift-console/console-65c9df797c-jkr2h" Jul 10 15:56:42.389483 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.389350 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-service-ca\") pod \"console-65c9df797c-jkr2h\" (UID: \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\") " pod="openshift-console/console-65c9df797c-jkr2h" Jul 10 15:56:42.389483 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.389389 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-trusted-ca-bundle\") pod \"console-65c9df797c-jkr2h\" (UID: \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\") " pod="openshift-console/console-65c9df797c-jkr2h" Jul 10 15:56:42.389483 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.389456 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-console-oauth-config\") pod \"console-65c9df797c-jkr2h\" (UID: \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\") " pod="openshift-console/console-65c9df797c-jkr2h" Jul 10 15:56:42.490288 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.490199 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-console-oauth-config\") pod \"console-65c9df797c-jkr2h\" (UID: \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\") " pod="openshift-console/console-65c9df797c-jkr2h" Jul 10 15:56:42.490456 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.490296 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2jll\" (UniqueName: \"kubernetes.io/projected/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-kube-api-access-j2jll\") pod \"console-65c9df797c-jkr2h\" (UID: \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\") " pod="openshift-console/console-65c9df797c-jkr2h" Jul 10 15:56:42.490456 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.490335 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-console-config\") pod \"console-65c9df797c-jkr2h\" (UID: \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\") " pod="openshift-console/console-65c9df797c-jkr2h" Jul 10 15:56:42.490456 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.490382 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-oauth-serving-cert\") pod \"console-65c9df797c-jkr2h\" (UID: \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\") " pod="openshift-console/console-65c9df797c-jkr2h" Jul 10 15:56:42.490456 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.490412 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-console-serving-cert\") pod \"console-65c9df797c-jkr2h\" (UID: \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\") " pod="openshift-console/console-65c9df797c-jkr2h" Jul 10 15:56:42.490456 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.490451 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-service-ca\") pod \"console-65c9df797c-jkr2h\" (UID: \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\") " pod="openshift-console/console-65c9df797c-jkr2h" Jul 10 15:56:42.490723 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.490475 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-trusted-ca-bundle\") pod \"console-65c9df797c-jkr2h\" (UID: \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\") " pod="openshift-console/console-65c9df797c-jkr2h" Jul 10 15:56:42.491281 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.491254 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-console-config\") pod \"console-65c9df797c-jkr2h\" (UID: \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\") " pod="openshift-console/console-65c9df797c-jkr2h" Jul 10 15:56:42.491653 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.491627 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-service-ca\") pod \"console-65c9df797c-jkr2h\" (UID: \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\") " pod="openshift-console/console-65c9df797c-jkr2h" Jul 10 15:56:42.491823 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.491778 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-trusted-ca-bundle\") pod \"console-65c9df797c-jkr2h\" (UID: \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\") " pod="openshift-console/console-65c9df797c-jkr2h" Jul 10 15:56:42.491983 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.491966 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-oauth-serving-cert\") pod \"console-65c9df797c-jkr2h\" (UID: \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\") " pod="openshift-console/console-65c9df797c-jkr2h" Jul 10 15:56:42.493553 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.493532 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-console-oauth-config\") pod \"console-65c9df797c-jkr2h\" (UID: \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\") " pod="openshift-console/console-65c9df797c-jkr2h" Jul 10 15:56:42.493961 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.493938 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-console-serving-cert\") pod \"console-65c9df797c-jkr2h\" (UID: \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\") " pod="openshift-console/console-65c9df797c-jkr2h" Jul 10 15:56:42.499177 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.499150 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2jll\" (UniqueName: \"kubernetes.io/projected/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-kube-api-access-j2jll\") pod \"console-65c9df797c-jkr2h\" (UID: \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\") " pod="openshift-console/console-65c9df797c-jkr2h" Jul 10 15:56:42.537167 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:42.537129 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65c9df797c-jkr2h" Jul 10 15:56:44.345231 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:44.345200 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cmq2z" Jul 10 15:56:45.442241 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:56:45.442195 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57aa6454_baf4_4c62_8497_484be0ced21a.slice/crio-8e8438890b4c30fc6b84939900cbc822426f162fc30e45c27037d2405319b495 WatchSource:0}: Error finding container 8e8438890b4c30fc6b84939900cbc822426f162fc30e45c27037d2405319b495: Status 404 returned error can't find the container with id 8e8438890b4c30fc6b84939900cbc822426f162fc30e45c27037d2405319b495 Jul 10 15:56:45.518848 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:45.518783 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9qhdn" event={"ID":"57aa6454-baf4-4c62-8497-484be0ced21a","Type":"ContainerStarted","Data":"8e8438890b4c30fc6b84939900cbc822426f162fc30e45c27037d2405319b495"} Jul 10 15:56:45.615030 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:45.614669 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65c9df797c-jkr2h"] Jul 10 15:56:45.676338 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:45.676313 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-fc56d5dbc-lmmww"] Jul 10 15:56:45.680704 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:56:45.680676 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a93a6d2_18a7_4561_9d26_7a2d53ddf3a9.slice/crio-209ed84ac291ee5de0e25f23eeed84d8264b8cb9bb33fa391b56e156895f947e WatchSource:0}: Error finding container 209ed84ac291ee5de0e25f23eeed84d8264b8cb9bb33fa391b56e156895f947e: Status 404 returned error can't find the container with id 209ed84ac291ee5de0e25f23eeed84d8264b8cb9bb33fa391b56e156895f947e Jul 10 15:56:45.843366 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:45.843283 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-cmmk5"] Jul 10 15:56:45.846923 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:56:45.846894 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod355ba7a5_930f_49d7_b8a4_6e64bf8f11ec.slice/crio-d99e109ba7b67097b679b502a18632149e1e39d87cb8d7edbdb6b54f0d446df5 WatchSource:0}: Error finding container d99e109ba7b67097b679b502a18632149e1e39d87cb8d7edbdb6b54f0d446df5: Status 404 returned error can't find the container with id d99e109ba7b67097b679b502a18632149e1e39d87cb8d7edbdb6b54f0d446df5 Jul 10 15:56:45.847968 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:45.847936 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 15:56:45.848696 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:56:45.848663 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16f68e38_0805_4827_bec3_6f7782a34505.slice/crio-e08de5adb6b4c501a3b24cf57cf71ddbaee1b4708e60a791096241834b96c354 WatchSource:0}: Error finding container e08de5adb6b4c501a3b24cf57cf71ddbaee1b4708e60a791096241834b96c354: Status 404 returned error can't find the container with id e08de5adb6b4c501a3b24cf57cf71ddbaee1b4708e60a791096241834b96c354 Jul 10 15:56:46.528971 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:46.528932 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-pllvl" event={"ID":"6ac43d12-b6fd-4a8d-b41d-ecd8f9e60dba","Type":"ContainerStarted","Data":"ea800a305031115aa4db26da68183f2bbd80830e2176df2b22b5e2a89e037da2"} Jul 10 15:56:46.529945 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:46.529867 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-pllvl" Jul 10 15:56:46.533996 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:46.533958 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jnx2h" event={"ID":"f8d26c3e-e5d8-41f5-99f9-549e804fbeaa","Type":"ContainerStarted","Data":"61823e7bc36c2f549122daff339f15d2a81dad83369ef6ed1298096ca41f8b7f"} Jul 10 15:56:46.537490 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:46.537423 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-cmmk5" event={"ID":"355ba7a5-930f-49d7-b8a4-6e64bf8f11ec","Type":"ContainerStarted","Data":"d99e109ba7b67097b679b502a18632149e1e39d87cb8d7edbdb6b54f0d446df5"} Jul 10 15:56:46.541942 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:46.541900 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65c9df797c-jkr2h" event={"ID":"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed","Type":"ContainerStarted","Data":"3fb065b1502f74685be6ed9a079ff575fe766a25b46c39a44a4c221d973dd788"} Jul 10 15:56:46.542821 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:46.542090 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65c9df797c-jkr2h" event={"ID":"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed","Type":"ContainerStarted","Data":"b4b16eee8109f7bdb08c642a466168d0c378131b338de8ffd14e2dcd92853c76"} Jul 10 15:56:46.545136 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:46.545098 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" event={"ID":"6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9","Type":"ContainerStarted","Data":"209ed84ac291ee5de0e25f23eeed84d8264b8cb9bb33fa391b56e156895f947e"} Jul 10 15:56:46.546860 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:46.546798 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"16f68e38-0805-4827-bec3-6f7782a34505","Type":"ContainerStarted","Data":"e08de5adb6b4c501a3b24cf57cf71ddbaee1b4708e60a791096241834b96c354"} Jul 10 15:56:46.547147 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:46.547114 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-pllvl" Jul 10 15:56:46.550881 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:46.550837 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-pllvl" podStartSLOduration=1.894518486 podStartE2EDuration="24.550819592s" totalImagesPullingTime="22.656301106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:56:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:46.548158786 +0000 UTC m=+105.980643780" watchObservedRunningTime="2026-07-10 15:56:46.550819592 +0000 UTC m=+105.983304595" Jul 10 15:56:46.568171 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:46.567511 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65c9df797c-jkr2h" podStartSLOduration=4.567490929 podStartE2EDuration="4.567490929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:56:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:46.565822109 +0000 UTC m=+105.998307105" watchObservedRunningTime="2026-07-10 15:56:46.567490929 +0000 UTC m=+105.999975925" Jul 10 15:56:46.609391 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:46.607967 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jnx2h" podStartSLOduration=34.905048465 podStartE2EDuration="50.607942727s" totalImagesPullingTime="15.702894262s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 15:55:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:46.586993403 +0000 UTC m=+106.019478399" watchObservedRunningTime="2026-07-10 15:56:46.607942727 +0000 UTC m=+106.040427722" Jul 10 15:56:47.854121 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:47.853686 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d4547c7c-5ggsk"] Jul 10 15:56:50.568715 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:50.568670 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-cmmk5" event={"ID":"355ba7a5-930f-49d7-b8a4-6e64bf8f11ec","Type":"ContainerStarted","Data":"30e904cdea4344e9e76d1f66d12b240301c96673bd74809815cc958517ac3b72"} Jul 10 15:56:50.569207 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:50.568755 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-cmmk5" event={"ID":"355ba7a5-930f-49d7-b8a4-6e64bf8f11ec","Type":"ContainerStarted","Data":"22dbcb660e75bd6fbee51db23da30b72d636b1d09704e6c4ac54ab92624262c9"} Jul 10 15:56:50.569207 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:50.568786 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-cmmk5" event={"ID":"355ba7a5-930f-49d7-b8a4-6e64bf8f11ec","Type":"ContainerStarted","Data":"27e0322e9dae3e022bc4e723cdfe563db06a1eae5dc56703f1e0fddd45d1f087"} Jul 10 15:56:50.570452 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:50.570422 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" event={"ID":"6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9","Type":"ContainerStarted","Data":"aa98219df45c099fce369d132d85d8b8bebd2027d6ee048648625ee3ccef724e"} Jul 10 15:56:50.572230 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:50.572204 2562 generic.go:356] "Generic (PLEG): container finished" podID="16f68e38-0805-4827-bec3-6f7782a34505" containerID="974fe367cf145c06cca1189b9a1a9232cd298d423535df6346587ac857341603" exitCode=0 Jul 10 15:56:50.572361 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:50.572290 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"16f68e38-0805-4827-bec3-6f7782a34505","Type":"ContainerDied","Data":"974fe367cf145c06cca1189b9a1a9232cd298d423535df6346587ac857341603"} Jul 10 15:56:50.574884 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:50.574853 2562 generic.go:356] "Generic (PLEG): container finished" podID="57aa6454-baf4-4c62-8497-484be0ced21a" containerID="fc1ac6a0f9f0e81ab1f0284b8bfce14f4d9abaef02f06c3a6e99200fbfa18edc" exitCode=0 Jul 10 15:56:50.575020 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:50.574896 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9qhdn" event={"ID":"57aa6454-baf4-4c62-8497-484be0ced21a","Type":"ContainerDied","Data":"fc1ac6a0f9f0e81ab1f0284b8bfce14f4d9abaef02f06c3a6e99200fbfa18edc"} Jul 10 15:56:50.590454 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:50.590399 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-cmmk5" podStartSLOduration=10.002860937 podStartE2EDuration="13.590385216s" totalImagesPullingTime="3.587524279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:56:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:50.588839562 +0000 UTC m=+110.021324551" watchObservedRunningTime="2026-07-10 15:56:50.590385216 +0000 UTC m=+110.022870209" Jul 10 15:56:51.586263 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:51.586214 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9qhdn" event={"ID":"57aa6454-baf4-4c62-8497-484be0ced21a","Type":"ContainerStarted","Data":"b70d348d9c3587e5ae59e56fd7995e03d796957d894b5a208c3a4c27561d1933"} Jul 10 15:56:51.586915 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:51.586287 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9qhdn" event={"ID":"57aa6454-baf4-4c62-8497-484be0ced21a","Type":"ContainerStarted","Data":"c9bf7aa8f95b36203d0c8951ebbc972f1ce88900683857d43c4323a845067eb9"} Jul 10 15:56:51.616907 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:51.616855 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9qhdn" podStartSLOduration=10.465190163 podStartE2EDuration="14.616835639s" totalImagesPullingTime="3.985288732s" totalInitContainerRuntime="166.356744ms" isStatefulPod=true podCreationTimestamp="2026-07-10 15:56:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:51.615045413 +0000 UTC m=+111.047530431" watchObservedRunningTime="2026-07-10 15:56:51.616835639 +0000 UTC m=+111.049320635" Jul 10 15:56:51.618352 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:51.618306 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" podStartSLOduration=6.860609208 podStartE2EDuration="10.61829069s" totalImagesPullingTime="3.757681482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:50.668834463 +0000 UTC m=+110.101319460" watchObservedRunningTime="2026-07-10 15:56:51.61829069 +0000 UTC m=+111.050775688" Jul 10 15:56:52.537764 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:52.537721 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65c9df797c-jkr2h" Jul 10 15:56:52.537943 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:52.537794 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65c9df797c-jkr2h" Jul 10 15:56:52.543638 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:52.543612 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65c9df797c-jkr2h" Jul 10 15:56:52.596390 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:52.596354 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65c9df797c-jkr2h" Jul 10 15:56:52.649324 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:52.649278 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55bf7fcd64-mp722"] Jul 10 15:56:53.599111 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:53.599058 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"16f68e38-0805-4827-bec3-6f7782a34505","Type":"ContainerStarted","Data":"d13b79b4ad883d13f65bfef6645df51299614cf620aedefb25ebac37bd52de96"} Jul 10 15:56:53.599507 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:53.599176 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"16f68e38-0805-4827-bec3-6f7782a34505","Type":"ContainerStarted","Data":"66bc6f4dc759071785af3495ce15fbc62473e6a9c277678f4c6b157514994de7"} Jul 10 15:56:53.599507 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:53.599215 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"16f68e38-0805-4827-bec3-6f7782a34505","Type":"ContainerStarted","Data":"5fafd6bae2da8b3e5e07c7eac1a03a0773e55a9aec962bb07f66eb0912c096f4"} Jul 10 15:56:53.599507 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:53.599250 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"16f68e38-0805-4827-bec3-6f7782a34505","Type":"ContainerStarted","Data":"c9a42c10cbee2fa0368aa9c14cb2eaeab2f76b1085e746d2efd472f54d572089"} Jul 10 15:56:54.607613 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:54.607547 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"16f68e38-0805-4827-bec3-6f7782a34505","Type":"ContainerStarted","Data":"a21aaa9eb89500c798d73803c48ddf75107d96b4bb2af9540be27e17cf804c8a"} Jul 10 15:56:55.614371 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:55.614336 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"16f68e38-0805-4827-bec3-6f7782a34505","Type":"ContainerStarted","Data":"190fa24d78a7be42c346133198d010654add3c914eaf0d7efa56389eb6f6c88c"} Jul 10 15:56:55.650838 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:56:55.650783 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=10.335341716 podStartE2EDuration="17.650767248s" totalImagesPullingTime="7.285863163s" totalInitContainerRuntime="29.562369ms" isStatefulPod=false podCreationTimestamp="2026-07-10 15:56:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:56:55.649199504 +0000 UTC m=+115.081684499" watchObservedRunningTime="2026-07-10 15:56:55.650767248 +0000 UTC m=+115.083252241" Jul 10 15:57:02.357064 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:02.357024 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" Jul 10 15:57:02.357520 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:02.357092 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" Jul 10 15:57:02.665735 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:02.665628 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-75dc5577bb-lqvsq" podUID="d066bec7-44fb-42de-b31b-1bf5b1208a08" containerName="console" containerID="cri-o://0e69865c18d418e83053fc5deec056e92c01d50d104cdabdc14e686150c847ae" gracePeriod=15 Jul 10 15:57:02.941701 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:02.941630 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75dc5577bb-lqvsq" Jul 10 15:57:02.994518 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:02.994486 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d066bec7-44fb-42de-b31b-1bf5b1208a08-console-oauth-config\") pod \"d066bec7-44fb-42de-b31b-1bf5b1208a08\" (UID: \"d066bec7-44fb-42de-b31b-1bf5b1208a08\") " Jul 10 15:57:02.994696 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:02.994551 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d066bec7-44fb-42de-b31b-1bf5b1208a08-service-ca\") pod \"d066bec7-44fb-42de-b31b-1bf5b1208a08\" (UID: \"d066bec7-44fb-42de-b31b-1bf5b1208a08\") " Jul 10 15:57:02.994696 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:02.994612 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d066bec7-44fb-42de-b31b-1bf5b1208a08-oauth-serving-cert\") pod \"d066bec7-44fb-42de-b31b-1bf5b1208a08\" (UID: \"d066bec7-44fb-42de-b31b-1bf5b1208a08\") " Jul 10 15:57:02.994696 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:02.994642 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d066bec7-44fb-42de-b31b-1bf5b1208a08-console-config\") pod \"d066bec7-44fb-42de-b31b-1bf5b1208a08\" (UID: \"d066bec7-44fb-42de-b31b-1bf5b1208a08\") " Jul 10 15:57:02.994696 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:02.994679 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbjz7\" (UniqueName: \"kubernetes.io/projected/d066bec7-44fb-42de-b31b-1bf5b1208a08-kube-api-access-pbjz7\") pod \"d066bec7-44fb-42de-b31b-1bf5b1208a08\" (UID: \"d066bec7-44fb-42de-b31b-1bf5b1208a08\") " Jul 10 15:57:02.994906 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:02.994738 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d066bec7-44fb-42de-b31b-1bf5b1208a08-console-serving-cert\") pod \"d066bec7-44fb-42de-b31b-1bf5b1208a08\" (UID: \"d066bec7-44fb-42de-b31b-1bf5b1208a08\") " Jul 10 15:57:02.994988 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:02.994960 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d066bec7-44fb-42de-b31b-1bf5b1208a08-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d066bec7-44fb-42de-b31b-1bf5b1208a08" (UID: "d066bec7-44fb-42de-b31b-1bf5b1208a08"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:57:02.995033 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:02.994980 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d066bec7-44fb-42de-b31b-1bf5b1208a08-service-ca" (OuterVolumeSpecName: "service-ca") pod "d066bec7-44fb-42de-b31b-1bf5b1208a08" (UID: "d066bec7-44fb-42de-b31b-1bf5b1208a08"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:57:02.995033 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:02.995006 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d066bec7-44fb-42de-b31b-1bf5b1208a08-console-config" (OuterVolumeSpecName: "console-config") pod "d066bec7-44fb-42de-b31b-1bf5b1208a08" (UID: "d066bec7-44fb-42de-b31b-1bf5b1208a08"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:57:02.997016 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:02.996994 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d066bec7-44fb-42de-b31b-1bf5b1208a08-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d066bec7-44fb-42de-b31b-1bf5b1208a08" (UID: "d066bec7-44fb-42de-b31b-1bf5b1208a08"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:57:02.997016 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:02.997011 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d066bec7-44fb-42de-b31b-1bf5b1208a08-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d066bec7-44fb-42de-b31b-1bf5b1208a08" (UID: "d066bec7-44fb-42de-b31b-1bf5b1208a08"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:57:02.997135 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:02.997020 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d066bec7-44fb-42de-b31b-1bf5b1208a08-kube-api-access-pbjz7" (OuterVolumeSpecName: "kube-api-access-pbjz7") pod "d066bec7-44fb-42de-b31b-1bf5b1208a08" (UID: "d066bec7-44fb-42de-b31b-1bf5b1208a08"). InnerVolumeSpecName "kube-api-access-pbjz7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:57:03.096028 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:03.095991 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d066bec7-44fb-42de-b31b-1bf5b1208a08-oauth-serving-cert\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:57:03.096028 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:03.096025 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d066bec7-44fb-42de-b31b-1bf5b1208a08-console-config\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:57:03.096028 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:03.096034 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbjz7\" (UniqueName: \"kubernetes.io/projected/d066bec7-44fb-42de-b31b-1bf5b1208a08-kube-api-access-pbjz7\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:57:03.096254 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:03.096044 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d066bec7-44fb-42de-b31b-1bf5b1208a08-console-serving-cert\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:57:03.096254 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:03.096055 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d066bec7-44fb-42de-b31b-1bf5b1208a08-console-oauth-config\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:57:03.096254 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:03.096064 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d066bec7-44fb-42de-b31b-1bf5b1208a08-service-ca\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:57:03.645786 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:03.645756 2562 generic.go:356] "Generic (PLEG): container finished" podID="d066bec7-44fb-42de-b31b-1bf5b1208a08" containerID="0e69865c18d418e83053fc5deec056e92c01d50d104cdabdc14e686150c847ae" exitCode=0 Jul 10 15:57:03.646262 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:03.645812 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75dc5577bb-lqvsq" Jul 10 15:57:03.646262 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:03.645849 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75dc5577bb-lqvsq" event={"ID":"d066bec7-44fb-42de-b31b-1bf5b1208a08","Type":"ContainerDied","Data":"0e69865c18d418e83053fc5deec056e92c01d50d104cdabdc14e686150c847ae"} Jul 10 15:57:03.646262 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:03.645896 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75dc5577bb-lqvsq" event={"ID":"d066bec7-44fb-42de-b31b-1bf5b1208a08","Type":"ContainerDied","Data":"cfe71316299c69622cfd946e4b3c020ae9aa53305a688e8fa307d184cfe00ff9"} Jul 10 15:57:03.646262 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:03.645916 2562 scope.go:117] "RemoveContainer" containerID="0e69865c18d418e83053fc5deec056e92c01d50d104cdabdc14e686150c847ae" Jul 10 15:57:03.656146 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:03.655685 2562 scope.go:117] "RemoveContainer" containerID="0e69865c18d418e83053fc5deec056e92c01d50d104cdabdc14e686150c847ae" Jul 10 15:57:03.656146 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:57:03.656019 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e69865c18d418e83053fc5deec056e92c01d50d104cdabdc14e686150c847ae\": container with ID starting with 0e69865c18d418e83053fc5deec056e92c01d50d104cdabdc14e686150c847ae not found: ID does not exist" containerID="0e69865c18d418e83053fc5deec056e92c01d50d104cdabdc14e686150c847ae" Jul 10 15:57:03.656146 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:03.656056 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e69865c18d418e83053fc5deec056e92c01d50d104cdabdc14e686150c847ae"} err="failed to get container status \"0e69865c18d418e83053fc5deec056e92c01d50d104cdabdc14e686150c847ae\": rpc error: code = NotFound desc = could not find container \"0e69865c18d418e83053fc5deec056e92c01d50d104cdabdc14e686150c847ae\": container with ID starting with 0e69865c18d418e83053fc5deec056e92c01d50d104cdabdc14e686150c847ae not found: ID does not exist" Jul 10 15:57:03.669291 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:03.669269 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75dc5577bb-lqvsq"] Jul 10 15:57:03.671133 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:03.671069 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75dc5577bb-lqvsq"] Jul 10 15:57:04.988863 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:04.988821 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d066bec7-44fb-42de-b31b-1bf5b1208a08" path="/var/lib/kubelet/pods/d066bec7-44fb-42de-b31b-1bf5b1208a08/volumes" Jul 10 15:57:10.762805 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:10.762770 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30cc000d-f3a7-453b-a542-d3f9af19fefb-metrics-certs\") pod \"network-metrics-daemon-b9hg4\" (UID: \"30cc000d-f3a7-453b-a542-d3f9af19fefb\") " pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:57:10.765200 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:10.765179 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30cc000d-f3a7-453b-a542-d3f9af19fefb-metrics-certs\") pod \"network-metrics-daemon-b9hg4\" (UID: \"30cc000d-f3a7-453b-a542-d3f9af19fefb\") " pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:57:10.900148 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:10.900116 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8rkdc\"" Jul 10 15:57:10.908309 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:10.908287 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9hg4" Jul 10 15:57:11.084150 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:11.084123 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b9hg4"] Jul 10 15:57:11.086627 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:57:11.086603 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30cc000d_f3a7_453b_a542_d3f9af19fefb.slice/crio-ad4bc082dfa5687bbd9ce19e77b10936cef41a43de0fa23032b508b4a5ff04ba WatchSource:0}: Error finding container ad4bc082dfa5687bbd9ce19e77b10936cef41a43de0fa23032b508b4a5ff04ba: Status 404 returned error can't find the container with id ad4bc082dfa5687bbd9ce19e77b10936cef41a43de0fa23032b508b4a5ff04ba Jul 10 15:57:11.678312 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:11.678280 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b9hg4" event={"ID":"30cc000d-f3a7-453b-a542-d3f9af19fefb","Type":"ContainerStarted","Data":"ad4bc082dfa5687bbd9ce19e77b10936cef41a43de0fa23032b508b4a5ff04ba"} Jul 10 15:57:12.887022 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:12.886947 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" podUID="690ed568-a2ec-4a7c-8d75-c11e65ef8733" containerName="registry" containerID="cri-o://14a279bfe79a0d004e1fa6f6619923f4ace95473f6c07d4fe7dbd802bddbbbe7" gracePeriod=30 Jul 10 15:57:13.172662 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.172636 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:57:13.288687 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.288654 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/690ed568-a2ec-4a7c-8d75-c11e65ef8733-ca-trust-extracted\") pod \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " Jul 10 15:57:13.288687 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.288686 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-tls\") pod \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " Jul 10 15:57:13.288919 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.288709 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6z8v\" (UniqueName: \"kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-kube-api-access-c6z8v\") pod \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " Jul 10 15:57:13.288919 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.288733 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/690ed568-a2ec-4a7c-8d75-c11e65ef8733-trusted-ca\") pod \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " Jul 10 15:57:13.288919 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.288747 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-certificates\") pod \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " Jul 10 15:57:13.288919 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.288787 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/690ed568-a2ec-4a7c-8d75-c11e65ef8733-installation-pull-secrets\") pod \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " Jul 10 15:57:13.288919 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.288814 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/690ed568-a2ec-4a7c-8d75-c11e65ef8733-image-registry-private-configuration\") pod \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " Jul 10 15:57:13.288919 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.288832 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-bound-sa-token\") pod \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\" (UID: \"690ed568-a2ec-4a7c-8d75-c11e65ef8733\") " Jul 10 15:57:13.289249 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.289216 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "690ed568-a2ec-4a7c-8d75-c11e65ef8733" (UID: "690ed568-a2ec-4a7c-8d75-c11e65ef8733"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:57:13.289307 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.289257 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/690ed568-a2ec-4a7c-8d75-c11e65ef8733-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "690ed568-a2ec-4a7c-8d75-c11e65ef8733" (UID: "690ed568-a2ec-4a7c-8d75-c11e65ef8733"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:57:13.291432 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.291375 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/690ed568-a2ec-4a7c-8d75-c11e65ef8733-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "690ed568-a2ec-4a7c-8d75-c11e65ef8733" (UID: "690ed568-a2ec-4a7c-8d75-c11e65ef8733"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:57:13.291432 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.291415 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "690ed568-a2ec-4a7c-8d75-c11e65ef8733" (UID: "690ed568-a2ec-4a7c-8d75-c11e65ef8733"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:57:13.291614 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.291551 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-kube-api-access-c6z8v" (OuterVolumeSpecName: "kube-api-access-c6z8v") pod "690ed568-a2ec-4a7c-8d75-c11e65ef8733" (UID: "690ed568-a2ec-4a7c-8d75-c11e65ef8733"). InnerVolumeSpecName "kube-api-access-c6z8v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:57:13.291664 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.291616 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "690ed568-a2ec-4a7c-8d75-c11e65ef8733" (UID: "690ed568-a2ec-4a7c-8d75-c11e65ef8733"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:57:13.291749 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.291731 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/690ed568-a2ec-4a7c-8d75-c11e65ef8733-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "690ed568-a2ec-4a7c-8d75-c11e65ef8733" (UID: "690ed568-a2ec-4a7c-8d75-c11e65ef8733"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:57:13.296998 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.296978 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/690ed568-a2ec-4a7c-8d75-c11e65ef8733-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "690ed568-a2ec-4a7c-8d75-c11e65ef8733" (UID: "690ed568-a2ec-4a7c-8d75-c11e65ef8733"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:57:13.389831 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.389755 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/690ed568-a2ec-4a7c-8d75-c11e65ef8733-ca-trust-extracted\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:57:13.389831 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.389782 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-tls\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:57:13.389831 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.389791 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6z8v\" (UniqueName: \"kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-kube-api-access-c6z8v\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:57:13.389831 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.389801 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/690ed568-a2ec-4a7c-8d75-c11e65ef8733-trusted-ca\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:57:13.389831 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.389810 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/690ed568-a2ec-4a7c-8d75-c11e65ef8733-registry-certificates\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:57:13.389831 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.389818 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/690ed568-a2ec-4a7c-8d75-c11e65ef8733-installation-pull-secrets\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:57:13.389831 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.389827 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/690ed568-a2ec-4a7c-8d75-c11e65ef8733-image-registry-private-configuration\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:57:13.389831 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.389835 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/690ed568-a2ec-4a7c-8d75-c11e65ef8733-bound-sa-token\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:57:13.688176 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.688134 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b9hg4" event={"ID":"30cc000d-f3a7-453b-a542-d3f9af19fefb","Type":"ContainerStarted","Data":"2d4f208b37d214c867f0f77036eda8cd83c8f1df4aaedb59f1b2f7bb4120f79e"} Jul 10 15:57:13.688337 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.688196 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b9hg4" event={"ID":"30cc000d-f3a7-453b-a542-d3f9af19fefb","Type":"ContainerStarted","Data":"294b37f92aec15fb3165261e0c620f8880689749344c41ec749ac5c1074c4c2e"} Jul 10 15:57:13.689301 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.689276 2562 generic.go:356] "Generic (PLEG): container finished" podID="690ed568-a2ec-4a7c-8d75-c11e65ef8733" containerID="14a279bfe79a0d004e1fa6f6619923f4ace95473f6c07d4fe7dbd802bddbbbe7" exitCode=0 Jul 10 15:57:13.689419 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.689316 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" Jul 10 15:57:13.689419 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.689322 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" event={"ID":"690ed568-a2ec-4a7c-8d75-c11e65ef8733","Type":"ContainerDied","Data":"14a279bfe79a0d004e1fa6f6619923f4ace95473f6c07d4fe7dbd802bddbbbe7"} Jul 10 15:57:13.689419 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.689353 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d4547c7c-5ggsk" event={"ID":"690ed568-a2ec-4a7c-8d75-c11e65ef8733","Type":"ContainerDied","Data":"2b4151ba34fa4e9ff0c3da8222c922558bef6f4e04dcc5895521a47c66ced9cf"} Jul 10 15:57:13.689419 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.689373 2562 scope.go:117] "RemoveContainer" containerID="14a279bfe79a0d004e1fa6f6619923f4ace95473f6c07d4fe7dbd802bddbbbe7" Jul 10 15:57:13.698042 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.698025 2562 scope.go:117] "RemoveContainer" containerID="14a279bfe79a0d004e1fa6f6619923f4ace95473f6c07d4fe7dbd802bddbbbe7" Jul 10 15:57:13.698306 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:57:13.698291 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14a279bfe79a0d004e1fa6f6619923f4ace95473f6c07d4fe7dbd802bddbbbe7\": container with ID starting with 14a279bfe79a0d004e1fa6f6619923f4ace95473f6c07d4fe7dbd802bddbbbe7 not found: ID does not exist" containerID="14a279bfe79a0d004e1fa6f6619923f4ace95473f6c07d4fe7dbd802bddbbbe7" Jul 10 15:57:13.698350 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.698315 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14a279bfe79a0d004e1fa6f6619923f4ace95473f6c07d4fe7dbd802bddbbbe7"} err="failed to get container status \"14a279bfe79a0d004e1fa6f6619923f4ace95473f6c07d4fe7dbd802bddbbbe7\": rpc error: code = NotFound desc = could not find container \"14a279bfe79a0d004e1fa6f6619923f4ace95473f6c07d4fe7dbd802bddbbbe7\": container with ID starting with 14a279bfe79a0d004e1fa6f6619923f4ace95473f6c07d4fe7dbd802bddbbbe7 not found: ID does not exist" Jul 10 15:57:13.710592 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.710531 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-b9hg4" podStartSLOduration=132.16462728 podStartE2EDuration="2m13.710517654s" totalImagesPullingTime="1.545890374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:55:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:57:13.709185709 +0000 UTC m=+133.141670704" watchObservedRunningTime="2026-07-10 15:57:13.710517654 +0000 UTC m=+133.143002649" Jul 10 15:57:13.726439 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.726414 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d4547c7c-5ggsk"] Jul 10 15:57:13.731800 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:13.731777 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-d4547c7c-5ggsk"] Jul 10 15:57:14.988065 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:14.988031 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="690ed568-a2ec-4a7c-8d75-c11e65ef8733" path="/var/lib/kubelet/pods/690ed568-a2ec-4a7c-8d75-c11e65ef8733/volumes" Jul 10 15:57:17.688126 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:17.688063 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-55bf7fcd64-mp722" podUID="c95b841c-6d89-4697-b372-336aa13af110" containerName="console" containerID="cri-o://11a5a09320a854b2c1f92730994fbc9898f02bed5fe15749ecd93fd994321e18" gracePeriod=15 Jul 10 15:57:17.953877 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:17.953805 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55bf7fcd64-mp722" Jul 10 15:57:18.029741 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.029710 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txjbj\" (UniqueName: \"kubernetes.io/projected/c95b841c-6d89-4697-b372-336aa13af110-kube-api-access-txjbj\") pod \"c95b841c-6d89-4697-b372-336aa13af110\" (UID: \"c95b841c-6d89-4697-b372-336aa13af110\") " Jul 10 15:57:18.029928 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.029811 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c95b841c-6d89-4697-b372-336aa13af110-trusted-ca-bundle\") pod \"c95b841c-6d89-4697-b372-336aa13af110\" (UID: \"c95b841c-6d89-4697-b372-336aa13af110\") " Jul 10 15:57:18.029928 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.029848 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c95b841c-6d89-4697-b372-336aa13af110-service-ca\") pod \"c95b841c-6d89-4697-b372-336aa13af110\" (UID: \"c95b841c-6d89-4697-b372-336aa13af110\") " Jul 10 15:57:18.029928 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.029877 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c95b841c-6d89-4697-b372-336aa13af110-console-oauth-config\") pod \"c95b841c-6d89-4697-b372-336aa13af110\" (UID: \"c95b841c-6d89-4697-b372-336aa13af110\") " Jul 10 15:57:18.030078 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.030001 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c95b841c-6d89-4697-b372-336aa13af110-console-serving-cert\") pod \"c95b841c-6d89-4697-b372-336aa13af110\" (UID: \"c95b841c-6d89-4697-b372-336aa13af110\") " Jul 10 15:57:18.030078 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.030042 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c95b841c-6d89-4697-b372-336aa13af110-console-config\") pod \"c95b841c-6d89-4697-b372-336aa13af110\" (UID: \"c95b841c-6d89-4697-b372-336aa13af110\") " Jul 10 15:57:18.030179 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.030094 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c95b841c-6d89-4697-b372-336aa13af110-oauth-serving-cert\") pod \"c95b841c-6d89-4697-b372-336aa13af110\" (UID: \"c95b841c-6d89-4697-b372-336aa13af110\") " Jul 10 15:57:18.030232 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.030204 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c95b841c-6d89-4697-b372-336aa13af110-service-ca" (OuterVolumeSpecName: "service-ca") pod "c95b841c-6d89-4697-b372-336aa13af110" (UID: "c95b841c-6d89-4697-b372-336aa13af110"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:57:18.030323 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.030298 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c95b841c-6d89-4697-b372-336aa13af110-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c95b841c-6d89-4697-b372-336aa13af110" (UID: "c95b841c-6d89-4697-b372-336aa13af110"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:57:18.030378 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.030365 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c95b841c-6d89-4697-b372-336aa13af110-service-ca\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:57:18.030473 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.030454 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c95b841c-6d89-4697-b372-336aa13af110-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c95b841c-6d89-4697-b372-336aa13af110" (UID: "c95b841c-6d89-4697-b372-336aa13af110"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:57:18.030723 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.030617 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c95b841c-6d89-4697-b372-336aa13af110-console-config" (OuterVolumeSpecName: "console-config") pod "c95b841c-6d89-4697-b372-336aa13af110" (UID: "c95b841c-6d89-4697-b372-336aa13af110"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:57:18.032002 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.031972 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c95b841c-6d89-4697-b372-336aa13af110-kube-api-access-txjbj" (OuterVolumeSpecName: "kube-api-access-txjbj") pod "c95b841c-6d89-4697-b372-336aa13af110" (UID: "c95b841c-6d89-4697-b372-336aa13af110"). InnerVolumeSpecName "kube-api-access-txjbj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:57:18.032136 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.032118 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c95b841c-6d89-4697-b372-336aa13af110-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c95b841c-6d89-4697-b372-336aa13af110" (UID: "c95b841c-6d89-4697-b372-336aa13af110"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:57:18.032181 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.032156 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c95b841c-6d89-4697-b372-336aa13af110-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c95b841c-6d89-4697-b372-336aa13af110" (UID: "c95b841c-6d89-4697-b372-336aa13af110"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:57:18.131270 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.131233 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c95b841c-6d89-4697-b372-336aa13af110-trusted-ca-bundle\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:57:18.131270 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.131266 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c95b841c-6d89-4697-b372-336aa13af110-console-oauth-config\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:57:18.131270 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.131278 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c95b841c-6d89-4697-b372-336aa13af110-console-serving-cert\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:57:18.131502 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.131290 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c95b841c-6d89-4697-b372-336aa13af110-console-config\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:57:18.131502 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.131304 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c95b841c-6d89-4697-b372-336aa13af110-oauth-serving-cert\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:57:18.131502 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.131315 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txjbj\" (UniqueName: \"kubernetes.io/projected/c95b841c-6d89-4697-b372-336aa13af110-kube-api-access-txjbj\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:57:18.715164 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.715125 2562 generic.go:356] "Generic (PLEG): container finished" podID="c95b841c-6d89-4697-b372-336aa13af110" containerID="11a5a09320a854b2c1f92730994fbc9898f02bed5fe15749ecd93fd994321e18" exitCode=0 Jul 10 15:57:18.715655 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.715175 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55bf7fcd64-mp722" Jul 10 15:57:18.715655 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.715218 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55bf7fcd64-mp722" event={"ID":"c95b841c-6d89-4697-b372-336aa13af110","Type":"ContainerDied","Data":"11a5a09320a854b2c1f92730994fbc9898f02bed5fe15749ecd93fd994321e18"} Jul 10 15:57:18.715655 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.715282 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55bf7fcd64-mp722" event={"ID":"c95b841c-6d89-4697-b372-336aa13af110","Type":"ContainerDied","Data":"989d25306c639926713876275a50c78ddbd381b87c1727db89d4210e7ea7e6ef"} Jul 10 15:57:18.715655 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.715313 2562 scope.go:117] "RemoveContainer" containerID="11a5a09320a854b2c1f92730994fbc9898f02bed5fe15749ecd93fd994321e18" Jul 10 15:57:18.723830 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.723810 2562 scope.go:117] "RemoveContainer" containerID="11a5a09320a854b2c1f92730994fbc9898f02bed5fe15749ecd93fd994321e18" Jul 10 15:57:18.724077 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:57:18.724060 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11a5a09320a854b2c1f92730994fbc9898f02bed5fe15749ecd93fd994321e18\": container with ID starting with 11a5a09320a854b2c1f92730994fbc9898f02bed5fe15749ecd93fd994321e18 not found: ID does not exist" containerID="11a5a09320a854b2c1f92730994fbc9898f02bed5fe15749ecd93fd994321e18" Jul 10 15:57:18.724121 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.724084 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11a5a09320a854b2c1f92730994fbc9898f02bed5fe15749ecd93fd994321e18"} err="failed to get container status \"11a5a09320a854b2c1f92730994fbc9898f02bed5fe15749ecd93fd994321e18\": rpc error: code = NotFound desc = could not find container \"11a5a09320a854b2c1f92730994fbc9898f02bed5fe15749ecd93fd994321e18\": container with ID starting with 11a5a09320a854b2c1f92730994fbc9898f02bed5fe15749ecd93fd994321e18 not found: ID does not exist" Jul 10 15:57:18.736643 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.736619 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55bf7fcd64-mp722"] Jul 10 15:57:18.740560 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.740540 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55bf7fcd64-mp722"] Jul 10 15:57:18.988419 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:18.988343 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c95b841c-6d89-4697-b372-336aa13af110" path="/var/lib/kubelet/pods/c95b841c-6d89-4697-b372-336aa13af110/volumes" Jul 10 15:57:22.362465 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:22.362428 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" Jul 10 15:57:22.366147 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:57:22.366122 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-fc56d5dbc-lmmww" Jul 10 15:58:01.846407 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:01.846369 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-647995b8b9-ngxrd"] Jul 10 15:58:01.846828 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:01.846664 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="690ed568-a2ec-4a7c-8d75-c11e65ef8733" containerName="registry" Jul 10 15:58:01.846828 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:01.846675 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="690ed568-a2ec-4a7c-8d75-c11e65ef8733" containerName="registry" Jul 10 15:58:01.846828 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:01.846686 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d066bec7-44fb-42de-b31b-1bf5b1208a08" containerName="console" Jul 10 15:58:01.846828 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:01.846691 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d066bec7-44fb-42de-b31b-1bf5b1208a08" containerName="console" Jul 10 15:58:01.846828 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:01.846706 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c95b841c-6d89-4697-b372-336aa13af110" containerName="console" Jul 10 15:58:01.846828 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:01.846712 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c95b841c-6d89-4697-b372-336aa13af110" containerName="console" Jul 10 15:58:01.846828 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:01.846759 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c95b841c-6d89-4697-b372-336aa13af110" containerName="console" Jul 10 15:58:01.846828 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:01.846766 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="690ed568-a2ec-4a7c-8d75-c11e65ef8733" containerName="registry" Jul 10 15:58:01.846828 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:01.846773 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d066bec7-44fb-42de-b31b-1bf5b1208a08" containerName="console" Jul 10 15:58:01.851307 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:01.851281 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" Jul 10 15:58:01.854072 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:01.854017 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-vzkbj\"" Jul 10 15:58:01.854072 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:01.854043 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 10 15:58:01.854072 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:01.854044 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 10 15:58:01.854367 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:01.854118 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 10 15:58:01.854474 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:01.854457 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 10 15:58:01.855185 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:01.855165 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 10 15:58:01.860549 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:01.860529 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 10 15:58:01.867058 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:01.867030 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-647995b8b9-ngxrd"] Jul 10 15:58:01.983688 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:01.983647 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/71e58bd6-3651-4401-8415-21953920c1b7-secret-telemeter-client\") pod \"telemeter-client-647995b8b9-ngxrd\" (UID: \"71e58bd6-3651-4401-8415-21953920c1b7\") " pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" Jul 10 15:58:01.983688 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:01.983683 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kqt9\" (UniqueName: \"kubernetes.io/projected/71e58bd6-3651-4401-8415-21953920c1b7-kube-api-access-5kqt9\") pod \"telemeter-client-647995b8b9-ngxrd\" (UID: \"71e58bd6-3651-4401-8415-21953920c1b7\") " pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" Jul 10 15:58:01.983899 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:01.983716 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71e58bd6-3651-4401-8415-21953920c1b7-serving-certs-ca-bundle\") pod \"telemeter-client-647995b8b9-ngxrd\" (UID: \"71e58bd6-3651-4401-8415-21953920c1b7\") " pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" Jul 10 15:58:01.983899 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:01.983785 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71e58bd6-3651-4401-8415-21953920c1b7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-647995b8b9-ngxrd\" (UID: \"71e58bd6-3651-4401-8415-21953920c1b7\") " pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" Jul 10 15:58:01.983899 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:01.983827 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71e58bd6-3651-4401-8415-21953920c1b7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-647995b8b9-ngxrd\" (UID: \"71e58bd6-3651-4401-8415-21953920c1b7\") " pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" Jul 10 15:58:01.983995 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:01.983901 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/71e58bd6-3651-4401-8415-21953920c1b7-telemeter-client-tls\") pod \"telemeter-client-647995b8b9-ngxrd\" (UID: \"71e58bd6-3651-4401-8415-21953920c1b7\") " pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" Jul 10 15:58:01.983995 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:01.983919 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/71e58bd6-3651-4401-8415-21953920c1b7-federate-client-tls\") pod \"telemeter-client-647995b8b9-ngxrd\" (UID: \"71e58bd6-3651-4401-8415-21953920c1b7\") " pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" Jul 10 15:58:01.983995 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:01.983968 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71e58bd6-3651-4401-8415-21953920c1b7-metrics-client-ca\") pod \"telemeter-client-647995b8b9-ngxrd\" (UID: \"71e58bd6-3651-4401-8415-21953920c1b7\") " pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" Jul 10 15:58:02.085287 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:02.085240 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/71e58bd6-3651-4401-8415-21953920c1b7-secret-telemeter-client\") pod \"telemeter-client-647995b8b9-ngxrd\" (UID: \"71e58bd6-3651-4401-8415-21953920c1b7\") " pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" Jul 10 15:58:02.085287 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:02.085286 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kqt9\" (UniqueName: \"kubernetes.io/projected/71e58bd6-3651-4401-8415-21953920c1b7-kube-api-access-5kqt9\") pod \"telemeter-client-647995b8b9-ngxrd\" (UID: \"71e58bd6-3651-4401-8415-21953920c1b7\") " pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" Jul 10 15:58:02.085533 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:02.085313 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71e58bd6-3651-4401-8415-21953920c1b7-serving-certs-ca-bundle\") pod \"telemeter-client-647995b8b9-ngxrd\" (UID: \"71e58bd6-3651-4401-8415-21953920c1b7\") " pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" Jul 10 15:58:02.085533 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:02.085346 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71e58bd6-3651-4401-8415-21953920c1b7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-647995b8b9-ngxrd\" (UID: \"71e58bd6-3651-4401-8415-21953920c1b7\") " pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" Jul 10 15:58:02.085533 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:02.085369 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71e58bd6-3651-4401-8415-21953920c1b7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-647995b8b9-ngxrd\" (UID: \"71e58bd6-3651-4401-8415-21953920c1b7\") " pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" Jul 10 15:58:02.085533 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:02.085414 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/71e58bd6-3651-4401-8415-21953920c1b7-telemeter-client-tls\") pod \"telemeter-client-647995b8b9-ngxrd\" (UID: \"71e58bd6-3651-4401-8415-21953920c1b7\") " pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" Jul 10 15:58:02.085533 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:02.085469 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/71e58bd6-3651-4401-8415-21953920c1b7-federate-client-tls\") pod \"telemeter-client-647995b8b9-ngxrd\" (UID: \"71e58bd6-3651-4401-8415-21953920c1b7\") " pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" Jul 10 15:58:02.085533 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:02.085509 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71e58bd6-3651-4401-8415-21953920c1b7-metrics-client-ca\") pod \"telemeter-client-647995b8b9-ngxrd\" (UID: \"71e58bd6-3651-4401-8415-21953920c1b7\") " pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" Jul 10 15:58:02.086419 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:02.086382 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71e58bd6-3651-4401-8415-21953920c1b7-serving-certs-ca-bundle\") pod \"telemeter-client-647995b8b9-ngxrd\" (UID: \"71e58bd6-3651-4401-8415-21953920c1b7\") " pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" Jul 10 15:58:02.086538 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:02.086423 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71e58bd6-3651-4401-8415-21953920c1b7-metrics-client-ca\") pod \"telemeter-client-647995b8b9-ngxrd\" (UID: \"71e58bd6-3651-4401-8415-21953920c1b7\") " pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" Jul 10 15:58:02.086765 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:02.086737 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71e58bd6-3651-4401-8415-21953920c1b7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-647995b8b9-ngxrd\" (UID: \"71e58bd6-3651-4401-8415-21953920c1b7\") " pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" Jul 10 15:58:02.088053 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:02.088028 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/71e58bd6-3651-4401-8415-21953920c1b7-secret-telemeter-client\") pod \"telemeter-client-647995b8b9-ngxrd\" (UID: \"71e58bd6-3651-4401-8415-21953920c1b7\") " pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" Jul 10 15:58:02.088154 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:02.088119 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71e58bd6-3651-4401-8415-21953920c1b7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-647995b8b9-ngxrd\" (UID: \"71e58bd6-3651-4401-8415-21953920c1b7\") " pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" Jul 10 15:58:02.088381 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:02.088366 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/71e58bd6-3651-4401-8415-21953920c1b7-telemeter-client-tls\") pod \"telemeter-client-647995b8b9-ngxrd\" (UID: \"71e58bd6-3651-4401-8415-21953920c1b7\") " pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" Jul 10 15:58:02.088464 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:02.088448 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/71e58bd6-3651-4401-8415-21953920c1b7-federate-client-tls\") pod \"telemeter-client-647995b8b9-ngxrd\" (UID: \"71e58bd6-3651-4401-8415-21953920c1b7\") " pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" Jul 10 15:58:02.094246 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:02.094223 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kqt9\" (UniqueName: \"kubernetes.io/projected/71e58bd6-3651-4401-8415-21953920c1b7-kube-api-access-5kqt9\") pod \"telemeter-client-647995b8b9-ngxrd\" (UID: \"71e58bd6-3651-4401-8415-21953920c1b7\") " pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" Jul 10 15:58:02.162629 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:02.162507 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" Jul 10 15:58:02.302514 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:02.302488 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-647995b8b9-ngxrd"] Jul 10 15:58:02.304469 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:58:02.304444 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71e58bd6_3651_4401_8415_21953920c1b7.slice/crio-8ef26bb766973eb4f58730c59e3ea0155ed661fcdbf61c9b745aaa5cb0a48c86 WatchSource:0}: Error finding container 8ef26bb766973eb4f58730c59e3ea0155ed661fcdbf61c9b745aaa5cb0a48c86: Status 404 returned error can't find the container with id 8ef26bb766973eb4f58730c59e3ea0155ed661fcdbf61c9b745aaa5cb0a48c86 Jul 10 15:58:02.895083 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:02.895046 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" event={"ID":"71e58bd6-3651-4401-8415-21953920c1b7","Type":"ContainerStarted","Data":"8ef26bb766973eb4f58730c59e3ea0155ed661fcdbf61c9b745aaa5cb0a48c86"} Jul 10 15:58:04.904991 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:04.904954 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" event={"ID":"71e58bd6-3651-4401-8415-21953920c1b7","Type":"ContainerStarted","Data":"2171fe4bb456ac7d39698965871080b9f29693b5b54546187feefff46ddd80e6"} Jul 10 15:58:04.905356 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:04.905017 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" event={"ID":"71e58bd6-3651-4401-8415-21953920c1b7","Type":"ContainerStarted","Data":"dd52a8de821f1d8d8c0a2747cb3f9721e79b94edca7091e124c331c95a91587f"} Jul 10 15:58:04.905356 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:04.905042 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" event={"ID":"71e58bd6-3651-4401-8415-21953920c1b7","Type":"ContainerStarted","Data":"94953e1b56dabd4ca09c7de1d3386669939352a3a6a58cbd11a01e7913716f56"} Jul 10 15:58:04.932816 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:04.932766 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-647995b8b9-ngxrd" podStartSLOduration=2.182012267 podStartE2EDuration="3.932720343s" totalImagesPullingTime="1.750708076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:58:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:58:04.931892175 +0000 UTC m=+184.364377170" watchObservedRunningTime="2026-07-10 15:58:04.932720343 +0000 UTC m=+184.365205337" Jul 10 15:58:05.650535 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:05.650501 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-678799d969-gg79c"] Jul 10 15:58:05.653772 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:05.653751 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-678799d969-gg79c" Jul 10 15:58:05.666241 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:05.666212 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-678799d969-gg79c"] Jul 10 15:58:05.718709 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:05.718674 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/079a5c14-9d8e-4648-90b9-cce8d226a8de-console-oauth-config\") pod \"console-678799d969-gg79c\" (UID: \"079a5c14-9d8e-4648-90b9-cce8d226a8de\") " pod="openshift-console/console-678799d969-gg79c" Jul 10 15:58:05.718872 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:05.718720 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/079a5c14-9d8e-4648-90b9-cce8d226a8de-console-config\") pod \"console-678799d969-gg79c\" (UID: \"079a5c14-9d8e-4648-90b9-cce8d226a8de\") " pod="openshift-console/console-678799d969-gg79c" Jul 10 15:58:05.718872 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:05.718740 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/079a5c14-9d8e-4648-90b9-cce8d226a8de-service-ca\") pod \"console-678799d969-gg79c\" (UID: \"079a5c14-9d8e-4648-90b9-cce8d226a8de\") " pod="openshift-console/console-678799d969-gg79c" Jul 10 15:58:05.718872 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:05.718767 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/079a5c14-9d8e-4648-90b9-cce8d226a8de-oauth-serving-cert\") pod \"console-678799d969-gg79c\" (UID: \"079a5c14-9d8e-4648-90b9-cce8d226a8de\") " pod="openshift-console/console-678799d969-gg79c" Jul 10 15:58:05.718872 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:05.718859 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/079a5c14-9d8e-4648-90b9-cce8d226a8de-trusted-ca-bundle\") pod \"console-678799d969-gg79c\" (UID: \"079a5c14-9d8e-4648-90b9-cce8d226a8de\") " pod="openshift-console/console-678799d969-gg79c" Jul 10 15:58:05.719018 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:05.718894 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z8d4\" (UniqueName: \"kubernetes.io/projected/079a5c14-9d8e-4648-90b9-cce8d226a8de-kube-api-access-9z8d4\") pod \"console-678799d969-gg79c\" (UID: \"079a5c14-9d8e-4648-90b9-cce8d226a8de\") " pod="openshift-console/console-678799d969-gg79c" Jul 10 15:58:05.719018 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:05.718917 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/079a5c14-9d8e-4648-90b9-cce8d226a8de-console-serving-cert\") pod \"console-678799d969-gg79c\" (UID: \"079a5c14-9d8e-4648-90b9-cce8d226a8de\") " pod="openshift-console/console-678799d969-gg79c" Jul 10 15:58:05.819905 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:05.819872 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/079a5c14-9d8e-4648-90b9-cce8d226a8de-trusted-ca-bundle\") pod \"console-678799d969-gg79c\" (UID: \"079a5c14-9d8e-4648-90b9-cce8d226a8de\") " pod="openshift-console/console-678799d969-gg79c" Jul 10 15:58:05.820060 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:05.819908 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z8d4\" (UniqueName: \"kubernetes.io/projected/079a5c14-9d8e-4648-90b9-cce8d226a8de-kube-api-access-9z8d4\") pod \"console-678799d969-gg79c\" (UID: \"079a5c14-9d8e-4648-90b9-cce8d226a8de\") " pod="openshift-console/console-678799d969-gg79c" Jul 10 15:58:05.820060 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:05.819933 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/079a5c14-9d8e-4648-90b9-cce8d226a8de-console-serving-cert\") pod \"console-678799d969-gg79c\" (UID: \"079a5c14-9d8e-4648-90b9-cce8d226a8de\") " pod="openshift-console/console-678799d969-gg79c" Jul 10 15:58:05.820060 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:05.819959 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/079a5c14-9d8e-4648-90b9-cce8d226a8de-console-oauth-config\") pod \"console-678799d969-gg79c\" (UID: \"079a5c14-9d8e-4648-90b9-cce8d226a8de\") " pod="openshift-console/console-678799d969-gg79c" Jul 10 15:58:05.820060 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:05.819983 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/079a5c14-9d8e-4648-90b9-cce8d226a8de-console-config\") pod \"console-678799d969-gg79c\" (UID: \"079a5c14-9d8e-4648-90b9-cce8d226a8de\") " pod="openshift-console/console-678799d969-gg79c" Jul 10 15:58:05.820060 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:05.820010 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/079a5c14-9d8e-4648-90b9-cce8d226a8de-service-ca\") pod \"console-678799d969-gg79c\" (UID: \"079a5c14-9d8e-4648-90b9-cce8d226a8de\") " pod="openshift-console/console-678799d969-gg79c" Jul 10 15:58:05.820060 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:05.820038 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/079a5c14-9d8e-4648-90b9-cce8d226a8de-oauth-serving-cert\") pod \"console-678799d969-gg79c\" (UID: \"079a5c14-9d8e-4648-90b9-cce8d226a8de\") " pod="openshift-console/console-678799d969-gg79c" Jul 10 15:58:05.820820 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:05.820782 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/079a5c14-9d8e-4648-90b9-cce8d226a8de-service-ca\") pod \"console-678799d969-gg79c\" (UID: \"079a5c14-9d8e-4648-90b9-cce8d226a8de\") " pod="openshift-console/console-678799d969-gg79c" Jul 10 15:58:05.820820 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:05.820791 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/079a5c14-9d8e-4648-90b9-cce8d226a8de-oauth-serving-cert\") pod \"console-678799d969-gg79c\" (UID: \"079a5c14-9d8e-4648-90b9-cce8d226a8de\") " pod="openshift-console/console-678799d969-gg79c" Jul 10 15:58:05.821067 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:05.821041 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/079a5c14-9d8e-4648-90b9-cce8d226a8de-console-config\") pod \"console-678799d969-gg79c\" (UID: \"079a5c14-9d8e-4648-90b9-cce8d226a8de\") " pod="openshift-console/console-678799d969-gg79c" Jul 10 15:58:05.821106 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:05.821074 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/079a5c14-9d8e-4648-90b9-cce8d226a8de-trusted-ca-bundle\") pod \"console-678799d969-gg79c\" (UID: \"079a5c14-9d8e-4648-90b9-cce8d226a8de\") " pod="openshift-console/console-678799d969-gg79c" Jul 10 15:58:05.822655 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:05.822633 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/079a5c14-9d8e-4648-90b9-cce8d226a8de-console-oauth-config\") pod \"console-678799d969-gg79c\" (UID: \"079a5c14-9d8e-4648-90b9-cce8d226a8de\") " pod="openshift-console/console-678799d969-gg79c" Jul 10 15:58:05.822750 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:05.822688 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/079a5c14-9d8e-4648-90b9-cce8d226a8de-console-serving-cert\") pod \"console-678799d969-gg79c\" (UID: \"079a5c14-9d8e-4648-90b9-cce8d226a8de\") " pod="openshift-console/console-678799d969-gg79c" Jul 10 15:58:05.828013 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:05.827992 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z8d4\" (UniqueName: \"kubernetes.io/projected/079a5c14-9d8e-4648-90b9-cce8d226a8de-kube-api-access-9z8d4\") pod \"console-678799d969-gg79c\" (UID: \"079a5c14-9d8e-4648-90b9-cce8d226a8de\") " pod="openshift-console/console-678799d969-gg79c" Jul 10 15:58:05.963236 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:05.963145 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-678799d969-gg79c" Jul 10 15:58:06.118054 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:06.118022 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-678799d969-gg79c"] Jul 10 15:58:06.121368 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:58:06.121337 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod079a5c14_9d8e_4648_90b9_cce8d226a8de.slice/crio-17a3f090b56c8ebcece8ec7d78ab3de7d55fc3db8c86800f58dd6144204529f6 WatchSource:0}: Error finding container 17a3f090b56c8ebcece8ec7d78ab3de7d55fc3db8c86800f58dd6144204529f6: Status 404 returned error can't find the container with id 17a3f090b56c8ebcece8ec7d78ab3de7d55fc3db8c86800f58dd6144204529f6 Jul 10 15:58:06.915596 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:06.915535 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-678799d969-gg79c" event={"ID":"079a5c14-9d8e-4648-90b9-cce8d226a8de","Type":"ContainerStarted","Data":"d17f68faad5d1f22f4fdc50d99e832b017dc0fde6bc62c2715dd85d4c71ae27d"} Jul 10 15:58:06.915807 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:06.915624 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-678799d969-gg79c" event={"ID":"079a5c14-9d8e-4648-90b9-cce8d226a8de","Type":"ContainerStarted","Data":"17a3f090b56c8ebcece8ec7d78ab3de7d55fc3db8c86800f58dd6144204529f6"} Jul 10 15:58:06.934705 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:06.934655 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-678799d969-gg79c" podStartSLOduration=1.934639985 podStartE2EDuration="1.934639985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:58:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:58:06.933355034 +0000 UTC m=+186.365840030" watchObservedRunningTime="2026-07-10 15:58:06.934639985 +0000 UTC m=+186.367124978" Jul 10 15:58:14.817667 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:14.817630 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-678799d969-gg79c"] Jul 10 15:58:14.849014 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:14.848983 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8584664959-z8k5m"] Jul 10 15:58:14.852621 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:14.852602 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8584664959-z8k5m" Jul 10 15:58:14.862787 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:14.862769 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8584664959-z8k5m"] Jul 10 15:58:15.006647 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:15.006617 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81d0ff10-85b2-4092-8d0b-68911890cc7b-service-ca\") pod \"console-8584664959-z8k5m\" (UID: \"81d0ff10-85b2-4092-8d0b-68911890cc7b\") " pod="openshift-console/console-8584664959-z8k5m" Jul 10 15:58:15.006647 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:15.006650 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfm4j\" (UniqueName: \"kubernetes.io/projected/81d0ff10-85b2-4092-8d0b-68911890cc7b-kube-api-access-vfm4j\") pod \"console-8584664959-z8k5m\" (UID: \"81d0ff10-85b2-4092-8d0b-68911890cc7b\") " pod="openshift-console/console-8584664959-z8k5m" Jul 10 15:58:15.006888 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:15.006683 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81d0ff10-85b2-4092-8d0b-68911890cc7b-console-serving-cert\") pod \"console-8584664959-z8k5m\" (UID: \"81d0ff10-85b2-4092-8d0b-68911890cc7b\") " pod="openshift-console/console-8584664959-z8k5m" Jul 10 15:58:15.006888 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:15.006776 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81d0ff10-85b2-4092-8d0b-68911890cc7b-console-oauth-config\") pod \"console-8584664959-z8k5m\" (UID: \"81d0ff10-85b2-4092-8d0b-68911890cc7b\") " pod="openshift-console/console-8584664959-z8k5m" Jul 10 15:58:15.006888 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:15.006809 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81d0ff10-85b2-4092-8d0b-68911890cc7b-trusted-ca-bundle\") pod \"console-8584664959-z8k5m\" (UID: \"81d0ff10-85b2-4092-8d0b-68911890cc7b\") " pod="openshift-console/console-8584664959-z8k5m" Jul 10 15:58:15.006888 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:15.006863 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81d0ff10-85b2-4092-8d0b-68911890cc7b-oauth-serving-cert\") pod \"console-8584664959-z8k5m\" (UID: \"81d0ff10-85b2-4092-8d0b-68911890cc7b\") " pod="openshift-console/console-8584664959-z8k5m" Jul 10 15:58:15.007035 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:15.006907 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81d0ff10-85b2-4092-8d0b-68911890cc7b-console-config\") pod \"console-8584664959-z8k5m\" (UID: \"81d0ff10-85b2-4092-8d0b-68911890cc7b\") " pod="openshift-console/console-8584664959-z8k5m" Jul 10 15:58:15.108186 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:15.108090 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81d0ff10-85b2-4092-8d0b-68911890cc7b-service-ca\") pod \"console-8584664959-z8k5m\" (UID: \"81d0ff10-85b2-4092-8d0b-68911890cc7b\") " pod="openshift-console/console-8584664959-z8k5m" Jul 10 15:58:15.108186 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:15.108140 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfm4j\" (UniqueName: \"kubernetes.io/projected/81d0ff10-85b2-4092-8d0b-68911890cc7b-kube-api-access-vfm4j\") pod \"console-8584664959-z8k5m\" (UID: \"81d0ff10-85b2-4092-8d0b-68911890cc7b\") " pod="openshift-console/console-8584664959-z8k5m" Jul 10 15:58:15.108404 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:15.108188 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81d0ff10-85b2-4092-8d0b-68911890cc7b-console-serving-cert\") pod \"console-8584664959-z8k5m\" (UID: \"81d0ff10-85b2-4092-8d0b-68911890cc7b\") " pod="openshift-console/console-8584664959-z8k5m" Jul 10 15:58:15.108404 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:15.108222 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81d0ff10-85b2-4092-8d0b-68911890cc7b-console-oauth-config\") pod \"console-8584664959-z8k5m\" (UID: \"81d0ff10-85b2-4092-8d0b-68911890cc7b\") " pod="openshift-console/console-8584664959-z8k5m" Jul 10 15:58:15.108404 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:15.108242 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81d0ff10-85b2-4092-8d0b-68911890cc7b-trusted-ca-bundle\") pod \"console-8584664959-z8k5m\" (UID: \"81d0ff10-85b2-4092-8d0b-68911890cc7b\") " pod="openshift-console/console-8584664959-z8k5m" Jul 10 15:58:15.108404 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:15.108273 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81d0ff10-85b2-4092-8d0b-68911890cc7b-oauth-serving-cert\") pod \"console-8584664959-z8k5m\" (UID: \"81d0ff10-85b2-4092-8d0b-68911890cc7b\") " pod="openshift-console/console-8584664959-z8k5m" Jul 10 15:58:15.108404 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:15.108318 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81d0ff10-85b2-4092-8d0b-68911890cc7b-console-config\") pod \"console-8584664959-z8k5m\" (UID: \"81d0ff10-85b2-4092-8d0b-68911890cc7b\") " pod="openshift-console/console-8584664959-z8k5m" Jul 10 15:58:15.109017 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:15.108994 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81d0ff10-85b2-4092-8d0b-68911890cc7b-console-config\") pod \"console-8584664959-z8k5m\" (UID: \"81d0ff10-85b2-4092-8d0b-68911890cc7b\") " pod="openshift-console/console-8584664959-z8k5m" Jul 10 15:58:15.109103 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:15.109046 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81d0ff10-85b2-4092-8d0b-68911890cc7b-oauth-serving-cert\") pod \"console-8584664959-z8k5m\" (UID: \"81d0ff10-85b2-4092-8d0b-68911890cc7b\") " pod="openshift-console/console-8584664959-z8k5m" Jul 10 15:58:15.109169 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:15.109148 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81d0ff10-85b2-4092-8d0b-68911890cc7b-service-ca\") pod \"console-8584664959-z8k5m\" (UID: \"81d0ff10-85b2-4092-8d0b-68911890cc7b\") " pod="openshift-console/console-8584664959-z8k5m" Jul 10 15:58:15.109534 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:15.109510 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81d0ff10-85b2-4092-8d0b-68911890cc7b-trusted-ca-bundle\") pod \"console-8584664959-z8k5m\" (UID: \"81d0ff10-85b2-4092-8d0b-68911890cc7b\") " pod="openshift-console/console-8584664959-z8k5m" Jul 10 15:58:15.110843 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:15.110821 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81d0ff10-85b2-4092-8d0b-68911890cc7b-console-serving-cert\") pod \"console-8584664959-z8k5m\" (UID: \"81d0ff10-85b2-4092-8d0b-68911890cc7b\") " pod="openshift-console/console-8584664959-z8k5m" Jul 10 15:58:15.110929 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:15.110874 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81d0ff10-85b2-4092-8d0b-68911890cc7b-console-oauth-config\") pod \"console-8584664959-z8k5m\" (UID: \"81d0ff10-85b2-4092-8d0b-68911890cc7b\") " pod="openshift-console/console-8584664959-z8k5m" Jul 10 15:58:15.117722 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:15.117697 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfm4j\" (UniqueName: \"kubernetes.io/projected/81d0ff10-85b2-4092-8d0b-68911890cc7b-kube-api-access-vfm4j\") pod \"console-8584664959-z8k5m\" (UID: \"81d0ff10-85b2-4092-8d0b-68911890cc7b\") " pod="openshift-console/console-8584664959-z8k5m" Jul 10 15:58:15.162120 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:15.162091 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8584664959-z8k5m" Jul 10 15:58:15.293611 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:15.293555 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8584664959-z8k5m"] Jul 10 15:58:15.295468 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:58:15.295442 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81d0ff10_85b2_4092_8d0b_68911890cc7b.slice/crio-ac00a9338034f08d04333361a6d77336bb2bf664cf2fb5b2fde8dc7636e92d85 WatchSource:0}: Error finding container ac00a9338034f08d04333361a6d77336bb2bf664cf2fb5b2fde8dc7636e92d85: Status 404 returned error can't find the container with id ac00a9338034f08d04333361a6d77336bb2bf664cf2fb5b2fde8dc7636e92d85 Jul 10 15:58:15.951114 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:15.951078 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8584664959-z8k5m" event={"ID":"81d0ff10-85b2-4092-8d0b-68911890cc7b","Type":"ContainerStarted","Data":"563f27d61b1713fbbf5b768acb58104e4ed3e22322fe217e8a8ca8657f4f3f77"} Jul 10 15:58:15.951482 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:15.951129 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8584664959-z8k5m" event={"ID":"81d0ff10-85b2-4092-8d0b-68911890cc7b","Type":"ContainerStarted","Data":"ac00a9338034f08d04333361a6d77336bb2bf664cf2fb5b2fde8dc7636e92d85"} Jul 10 15:58:15.963678 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:15.963658 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-678799d969-gg79c" Jul 10 15:58:15.970859 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:15.970799 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8584664959-z8k5m" podStartSLOduration=1.970781584 podStartE2EDuration="1.970781584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:58:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:58:15.968477535 +0000 UTC m=+195.400962525" watchObservedRunningTime="2026-07-10 15:58:15.970781584 +0000 UTC m=+195.403266579" Jul 10 15:58:25.162889 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:25.162848 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8584664959-z8k5m" Jul 10 15:58:25.163272 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:25.162907 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8584664959-z8k5m" Jul 10 15:58:25.167584 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:25.167548 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8584664959-z8k5m" Jul 10 15:58:25.995936 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:25.995907 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8584664959-z8k5m" Jul 10 15:58:26.051296 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:26.051266 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65c9df797c-jkr2h"] Jul 10 15:58:39.837946 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:39.837866 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-678799d969-gg79c" podUID="079a5c14-9d8e-4648-90b9-cce8d226a8de" containerName="console" containerID="cri-o://d17f68faad5d1f22f4fdc50d99e832b017dc0fde6bc62c2715dd85d4c71ae27d" gracePeriod=15 Jul 10 15:58:40.045799 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:40.045766 2562 generic.go:356] "Generic (PLEG): container finished" podID="079a5c14-9d8e-4648-90b9-cce8d226a8de" containerID="d17f68faad5d1f22f4fdc50d99e832b017dc0fde6bc62c2715dd85d4c71ae27d" exitCode=0 Jul 10 15:58:40.045959 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:40.045842 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-678799d969-gg79c" event={"ID":"079a5c14-9d8e-4648-90b9-cce8d226a8de","Type":"ContainerDied","Data":"d17f68faad5d1f22f4fdc50d99e832b017dc0fde6bc62c2715dd85d4c71ae27d"} Jul 10 15:58:40.079783 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:40.079756 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-678799d969-gg79c" Jul 10 15:58:40.129511 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:40.129429 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9z8d4\" (UniqueName: \"kubernetes.io/projected/079a5c14-9d8e-4648-90b9-cce8d226a8de-kube-api-access-9z8d4\") pod \"079a5c14-9d8e-4648-90b9-cce8d226a8de\" (UID: \"079a5c14-9d8e-4648-90b9-cce8d226a8de\") " Jul 10 15:58:40.129511 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:40.129469 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/079a5c14-9d8e-4648-90b9-cce8d226a8de-console-config\") pod \"079a5c14-9d8e-4648-90b9-cce8d226a8de\" (UID: \"079a5c14-9d8e-4648-90b9-cce8d226a8de\") " Jul 10 15:58:40.129511 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:40.129493 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/079a5c14-9d8e-4648-90b9-cce8d226a8de-console-serving-cert\") pod \"079a5c14-9d8e-4648-90b9-cce8d226a8de\" (UID: \"079a5c14-9d8e-4648-90b9-cce8d226a8de\") " Jul 10 15:58:40.129809 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:40.129524 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/079a5c14-9d8e-4648-90b9-cce8d226a8de-service-ca\") pod \"079a5c14-9d8e-4648-90b9-cce8d226a8de\" (UID: \"079a5c14-9d8e-4648-90b9-cce8d226a8de\") " Jul 10 15:58:40.129809 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:40.129553 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/079a5c14-9d8e-4648-90b9-cce8d226a8de-console-oauth-config\") pod \"079a5c14-9d8e-4648-90b9-cce8d226a8de\" (UID: \"079a5c14-9d8e-4648-90b9-cce8d226a8de\") " Jul 10 15:58:40.129809 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:40.129597 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/079a5c14-9d8e-4648-90b9-cce8d226a8de-trusted-ca-bundle\") pod \"079a5c14-9d8e-4648-90b9-cce8d226a8de\" (UID: \"079a5c14-9d8e-4648-90b9-cce8d226a8de\") " Jul 10 15:58:40.129809 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:40.129615 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/079a5c14-9d8e-4648-90b9-cce8d226a8de-oauth-serving-cert\") pod \"079a5c14-9d8e-4648-90b9-cce8d226a8de\" (UID: \"079a5c14-9d8e-4648-90b9-cce8d226a8de\") " Jul 10 15:58:40.130073 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:40.130034 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/079a5c14-9d8e-4648-90b9-cce8d226a8de-console-config" (OuterVolumeSpecName: "console-config") pod "079a5c14-9d8e-4648-90b9-cce8d226a8de" (UID: "079a5c14-9d8e-4648-90b9-cce8d226a8de"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:58:40.130143 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:40.130068 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/079a5c14-9d8e-4648-90b9-cce8d226a8de-service-ca" (OuterVolumeSpecName: "service-ca") pod "079a5c14-9d8e-4648-90b9-cce8d226a8de" (UID: "079a5c14-9d8e-4648-90b9-cce8d226a8de"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:58:40.130143 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:40.130088 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/079a5c14-9d8e-4648-90b9-cce8d226a8de-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "079a5c14-9d8e-4648-90b9-cce8d226a8de" (UID: "079a5c14-9d8e-4648-90b9-cce8d226a8de"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:58:40.130205 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:40.130138 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/079a5c14-9d8e-4648-90b9-cce8d226a8de-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "079a5c14-9d8e-4648-90b9-cce8d226a8de" (UID: "079a5c14-9d8e-4648-90b9-cce8d226a8de"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:58:40.131848 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:40.131827 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/079a5c14-9d8e-4648-90b9-cce8d226a8de-kube-api-access-9z8d4" (OuterVolumeSpecName: "kube-api-access-9z8d4") pod "079a5c14-9d8e-4648-90b9-cce8d226a8de" (UID: "079a5c14-9d8e-4648-90b9-cce8d226a8de"). InnerVolumeSpecName "kube-api-access-9z8d4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:58:40.132365 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:40.132348 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/079a5c14-9d8e-4648-90b9-cce8d226a8de-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "079a5c14-9d8e-4648-90b9-cce8d226a8de" (UID: "079a5c14-9d8e-4648-90b9-cce8d226a8de"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:58:40.132451 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:40.132368 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/079a5c14-9d8e-4648-90b9-cce8d226a8de-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "079a5c14-9d8e-4648-90b9-cce8d226a8de" (UID: "079a5c14-9d8e-4648-90b9-cce8d226a8de"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:58:40.230371 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:40.230340 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9z8d4\" (UniqueName: \"kubernetes.io/projected/079a5c14-9d8e-4648-90b9-cce8d226a8de-kube-api-access-9z8d4\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:58:40.230371 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:40.230367 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/079a5c14-9d8e-4648-90b9-cce8d226a8de-console-config\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:58:40.230371 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:40.230376 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/079a5c14-9d8e-4648-90b9-cce8d226a8de-console-serving-cert\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:58:40.230592 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:40.230384 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/079a5c14-9d8e-4648-90b9-cce8d226a8de-service-ca\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:58:40.230592 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:40.230392 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/079a5c14-9d8e-4648-90b9-cce8d226a8de-console-oauth-config\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:58:40.230592 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:40.230400 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/079a5c14-9d8e-4648-90b9-cce8d226a8de-trusted-ca-bundle\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:58:40.230592 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:40.230407 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/079a5c14-9d8e-4648-90b9-cce8d226a8de-oauth-serving-cert\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:58:41.050905 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:41.050877 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-678799d969-gg79c" Jul 10 15:58:41.051334 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:41.050876 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-678799d969-gg79c" event={"ID":"079a5c14-9d8e-4648-90b9-cce8d226a8de","Type":"ContainerDied","Data":"17a3f090b56c8ebcece8ec7d78ab3de7d55fc3db8c86800f58dd6144204529f6"} Jul 10 15:58:41.051334 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:41.051007 2562 scope.go:117] "RemoveContainer" containerID="d17f68faad5d1f22f4fdc50d99e832b017dc0fde6bc62c2715dd85d4c71ae27d" Jul 10 15:58:41.068697 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:41.068676 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-678799d969-gg79c"] Jul 10 15:58:41.074478 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:41.074458 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-678799d969-gg79c"] Jul 10 15:58:42.988195 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:42.988161 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="079a5c14-9d8e-4648-90b9-cce8d226a8de" path="/var/lib/kubelet/pods/079a5c14-9d8e-4648-90b9-cce8d226a8de/volumes" Jul 10 15:58:51.072223 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:51.072165 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65c9df797c-jkr2h" podUID="4c51b773-6a21-4bfc-b1eb-43c792e7c0ed" containerName="console" containerID="cri-o://3fb065b1502f74685be6ed9a079ff575fe766a25b46c39a44a4c221d973dd788" gracePeriod=15 Jul 10 15:58:51.341326 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:51.341301 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65c9df797c-jkr2h" Jul 10 15:58:51.432983 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:51.432932 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-oauth-serving-cert\") pod \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\" (UID: \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\") " Jul 10 15:58:51.433149 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:51.433031 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2jll\" (UniqueName: \"kubernetes.io/projected/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-kube-api-access-j2jll\") pod \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\" (UID: \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\") " Jul 10 15:58:51.433149 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:51.433067 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-console-oauth-config\") pod \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\" (UID: \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\") " Jul 10 15:58:51.433149 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:51.433092 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-trusted-ca-bundle\") pod \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\" (UID: \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\") " Jul 10 15:58:51.433149 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:51.433143 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-console-config\") pod \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\" (UID: \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\") " Jul 10 15:58:51.433360 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:51.433158 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-service-ca\") pod \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\" (UID: \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\") " Jul 10 15:58:51.433360 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:51.433214 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-console-serving-cert\") pod \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\" (UID: \"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed\") " Jul 10 15:58:51.433487 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:51.433464 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4c51b773-6a21-4bfc-b1eb-43c792e7c0ed" (UID: "4c51b773-6a21-4bfc-b1eb-43c792e7c0ed"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:58:51.433549 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:51.433484 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-console-config" (OuterVolumeSpecName: "console-config") pod "4c51b773-6a21-4bfc-b1eb-43c792e7c0ed" (UID: "4c51b773-6a21-4bfc-b1eb-43c792e7c0ed"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:58:51.433549 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:51.433536 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4c51b773-6a21-4bfc-b1eb-43c792e7c0ed" (UID: "4c51b773-6a21-4bfc-b1eb-43c792e7c0ed"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:58:51.433669 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:51.433605 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-service-ca" (OuterVolumeSpecName: "service-ca") pod "4c51b773-6a21-4bfc-b1eb-43c792e7c0ed" (UID: "4c51b773-6a21-4bfc-b1eb-43c792e7c0ed"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:58:51.435238 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:51.435217 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4c51b773-6a21-4bfc-b1eb-43c792e7c0ed" (UID: "4c51b773-6a21-4bfc-b1eb-43c792e7c0ed"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:58:51.435338 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:51.435258 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-kube-api-access-j2jll" (OuterVolumeSpecName: "kube-api-access-j2jll") pod "4c51b773-6a21-4bfc-b1eb-43c792e7c0ed" (UID: "4c51b773-6a21-4bfc-b1eb-43c792e7c0ed"). InnerVolumeSpecName "kube-api-access-j2jll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:58:51.435338 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:51.435331 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4c51b773-6a21-4bfc-b1eb-43c792e7c0ed" (UID: "4c51b773-6a21-4bfc-b1eb-43c792e7c0ed"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:58:51.534677 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:51.534635 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-console-config\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:58:51.534677 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:51.534671 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-service-ca\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:58:51.534677 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:51.534681 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-console-serving-cert\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:58:51.534677 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:51.534690 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-oauth-serving-cert\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:58:51.534923 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:51.534698 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2jll\" (UniqueName: \"kubernetes.io/projected/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-kube-api-access-j2jll\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:58:51.534923 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:51.534709 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-console-oauth-config\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:58:51.534923 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:51.534719 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed-trusted-ca-bundle\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:58:52.091997 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:52.091960 2562 generic.go:356] "Generic (PLEG): container finished" podID="4c51b773-6a21-4bfc-b1eb-43c792e7c0ed" containerID="3fb065b1502f74685be6ed9a079ff575fe766a25b46c39a44a4c221d973dd788" exitCode=0 Jul 10 15:58:52.092423 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:52.092005 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65c9df797c-jkr2h" Jul 10 15:58:52.092423 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:52.092037 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65c9df797c-jkr2h" event={"ID":"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed","Type":"ContainerDied","Data":"3fb065b1502f74685be6ed9a079ff575fe766a25b46c39a44a4c221d973dd788"} Jul 10 15:58:52.092423 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:52.092084 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65c9df797c-jkr2h" event={"ID":"4c51b773-6a21-4bfc-b1eb-43c792e7c0ed","Type":"ContainerDied","Data":"b4b16eee8109f7bdb08c642a466168d0c378131b338de8ffd14e2dcd92853c76"} Jul 10 15:58:52.092423 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:52.092103 2562 scope.go:117] "RemoveContainer" containerID="3fb065b1502f74685be6ed9a079ff575fe766a25b46c39a44a4c221d973dd788" Jul 10 15:58:52.104049 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:52.104032 2562 scope.go:117] "RemoveContainer" containerID="3fb065b1502f74685be6ed9a079ff575fe766a25b46c39a44a4c221d973dd788" Jul 10 15:58:52.104400 ip-10-0-136-164 kubenswrapper[2562]: E0710 15:58:52.104377 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fb065b1502f74685be6ed9a079ff575fe766a25b46c39a44a4c221d973dd788\": container with ID starting with 3fb065b1502f74685be6ed9a079ff575fe766a25b46c39a44a4c221d973dd788 not found: ID does not exist" containerID="3fb065b1502f74685be6ed9a079ff575fe766a25b46c39a44a4c221d973dd788" Jul 10 15:58:52.104465 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:52.104408 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fb065b1502f74685be6ed9a079ff575fe766a25b46c39a44a4c221d973dd788"} err="failed to get container status \"3fb065b1502f74685be6ed9a079ff575fe766a25b46c39a44a4c221d973dd788\": rpc error: code = NotFound desc = could not find container \"3fb065b1502f74685be6ed9a079ff575fe766a25b46c39a44a4c221d973dd788\": container with ID starting with 3fb065b1502f74685be6ed9a079ff575fe766a25b46c39a44a4c221d973dd788 not found: ID does not exist" Jul 10 15:58:52.114828 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:52.114803 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65c9df797c-jkr2h"] Jul 10 15:58:52.120493 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:52.120473 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65c9df797c-jkr2h"] Jul 10 15:58:52.988197 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:58:52.988163 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c51b773-6a21-4bfc-b1eb-43c792e7c0ed" path="/var/lib/kubelet/pods/4c51b773-6a21-4bfc-b1eb-43c792e7c0ed/volumes" Jul 10 15:59:09.137097 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:09.137070 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj"] Jul 10 15:59:09.137458 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:09.137365 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c51b773-6a21-4bfc-b1eb-43c792e7c0ed" containerName="console" Jul 10 15:59:09.137458 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:09.137375 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c51b773-6a21-4bfc-b1eb-43c792e7c0ed" containerName="console" Jul 10 15:59:09.137458 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:09.137385 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="079a5c14-9d8e-4648-90b9-cce8d226a8de" containerName="console" Jul 10 15:59:09.137458 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:09.137392 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="079a5c14-9d8e-4648-90b9-cce8d226a8de" containerName="console" Jul 10 15:59:09.137458 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:09.137446 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="079a5c14-9d8e-4648-90b9-cce8d226a8de" containerName="console" Jul 10 15:59:09.137458 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:09.137457 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c51b773-6a21-4bfc-b1eb-43c792e7c0ed" containerName="console" Jul 10 15:59:09.141991 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:09.141973 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj" Jul 10 15:59:09.146140 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:09.146121 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 10 15:59:09.146270 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:09.146251 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 10 15:59:09.147353 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:09.147321 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ms7zq\"" Jul 10 15:59:09.153924 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:09.153883 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj"] Jul 10 15:59:09.176501 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:09.176473 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/386d8007-e4d6-4c10-909d-a4aff8e55194-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj\" (UID: \"386d8007-e4d6-4c10-909d-a4aff8e55194\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj" Jul 10 15:59:09.176659 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:09.176533 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/386d8007-e4d6-4c10-909d-a4aff8e55194-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj\" (UID: \"386d8007-e4d6-4c10-909d-a4aff8e55194\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj" Jul 10 15:59:09.176659 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:09.176561 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5t4b\" (UniqueName: \"kubernetes.io/projected/386d8007-e4d6-4c10-909d-a4aff8e55194-kube-api-access-s5t4b\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj\" (UID: \"386d8007-e4d6-4c10-909d-a4aff8e55194\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj" Jul 10 15:59:09.277111 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:09.277074 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/386d8007-e4d6-4c10-909d-a4aff8e55194-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj\" (UID: \"386d8007-e4d6-4c10-909d-a4aff8e55194\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj" Jul 10 15:59:09.277300 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:09.277130 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/386d8007-e4d6-4c10-909d-a4aff8e55194-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj\" (UID: \"386d8007-e4d6-4c10-909d-a4aff8e55194\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj" Jul 10 15:59:09.277300 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:09.277159 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5t4b\" (UniqueName: \"kubernetes.io/projected/386d8007-e4d6-4c10-909d-a4aff8e55194-kube-api-access-s5t4b\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj\" (UID: \"386d8007-e4d6-4c10-909d-a4aff8e55194\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj" Jul 10 15:59:09.277452 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:09.277430 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/386d8007-e4d6-4c10-909d-a4aff8e55194-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj\" (UID: \"386d8007-e4d6-4c10-909d-a4aff8e55194\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj" Jul 10 15:59:09.277506 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:09.277466 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/386d8007-e4d6-4c10-909d-a4aff8e55194-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj\" (UID: \"386d8007-e4d6-4c10-909d-a4aff8e55194\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj" Jul 10 15:59:09.287035 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:09.287006 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5t4b\" (UniqueName: \"kubernetes.io/projected/386d8007-e4d6-4c10-909d-a4aff8e55194-kube-api-access-s5t4b\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj\" (UID: \"386d8007-e4d6-4c10-909d-a4aff8e55194\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj" Jul 10 15:59:09.451395 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:09.451308 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj" Jul 10 15:59:09.582742 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:09.582718 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj"] Jul 10 15:59:09.585234 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:59:09.585207 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod386d8007_e4d6_4c10_909d_a4aff8e55194.slice/crio-a989cf6f05fa078958fd234e9dea821ef118ecb091114b25fb03b23f014c4926 WatchSource:0}: Error finding container a989cf6f05fa078958fd234e9dea821ef118ecb091114b25fb03b23f014c4926: Status 404 returned error can't find the container with id a989cf6f05fa078958fd234e9dea821ef118ecb091114b25fb03b23f014c4926 Jul 10 15:59:10.161623 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:10.161559 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj" event={"ID":"386d8007-e4d6-4c10-909d-a4aff8e55194","Type":"ContainerStarted","Data":"a989cf6f05fa078958fd234e9dea821ef118ecb091114b25fb03b23f014c4926"} Jul 10 15:59:17.192506 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:17.192417 2562 generic.go:356] "Generic (PLEG): container finished" podID="386d8007-e4d6-4c10-909d-a4aff8e55194" containerID="2bb1150410310162527c5ffe9d693339ebdfda245506b8464e00bb43f5b23cba" exitCode=0 Jul 10 15:59:17.192506 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:17.192492 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj" event={"ID":"386d8007-e4d6-4c10-909d-a4aff8e55194","Type":"ContainerDied","Data":"2bb1150410310162527c5ffe9d693339ebdfda245506b8464e00bb43f5b23cba"} Jul 10 15:59:19.202720 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:19.202688 2562 generic.go:356] "Generic (PLEG): container finished" podID="386d8007-e4d6-4c10-909d-a4aff8e55194" containerID="711ecfbd46c4724bf652e83bbc0905f60d20a65c749978347fbd6dc934d1a6e8" exitCode=0 Jul 10 15:59:19.203135 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:19.202765 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj" event={"ID":"386d8007-e4d6-4c10-909d-a4aff8e55194","Type":"ContainerDied","Data":"711ecfbd46c4724bf652e83bbc0905f60d20a65c749978347fbd6dc934d1a6e8"} Jul 10 15:59:29.252588 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:29.252478 2562 generic.go:356] "Generic (PLEG): container finished" podID="386d8007-e4d6-4c10-909d-a4aff8e55194" containerID="ec96c6a3a3072197774f5ed38c9fbcaa398273b6a50d0dc29ec9d118a6b22cc3" exitCode=0 Jul 10 15:59:29.252588 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:29.252538 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj" event={"ID":"386d8007-e4d6-4c10-909d-a4aff8e55194","Type":"ContainerDied","Data":"ec96c6a3a3072197774f5ed38c9fbcaa398273b6a50d0dc29ec9d118a6b22cc3"} Jul 10 15:59:30.437324 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:30.437285 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj" Jul 10 15:59:30.566311 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:30.566277 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/386d8007-e4d6-4c10-909d-a4aff8e55194-util\") pod \"386d8007-e4d6-4c10-909d-a4aff8e55194\" (UID: \"386d8007-e4d6-4c10-909d-a4aff8e55194\") " Jul 10 15:59:30.566311 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:30.566318 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/386d8007-e4d6-4c10-909d-a4aff8e55194-bundle\") pod \"386d8007-e4d6-4c10-909d-a4aff8e55194\" (UID: \"386d8007-e4d6-4c10-909d-a4aff8e55194\") " Jul 10 15:59:30.566556 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:30.566367 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5t4b\" (UniqueName: \"kubernetes.io/projected/386d8007-e4d6-4c10-909d-a4aff8e55194-kube-api-access-s5t4b\") pod \"386d8007-e4d6-4c10-909d-a4aff8e55194\" (UID: \"386d8007-e4d6-4c10-909d-a4aff8e55194\") " Jul 10 15:59:30.567083 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:30.567053 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/386d8007-e4d6-4c10-909d-a4aff8e55194-bundle" (OuterVolumeSpecName: "bundle") pod "386d8007-e4d6-4c10-909d-a4aff8e55194" (UID: "386d8007-e4d6-4c10-909d-a4aff8e55194"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:59:30.568753 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:30.568730 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/386d8007-e4d6-4c10-909d-a4aff8e55194-kube-api-access-s5t4b" (OuterVolumeSpecName: "kube-api-access-s5t4b") pod "386d8007-e4d6-4c10-909d-a4aff8e55194" (UID: "386d8007-e4d6-4c10-909d-a4aff8e55194"). InnerVolumeSpecName "kube-api-access-s5t4b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:59:30.570697 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:30.570673 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/386d8007-e4d6-4c10-909d-a4aff8e55194-util" (OuterVolumeSpecName: "util") pod "386d8007-e4d6-4c10-909d-a4aff8e55194" (UID: "386d8007-e4d6-4c10-909d-a4aff8e55194"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:59:30.667373 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:30.667328 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/386d8007-e4d6-4c10-909d-a4aff8e55194-util\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:59:30.667373 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:30.667365 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/386d8007-e4d6-4c10-909d-a4aff8e55194-bundle\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:59:30.667373 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:30.667378 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5t4b\" (UniqueName: \"kubernetes.io/projected/386d8007-e4d6-4c10-909d-a4aff8e55194-kube-api-access-s5t4b\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 15:59:31.262381 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:31.262299 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj" event={"ID":"386d8007-e4d6-4c10-909d-a4aff8e55194","Type":"ContainerDied","Data":"a989cf6f05fa078958fd234e9dea821ef118ecb091114b25fb03b23f014c4926"} Jul 10 15:59:31.262381 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:31.262352 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a989cf6f05fa078958fd234e9dea821ef118ecb091114b25fb03b23f014c4926" Jul 10 15:59:31.262381 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:31.262308 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nnblj" Jul 10 15:59:37.215411 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:37.215376 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ff69r"] Jul 10 15:59:37.215882 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:37.215713 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="386d8007-e4d6-4c10-909d-a4aff8e55194" containerName="util" Jul 10 15:59:37.215882 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:37.215724 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="386d8007-e4d6-4c10-909d-a4aff8e55194" containerName="util" Jul 10 15:59:37.215882 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:37.215739 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="386d8007-e4d6-4c10-909d-a4aff8e55194" containerName="pull" Jul 10 15:59:37.215882 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:37.215745 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="386d8007-e4d6-4c10-909d-a4aff8e55194" containerName="pull" Jul 10 15:59:37.215882 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:37.215751 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="386d8007-e4d6-4c10-909d-a4aff8e55194" containerName="extract" Jul 10 15:59:37.215882 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:37.215756 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="386d8007-e4d6-4c10-909d-a4aff8e55194" containerName="extract" Jul 10 15:59:37.215882 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:37.215821 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="386d8007-e4d6-4c10-909d-a4aff8e55194" containerName="extract" Jul 10 15:59:37.218789 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:37.218771 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ff69r" Jul 10 15:59:37.221819 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:37.221800 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-tbcgb\"" Jul 10 15:59:37.221922 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:37.221877 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 10 15:59:37.222352 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:37.222337 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 10 15:59:37.237585 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:37.237547 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ff69r"] Jul 10 15:59:37.328467 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:37.328437 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adf7505a-7913-4b50-8f87-20f65aa92476-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ff69r\" (UID: \"adf7505a-7913-4b50-8f87-20f65aa92476\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ff69r" Jul 10 15:59:37.328666 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:37.328505 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c4gf\" (UniqueName: \"kubernetes.io/projected/adf7505a-7913-4b50-8f87-20f65aa92476-kube-api-access-6c4gf\") pod \"cert-manager-operator-controller-manager-55c444bf86-ff69r\" (UID: \"adf7505a-7913-4b50-8f87-20f65aa92476\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ff69r" Jul 10 15:59:37.429842 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:37.429795 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c4gf\" (UniqueName: \"kubernetes.io/projected/adf7505a-7913-4b50-8f87-20f65aa92476-kube-api-access-6c4gf\") pod \"cert-manager-operator-controller-manager-55c444bf86-ff69r\" (UID: \"adf7505a-7913-4b50-8f87-20f65aa92476\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ff69r" Jul 10 15:59:37.429979 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:37.429860 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adf7505a-7913-4b50-8f87-20f65aa92476-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ff69r\" (UID: \"adf7505a-7913-4b50-8f87-20f65aa92476\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ff69r" Jul 10 15:59:37.430178 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:37.430163 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adf7505a-7913-4b50-8f87-20f65aa92476-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ff69r\" (UID: \"adf7505a-7913-4b50-8f87-20f65aa92476\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ff69r" Jul 10 15:59:37.439559 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:37.439532 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c4gf\" (UniqueName: \"kubernetes.io/projected/adf7505a-7913-4b50-8f87-20f65aa92476-kube-api-access-6c4gf\") pod \"cert-manager-operator-controller-manager-55c444bf86-ff69r\" (UID: \"adf7505a-7913-4b50-8f87-20f65aa92476\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ff69r" Jul 10 15:59:37.527425 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:37.527399 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ff69r" Jul 10 15:59:37.663728 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:37.663678 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ff69r"] Jul 10 15:59:37.669132 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:59:37.669102 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf7505a_7913_4b50_8f87_20f65aa92476.slice/crio-4e795958edf1f6e897b6bdbaeb25ea18a9c379dc795ca9187f34711eb0bddccf WatchSource:0}: Error finding container 4e795958edf1f6e897b6bdbaeb25ea18a9c379dc795ca9187f34711eb0bddccf: Status 404 returned error can't find the container with id 4e795958edf1f6e897b6bdbaeb25ea18a9c379dc795ca9187f34711eb0bddccf Jul 10 15:59:38.290778 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:38.290744 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ff69r" event={"ID":"adf7505a-7913-4b50-8f87-20f65aa92476","Type":"ContainerStarted","Data":"4e795958edf1f6e897b6bdbaeb25ea18a9c379dc795ca9187f34711eb0bddccf"} Jul 10 15:59:52.350078 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:52.350038 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ff69r" event={"ID":"adf7505a-7913-4b50-8f87-20f65aa92476","Type":"ContainerStarted","Data":"4d4770ee57c8a514e870ceb5eaa4007d862e8a548c19b645264e951b8827c1a7"} Jul 10 15:59:52.374069 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:52.374009 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ff69r" podStartSLOduration=0.863833166 podStartE2EDuration="15.373988682s" totalImagesPullingTime="14.510155516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:59:52.371122409 +0000 UTC m=+291.803607405" watchObservedRunningTime="2026-07-10 15:59:52.373988682 +0000 UTC m=+291.806473681" Jul 10 15:59:53.084143 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:53.084114 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8"] Jul 10 15:59:53.091740 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:53.091713 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8" Jul 10 15:59:53.095787 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:53.095767 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 10 15:59:53.096676 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:53.096645 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 10 15:59:53.096765 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:53.096651 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ms7zq\"" Jul 10 15:59:53.103792 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:53.103768 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8"] Jul 10 15:59:53.165929 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:53.165901 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c83f92cd-2f23-4211-8fd5-59cd66e5b9d3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8\" (UID: \"c83f92cd-2f23-4211-8fd5-59cd66e5b9d3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8" Jul 10 15:59:53.166087 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:53.165939 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xgmq\" (UniqueName: \"kubernetes.io/projected/c83f92cd-2f23-4211-8fd5-59cd66e5b9d3-kube-api-access-5xgmq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8\" (UID: \"c83f92cd-2f23-4211-8fd5-59cd66e5b9d3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8" Jul 10 15:59:53.166087 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:53.165990 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c83f92cd-2f23-4211-8fd5-59cd66e5b9d3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8\" (UID: \"c83f92cd-2f23-4211-8fd5-59cd66e5b9d3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8" Jul 10 15:59:53.266415 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:53.266374 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c83f92cd-2f23-4211-8fd5-59cd66e5b9d3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8\" (UID: \"c83f92cd-2f23-4211-8fd5-59cd66e5b9d3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8" Jul 10 15:59:53.266606 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:53.266424 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xgmq\" (UniqueName: \"kubernetes.io/projected/c83f92cd-2f23-4211-8fd5-59cd66e5b9d3-kube-api-access-5xgmq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8\" (UID: \"c83f92cd-2f23-4211-8fd5-59cd66e5b9d3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8" Jul 10 15:59:53.266606 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:53.266466 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c83f92cd-2f23-4211-8fd5-59cd66e5b9d3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8\" (UID: \"c83f92cd-2f23-4211-8fd5-59cd66e5b9d3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8" Jul 10 15:59:53.266839 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:53.266818 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c83f92cd-2f23-4211-8fd5-59cd66e5b9d3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8\" (UID: \"c83f92cd-2f23-4211-8fd5-59cd66e5b9d3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8" Jul 10 15:59:53.266884 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:53.266818 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c83f92cd-2f23-4211-8fd5-59cd66e5b9d3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8\" (UID: \"c83f92cd-2f23-4211-8fd5-59cd66e5b9d3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8" Jul 10 15:59:53.281302 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:53.281269 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xgmq\" (UniqueName: \"kubernetes.io/projected/c83f92cd-2f23-4211-8fd5-59cd66e5b9d3-kube-api-access-5xgmq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8\" (UID: \"c83f92cd-2f23-4211-8fd5-59cd66e5b9d3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8" Jul 10 15:59:53.401339 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:53.401249 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8" Jul 10 15:59:53.531008 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:53.530957 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8"] Jul 10 15:59:53.533312 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:59:53.533275 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc83f92cd_2f23_4211_8fd5_59cd66e5b9d3.slice/crio-3bcdfd7d0b8ea63559d664fd9fb27c827ead427020665f5daa709c4c158359c2 WatchSource:0}: Error finding container 3bcdfd7d0b8ea63559d664fd9fb27c827ead427020665f5daa709c4c158359c2: Status 404 returned error can't find the container with id 3bcdfd7d0b8ea63559d664fd9fb27c827ead427020665f5daa709c4c158359c2 Jul 10 15:59:53.958666 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:53.958634 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-45bkr"] Jul 10 15:59:53.962013 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:53.961996 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-45bkr" Jul 10 15:59:53.964757 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:53.964731 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 10 15:59:53.964932 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:53.964900 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 10 15:59:53.965053 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:53.964990 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-c45wr\"" Jul 10 15:59:53.970899 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:53.970876 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-45bkr"] Jul 10 15:59:53.970991 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:53.970909 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls7dr\" (UniqueName: \"kubernetes.io/projected/41f43203-838e-4003-b7ee-8cf1241cecab-kube-api-access-ls7dr\") pod \"cert-manager-webhook-6486ffd997-45bkr\" (UID: \"41f43203-838e-4003-b7ee-8cf1241cecab\") " pod="cert-manager/cert-manager-webhook-6486ffd997-45bkr" Jul 10 15:59:53.970991 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:53.970942 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41f43203-838e-4003-b7ee-8cf1241cecab-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-45bkr\" (UID: \"41f43203-838e-4003-b7ee-8cf1241cecab\") " pod="cert-manager/cert-manager-webhook-6486ffd997-45bkr" Jul 10 15:59:54.071523 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:54.071488 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls7dr\" (UniqueName: \"kubernetes.io/projected/41f43203-838e-4003-b7ee-8cf1241cecab-kube-api-access-ls7dr\") pod \"cert-manager-webhook-6486ffd997-45bkr\" (UID: \"41f43203-838e-4003-b7ee-8cf1241cecab\") " pod="cert-manager/cert-manager-webhook-6486ffd997-45bkr" Jul 10 15:59:54.071523 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:54.071531 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41f43203-838e-4003-b7ee-8cf1241cecab-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-45bkr\" (UID: \"41f43203-838e-4003-b7ee-8cf1241cecab\") " pod="cert-manager/cert-manager-webhook-6486ffd997-45bkr" Jul 10 15:59:54.081393 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:54.081361 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41f43203-838e-4003-b7ee-8cf1241cecab-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-45bkr\" (UID: \"41f43203-838e-4003-b7ee-8cf1241cecab\") " pod="cert-manager/cert-manager-webhook-6486ffd997-45bkr" Jul 10 15:59:54.081545 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:54.081433 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls7dr\" (UniqueName: \"kubernetes.io/projected/41f43203-838e-4003-b7ee-8cf1241cecab-kube-api-access-ls7dr\") pod \"cert-manager-webhook-6486ffd997-45bkr\" (UID: \"41f43203-838e-4003-b7ee-8cf1241cecab\") " pod="cert-manager/cert-manager-webhook-6486ffd997-45bkr" Jul 10 15:59:54.292797 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:54.292770 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-45bkr" Jul 10 15:59:54.361358 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:54.361322 2562 generic.go:356] "Generic (PLEG): container finished" podID="c83f92cd-2f23-4211-8fd5-59cd66e5b9d3" containerID="41711ee9a21d8baf93ebb07d3f477654f810b58df110b5fa3c0a5c58be89bdc9" exitCode=0 Jul 10 15:59:54.361510 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:54.361385 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8" event={"ID":"c83f92cd-2f23-4211-8fd5-59cd66e5b9d3","Type":"ContainerDied","Data":"41711ee9a21d8baf93ebb07d3f477654f810b58df110b5fa3c0a5c58be89bdc9"} Jul 10 15:59:54.361510 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:54.361432 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8" event={"ID":"c83f92cd-2f23-4211-8fd5-59cd66e5b9d3","Type":"ContainerStarted","Data":"3bcdfd7d0b8ea63559d664fd9fb27c827ead427020665f5daa709c4c158359c2"} Jul 10 15:59:54.425926 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:54.425895 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-45bkr"] Jul 10 15:59:54.428172 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:59:54.428148 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41f43203_838e_4003_b7ee_8cf1241cecab.slice/crio-c3fb2c74f259097b0d874db85f7d0a0a806c38611896f08abeef7f218d83c18e WatchSource:0}: Error finding container c3fb2c74f259097b0d874db85f7d0a0a806c38611896f08abeef7f218d83c18e: Status 404 returned error can't find the container with id c3fb2c74f259097b0d874db85f7d0a0a806c38611896f08abeef7f218d83c18e Jul 10 15:59:55.370341 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:55.370300 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-45bkr" event={"ID":"41f43203-838e-4003-b7ee-8cf1241cecab","Type":"ContainerStarted","Data":"c3fb2c74f259097b0d874db85f7d0a0a806c38611896f08abeef7f218d83c18e"} Jul 10 15:59:58.391032 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:58.390989 2562 generic.go:356] "Generic (PLEG): container finished" podID="c83f92cd-2f23-4211-8fd5-59cd66e5b9d3" containerID="02ec97a40f0550045af22561c65e236506195af28f873d487db0b2464d0e9780" exitCode=0 Jul 10 15:59:58.391455 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:58.391043 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8" event={"ID":"c83f92cd-2f23-4211-8fd5-59cd66e5b9d3","Type":"ContainerDied","Data":"02ec97a40f0550045af22561c65e236506195af28f873d487db0b2464d0e9780"} Jul 10 15:59:58.392792 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:58.392768 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-45bkr" event={"ID":"41f43203-838e-4003-b7ee-8cf1241cecab","Type":"ContainerStarted","Data":"7c6cbc853ea6617465d3aae159ff2cc041a1c04f14e25873fb29bfc8630b59e8"} Jul 10 15:59:58.392907 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:58.392891 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-45bkr" Jul 10 15:59:58.427307 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:58.427253 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-45bkr" podStartSLOduration=2.546622268 podStartE2EDuration="5.427235034s" totalImagesPullingTime="2.880612766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:59:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:59:58.426284234 +0000 UTC m=+297.858769230" watchObservedRunningTime="2026-07-10 15:59:58.427235034 +0000 UTC m=+297.859720027" Jul 10 15:59:59.351887 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:59.351850 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5nhhg"] Jul 10 15:59:59.376095 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:59.376064 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5nhhg"] Jul 10 15:59:59.376265 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:59.376175 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5nhhg" Jul 10 15:59:59.379133 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:59.379105 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-5bxpc\"" Jul 10 15:59:59.398917 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:59.398884 2562 generic.go:356] "Generic (PLEG): container finished" podID="c83f92cd-2f23-4211-8fd5-59cd66e5b9d3" containerID="f68d20abcb3bb0f6cca944d211a45d3d3c1c721a2cb44e77133fb287d17d4b9b" exitCode=0 Jul 10 15:59:59.399310 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:59.398980 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8" event={"ID":"c83f92cd-2f23-4211-8fd5-59cd66e5b9d3","Type":"ContainerDied","Data":"f68d20abcb3bb0f6cca944d211a45d3d3c1c721a2cb44e77133fb287d17d4b9b"} Jul 10 15:59:59.413478 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:59.413430 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdce98c0-e930-42cf-8c11-6ea4873d7442-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5nhhg\" (UID: \"cdce98c0-e930-42cf-8c11-6ea4873d7442\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5nhhg" Jul 10 15:59:59.413670 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:59.413618 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sdkv\" (UniqueName: \"kubernetes.io/projected/cdce98c0-e930-42cf-8c11-6ea4873d7442-kube-api-access-7sdkv\") pod \"cert-manager-cainjector-559cdd8c87-5nhhg\" (UID: \"cdce98c0-e930-42cf-8c11-6ea4873d7442\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5nhhg" Jul 10 15:59:59.514786 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:59.514746 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sdkv\" (UniqueName: \"kubernetes.io/projected/cdce98c0-e930-42cf-8c11-6ea4873d7442-kube-api-access-7sdkv\") pod \"cert-manager-cainjector-559cdd8c87-5nhhg\" (UID: \"cdce98c0-e930-42cf-8c11-6ea4873d7442\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5nhhg" Jul 10 15:59:59.514949 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:59.514825 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdce98c0-e930-42cf-8c11-6ea4873d7442-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5nhhg\" (UID: \"cdce98c0-e930-42cf-8c11-6ea4873d7442\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5nhhg" Jul 10 15:59:59.525086 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:59.525058 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sdkv\" (UniqueName: \"kubernetes.io/projected/cdce98c0-e930-42cf-8c11-6ea4873d7442-kube-api-access-7sdkv\") pod \"cert-manager-cainjector-559cdd8c87-5nhhg\" (UID: \"cdce98c0-e930-42cf-8c11-6ea4873d7442\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5nhhg" Jul 10 15:59:59.525259 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:59.525234 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdce98c0-e930-42cf-8c11-6ea4873d7442-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5nhhg\" (UID: \"cdce98c0-e930-42cf-8c11-6ea4873d7442\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5nhhg" Jul 10 15:59:59.685508 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:59.685417 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5nhhg" Jul 10 15:59:59.837161 ip-10-0-136-164 kubenswrapper[2562]: I0710 15:59:59.837134 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5nhhg"] Jul 10 15:59:59.839271 ip-10-0-136-164 kubenswrapper[2562]: W0710 15:59:59.839240 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcdce98c0_e930_42cf_8c11_6ea4873d7442.slice/crio-cf61192f203776c92c80c7cc9c0083ddb510941245d2852b1a4f21abaac31ff7 WatchSource:0}: Error finding container cf61192f203776c92c80c7cc9c0083ddb510941245d2852b1a4f21abaac31ff7: Status 404 returned error can't find the container with id cf61192f203776c92c80c7cc9c0083ddb510941245d2852b1a4f21abaac31ff7 Jul 10 16:00:00.405126 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:00.405092 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5nhhg" event={"ID":"cdce98c0-e930-42cf-8c11-6ea4873d7442","Type":"ContainerStarted","Data":"34aa1ed0d1840f2c845a777c108c656a10275c939bd8f9cce21925f12fa4268c"} Jul 10 16:00:00.405126 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:00.405135 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5nhhg" event={"ID":"cdce98c0-e930-42cf-8c11-6ea4873d7442","Type":"ContainerStarted","Data":"cf61192f203776c92c80c7cc9c0083ddb510941245d2852b1a4f21abaac31ff7"} Jul 10 16:00:00.427414 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:00.427360 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5nhhg" podStartSLOduration=1.427338579 podStartE2EDuration="1.427338579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:59:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:00:00.424269992 +0000 UTC m=+299.856754987" watchObservedRunningTime="2026-07-10 16:00:00.427338579 +0000 UTC m=+299.859823574" Jul 10 16:00:00.579586 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:00.579553 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8" Jul 10 16:00:00.624899 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:00.624865 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xgmq\" (UniqueName: \"kubernetes.io/projected/c83f92cd-2f23-4211-8fd5-59cd66e5b9d3-kube-api-access-5xgmq\") pod \"c83f92cd-2f23-4211-8fd5-59cd66e5b9d3\" (UID: \"c83f92cd-2f23-4211-8fd5-59cd66e5b9d3\") " Jul 10 16:00:00.625056 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:00.624939 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c83f92cd-2f23-4211-8fd5-59cd66e5b9d3-util\") pod \"c83f92cd-2f23-4211-8fd5-59cd66e5b9d3\" (UID: \"c83f92cd-2f23-4211-8fd5-59cd66e5b9d3\") " Jul 10 16:00:00.625056 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:00.624998 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c83f92cd-2f23-4211-8fd5-59cd66e5b9d3-bundle\") pod \"c83f92cd-2f23-4211-8fd5-59cd66e5b9d3\" (UID: \"c83f92cd-2f23-4211-8fd5-59cd66e5b9d3\") " Jul 10 16:00:00.625408 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:00.625376 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c83f92cd-2f23-4211-8fd5-59cd66e5b9d3-bundle" (OuterVolumeSpecName: "bundle") pod "c83f92cd-2f23-4211-8fd5-59cd66e5b9d3" (UID: "c83f92cd-2f23-4211-8fd5-59cd66e5b9d3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 16:00:00.627128 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:00.627106 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c83f92cd-2f23-4211-8fd5-59cd66e5b9d3-kube-api-access-5xgmq" (OuterVolumeSpecName: "kube-api-access-5xgmq") pod "c83f92cd-2f23-4211-8fd5-59cd66e5b9d3" (UID: "c83f92cd-2f23-4211-8fd5-59cd66e5b9d3"). InnerVolumeSpecName "kube-api-access-5xgmq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:00:00.629600 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:00.629556 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c83f92cd-2f23-4211-8fd5-59cd66e5b9d3-util" (OuterVolumeSpecName: "util") pod "c83f92cd-2f23-4211-8fd5-59cd66e5b9d3" (UID: "c83f92cd-2f23-4211-8fd5-59cd66e5b9d3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 16:00:00.726316 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:00.726230 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xgmq\" (UniqueName: \"kubernetes.io/projected/c83f92cd-2f23-4211-8fd5-59cd66e5b9d3-kube-api-access-5xgmq\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:00:00.726316 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:00.726258 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c83f92cd-2f23-4211-8fd5-59cd66e5b9d3-util\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:00:00.726316 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:00.726269 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c83f92cd-2f23-4211-8fd5-59cd66e5b9d3-bundle\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:00:00.895511 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:00.895484 2562 kubelet.go:1648] "Image garbage collection succeeded" Jul 10 16:00:01.411727 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:01.411697 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8" Jul 10 16:00:01.411727 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:01.411715 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9l6c8" event={"ID":"c83f92cd-2f23-4211-8fd5-59cd66e5b9d3","Type":"ContainerDied","Data":"3bcdfd7d0b8ea63559d664fd9fb27c827ead427020665f5daa709c4c158359c2"} Jul 10 16:00:01.412151 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:01.411762 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3bcdfd7d0b8ea63559d664fd9fb27c827ead427020665f5daa709c4c158359c2" Jul 10 16:00:04.363946 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:04.363913 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v9q6b"] Jul 10 16:00:04.364324 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:04.364212 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c83f92cd-2f23-4211-8fd5-59cd66e5b9d3" containerName="util" Jul 10 16:00:04.364324 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:04.364222 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c83f92cd-2f23-4211-8fd5-59cd66e5b9d3" containerName="util" Jul 10 16:00:04.364324 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:04.364230 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c83f92cd-2f23-4211-8fd5-59cd66e5b9d3" containerName="pull" Jul 10 16:00:04.364324 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:04.364235 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c83f92cd-2f23-4211-8fd5-59cd66e5b9d3" containerName="pull" Jul 10 16:00:04.364324 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:04.364257 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c83f92cd-2f23-4211-8fd5-59cd66e5b9d3" containerName="extract" Jul 10 16:00:04.364324 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:04.364264 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c83f92cd-2f23-4211-8fd5-59cd66e5b9d3" containerName="extract" Jul 10 16:00:04.364324 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:04.364309 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c83f92cd-2f23-4211-8fd5-59cd66e5b9d3" containerName="extract" Jul 10 16:00:04.366924 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:04.366907 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v9q6b" Jul 10 16:00:04.369686 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:04.369667 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 10 16:00:04.370712 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:04.370688 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-b98bq\"" Jul 10 16:00:04.370814 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:04.370689 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 10 16:00:04.377729 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:04.377708 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v9q6b"] Jul 10 16:00:04.400808 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:04.400779 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-45bkr" Jul 10 16:00:04.458100 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:04.458061 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t675v\" (UniqueName: \"kubernetes.io/projected/d5f661a1-47a6-4c6e-b97f-73bcfb0149fb-kube-api-access-t675v\") pod \"openshift-lws-operator-fd8ccff4c-v9q6b\" (UID: \"d5f661a1-47a6-4c6e-b97f-73bcfb0149fb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v9q6b" Jul 10 16:00:04.458274 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:04.458108 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5f661a1-47a6-4c6e-b97f-73bcfb0149fb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-v9q6b\" (UID: \"d5f661a1-47a6-4c6e-b97f-73bcfb0149fb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v9q6b" Jul 10 16:00:04.559408 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:04.559365 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t675v\" (UniqueName: \"kubernetes.io/projected/d5f661a1-47a6-4c6e-b97f-73bcfb0149fb-kube-api-access-t675v\") pod \"openshift-lws-operator-fd8ccff4c-v9q6b\" (UID: \"d5f661a1-47a6-4c6e-b97f-73bcfb0149fb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v9q6b" Jul 10 16:00:04.559408 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:04.559414 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5f661a1-47a6-4c6e-b97f-73bcfb0149fb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-v9q6b\" (UID: \"d5f661a1-47a6-4c6e-b97f-73bcfb0149fb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v9q6b" Jul 10 16:00:04.559866 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:04.559842 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5f661a1-47a6-4c6e-b97f-73bcfb0149fb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-v9q6b\" (UID: \"d5f661a1-47a6-4c6e-b97f-73bcfb0149fb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v9q6b" Jul 10 16:00:04.569004 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:04.568980 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t675v\" (UniqueName: \"kubernetes.io/projected/d5f661a1-47a6-4c6e-b97f-73bcfb0149fb-kube-api-access-t675v\") pod \"openshift-lws-operator-fd8ccff4c-v9q6b\" (UID: \"d5f661a1-47a6-4c6e-b97f-73bcfb0149fb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v9q6b" Jul 10 16:00:04.676546 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:04.676461 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v9q6b" Jul 10 16:00:04.845236 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:04.845213 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v9q6b"] Jul 10 16:00:04.847680 ip-10-0-136-164 kubenswrapper[2562]: W0710 16:00:04.847644 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5f661a1_47a6_4c6e_b97f_73bcfb0149fb.slice/crio-0ff266905d7de016b2cb080b7c3a2db2d7edc58a20aa53eeb1255c4c04386246 WatchSource:0}: Error finding container 0ff266905d7de016b2cb080b7c3a2db2d7edc58a20aa53eeb1255c4c04386246: Status 404 returned error can't find the container with id 0ff266905d7de016b2cb080b7c3a2db2d7edc58a20aa53eeb1255c4c04386246 Jul 10 16:00:04.849239 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:04.849220 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 16:00:05.430085 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:05.430046 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v9q6b" event={"ID":"d5f661a1-47a6-4c6e-b97f-73bcfb0149fb","Type":"ContainerStarted","Data":"0ff266905d7de016b2cb080b7c3a2db2d7edc58a20aa53eeb1255c4c04386246"} Jul 10 16:00:09.450159 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:09.450128 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v9q6b" event={"ID":"d5f661a1-47a6-4c6e-b97f-73bcfb0149fb","Type":"ContainerStarted","Data":"adade3bd8fda57afa4272dcd580bd8beeaa774e634ee5adb479ca177760c3b07"} Jul 10 16:00:09.469589 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:09.469519 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v9q6b" podStartSLOduration=1.860716545 podStartE2EDuration="5.46950393s" totalImagesPullingTime="3.608787385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:00:09.468284804 +0000 UTC m=+308.900769800" watchObservedRunningTime="2026-07-10 16:00:09.46950393 +0000 UTC m=+308.901988924" Jul 10 16:00:11.831489 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:11.831452 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v"] Jul 10 16:00:11.835058 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:11.835039 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v" Jul 10 16:00:11.837741 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:11.837713 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 10 16:00:11.838751 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:11.838731 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 10 16:00:11.838854 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:11.838751 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ms7zq\"" Jul 10 16:00:11.843658 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:11.843635 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v"] Jul 10 16:00:11.924797 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:11.924753 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af606d1b-4809-489d-bc49-b30190a97173-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v\" (UID: \"af606d1b-4809-489d-bc49-b30190a97173\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v" Jul 10 16:00:11.924993 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:11.924822 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af606d1b-4809-489d-bc49-b30190a97173-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v\" (UID: \"af606d1b-4809-489d-bc49-b30190a97173\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v" Jul 10 16:00:11.924993 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:11.924878 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqt9r\" (UniqueName: \"kubernetes.io/projected/af606d1b-4809-489d-bc49-b30190a97173-kube-api-access-rqt9r\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v\" (UID: \"af606d1b-4809-489d-bc49-b30190a97173\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v" Jul 10 16:00:12.026152 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:12.026117 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af606d1b-4809-489d-bc49-b30190a97173-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v\" (UID: \"af606d1b-4809-489d-bc49-b30190a97173\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v" Jul 10 16:00:12.026296 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:12.026174 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af606d1b-4809-489d-bc49-b30190a97173-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v\" (UID: \"af606d1b-4809-489d-bc49-b30190a97173\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v" Jul 10 16:00:12.026296 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:12.026216 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqt9r\" (UniqueName: \"kubernetes.io/projected/af606d1b-4809-489d-bc49-b30190a97173-kube-api-access-rqt9r\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v\" (UID: \"af606d1b-4809-489d-bc49-b30190a97173\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v" Jul 10 16:00:12.026555 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:12.026531 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af606d1b-4809-489d-bc49-b30190a97173-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v\" (UID: \"af606d1b-4809-489d-bc49-b30190a97173\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v" Jul 10 16:00:12.026555 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:12.026549 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af606d1b-4809-489d-bc49-b30190a97173-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v\" (UID: \"af606d1b-4809-489d-bc49-b30190a97173\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v" Jul 10 16:00:12.034704 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:12.034673 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqt9r\" (UniqueName: \"kubernetes.io/projected/af606d1b-4809-489d-bc49-b30190a97173-kube-api-access-rqt9r\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v\" (UID: \"af606d1b-4809-489d-bc49-b30190a97173\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v" Jul 10 16:00:12.144345 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:12.144258 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v" Jul 10 16:00:12.276099 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:12.276077 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v"] Jul 10 16:00:12.277911 ip-10-0-136-164 kubenswrapper[2562]: W0710 16:00:12.277872 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf606d1b_4809_489d_bc49_b30190a97173.slice/crio-a6a3042c960d8fbf7401c63c94bf2c7d65807a734039f7a20e09442cfa027ac9 WatchSource:0}: Error finding container a6a3042c960d8fbf7401c63c94bf2c7d65807a734039f7a20e09442cfa027ac9: Status 404 returned error can't find the container with id a6a3042c960d8fbf7401c63c94bf2c7d65807a734039f7a20e09442cfa027ac9 Jul 10 16:00:12.464140 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:12.464057 2562 generic.go:356] "Generic (PLEG): container finished" podID="af606d1b-4809-489d-bc49-b30190a97173" containerID="246c922e1c137cd0fbac3b3c7edebbabcde23e03e6b85dd6fb12d953d4485290" exitCode=0 Jul 10 16:00:12.464266 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:12.464145 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v" event={"ID":"af606d1b-4809-489d-bc49-b30190a97173","Type":"ContainerDied","Data":"246c922e1c137cd0fbac3b3c7edebbabcde23e03e6b85dd6fb12d953d4485290"} Jul 10 16:00:12.464266 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:12.464195 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v" event={"ID":"af606d1b-4809-489d-bc49-b30190a97173","Type":"ContainerStarted","Data":"a6a3042c960d8fbf7401c63c94bf2c7d65807a734039f7a20e09442cfa027ac9"} Jul 10 16:00:13.470447 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:13.470363 2562 generic.go:356] "Generic (PLEG): container finished" podID="af606d1b-4809-489d-bc49-b30190a97173" containerID="0796e177af177557efe3d64d0216599dcc4a19544383624fc0e0d407677552ff" exitCode=0 Jul 10 16:00:13.470447 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:13.470400 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v" event={"ID":"af606d1b-4809-489d-bc49-b30190a97173","Type":"ContainerDied","Data":"0796e177af177557efe3d64d0216599dcc4a19544383624fc0e0d407677552ff"} Jul 10 16:00:14.477478 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:14.477437 2562 generic.go:356] "Generic (PLEG): container finished" podID="af606d1b-4809-489d-bc49-b30190a97173" containerID="9bb41943f4aaaa9f51e0ae74ff00139bbad10295c6cc3dd88a4a647d95db930f" exitCode=0 Jul 10 16:00:14.477862 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:14.477533 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v" event={"ID":"af606d1b-4809-489d-bc49-b30190a97173","Type":"ContainerDied","Data":"9bb41943f4aaaa9f51e0ae74ff00139bbad10295c6cc3dd88a4a647d95db930f"} Jul 10 16:00:15.630162 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:15.630139 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v" Jul 10 16:00:15.659558 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:15.659529 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af606d1b-4809-489d-bc49-b30190a97173-bundle\") pod \"af606d1b-4809-489d-bc49-b30190a97173\" (UID: \"af606d1b-4809-489d-bc49-b30190a97173\") " Jul 10 16:00:15.659726 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:15.659600 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af606d1b-4809-489d-bc49-b30190a97173-util\") pod \"af606d1b-4809-489d-bc49-b30190a97173\" (UID: \"af606d1b-4809-489d-bc49-b30190a97173\") " Jul 10 16:00:15.659726 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:15.659642 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqt9r\" (UniqueName: \"kubernetes.io/projected/af606d1b-4809-489d-bc49-b30190a97173-kube-api-access-rqt9r\") pod \"af606d1b-4809-489d-bc49-b30190a97173\" (UID: \"af606d1b-4809-489d-bc49-b30190a97173\") " Jul 10 16:00:15.660211 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:15.660185 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af606d1b-4809-489d-bc49-b30190a97173-bundle" (OuterVolumeSpecName: "bundle") pod "af606d1b-4809-489d-bc49-b30190a97173" (UID: "af606d1b-4809-489d-bc49-b30190a97173"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 16:00:15.661942 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:15.661914 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af606d1b-4809-489d-bc49-b30190a97173-kube-api-access-rqt9r" (OuterVolumeSpecName: "kube-api-access-rqt9r") pod "af606d1b-4809-489d-bc49-b30190a97173" (UID: "af606d1b-4809-489d-bc49-b30190a97173"). InnerVolumeSpecName "kube-api-access-rqt9r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:00:15.666222 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:15.666197 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af606d1b-4809-489d-bc49-b30190a97173-util" (OuterVolumeSpecName: "util") pod "af606d1b-4809-489d-bc49-b30190a97173" (UID: "af606d1b-4809-489d-bc49-b30190a97173"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 16:00:15.760456 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:15.760393 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af606d1b-4809-489d-bc49-b30190a97173-bundle\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:00:15.760456 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:15.760417 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af606d1b-4809-489d-bc49-b30190a97173-util\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:00:15.760456 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:15.760427 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqt9r\" (UniqueName: \"kubernetes.io/projected/af606d1b-4809-489d-bc49-b30190a97173-kube-api-access-rqt9r\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:00:16.488371 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:16.488342 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v" Jul 10 16:00:16.488371 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:16.488349 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4j66v" event={"ID":"af606d1b-4809-489d-bc49-b30190a97173","Type":"ContainerDied","Data":"a6a3042c960d8fbf7401c63c94bf2c7d65807a734039f7a20e09442cfa027ac9"} Jul 10 16:00:16.488591 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:16.488395 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a6a3042c960d8fbf7401c63c94bf2c7d65807a734039f7a20e09442cfa027ac9" Jul 10 16:00:25.106413 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.106382 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c56c8c4bf-ms96f"] Jul 10 16:00:25.106809 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.106707 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af606d1b-4809-489d-bc49-b30190a97173" containerName="extract" Jul 10 16:00:25.106809 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.106722 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="af606d1b-4809-489d-bc49-b30190a97173" containerName="extract" Jul 10 16:00:25.106809 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.106741 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af606d1b-4809-489d-bc49-b30190a97173" containerName="util" Jul 10 16:00:25.106809 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.106748 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="af606d1b-4809-489d-bc49-b30190a97173" containerName="util" Jul 10 16:00:25.106809 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.106756 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af606d1b-4809-489d-bc49-b30190a97173" containerName="pull" Jul 10 16:00:25.106809 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.106762 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="af606d1b-4809-489d-bc49-b30190a97173" containerName="pull" Jul 10 16:00:25.106809 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.106809 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="af606d1b-4809-489d-bc49-b30190a97173" containerName="extract" Jul 10 16:00:25.111258 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.111241 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c56c8c4bf-ms96f" Jul 10 16:00:25.114814 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.114784 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 10 16:00:25.114941 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.114848 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5fx84\"" Jul 10 16:00:25.115867 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.115850 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 10 16:00:25.115989 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.115971 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 10 16:00:25.119353 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.119332 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 10 16:00:25.142872 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.142847 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c56c8c4bf-ms96f"] Jul 10 16:00:25.237937 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.237897 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c56c8c4bf-ms96f\" (UID: \"a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c56c8c4bf-ms96f" Jul 10 16:00:25.238077 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.237955 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c56c8c4bf-ms96f\" (UID: \"a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c56c8c4bf-ms96f" Jul 10 16:00:25.238077 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.238015 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2-manifests\") pod \"opendatahub-operator-controller-manager-7c56c8c4bf-ms96f\" (UID: \"a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c56c8c4bf-ms96f" Jul 10 16:00:25.238167 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.238085 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2-tmp\") pod \"opendatahub-operator-controller-manager-7c56c8c4bf-ms96f\" (UID: \"a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c56c8c4bf-ms96f" Jul 10 16:00:25.238167 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.238108 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx98b\" (UniqueName: \"kubernetes.io/projected/a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2-kube-api-access-hx98b\") pod \"opendatahub-operator-controller-manager-7c56c8c4bf-ms96f\" (UID: \"a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c56c8c4bf-ms96f" Jul 10 16:00:25.339424 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.339375 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c56c8c4bf-ms96f\" (UID: \"a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c56c8c4bf-ms96f" Jul 10 16:00:25.339623 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.339452 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c56c8c4bf-ms96f\" (UID: \"a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c56c8c4bf-ms96f" Jul 10 16:00:25.339623 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.339486 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2-manifests\") pod \"opendatahub-operator-controller-manager-7c56c8c4bf-ms96f\" (UID: \"a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c56c8c4bf-ms96f" Jul 10 16:00:25.339623 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.339546 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2-tmp\") pod \"opendatahub-operator-controller-manager-7c56c8c4bf-ms96f\" (UID: \"a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c56c8c4bf-ms96f" Jul 10 16:00:25.339623 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.339609 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx98b\" (UniqueName: \"kubernetes.io/projected/a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2-kube-api-access-hx98b\") pod \"opendatahub-operator-controller-manager-7c56c8c4bf-ms96f\" (UID: \"a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c56c8c4bf-ms96f" Jul 10 16:00:25.339967 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.339937 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2-manifests\") pod \"opendatahub-operator-controller-manager-7c56c8c4bf-ms96f\" (UID: \"a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c56c8c4bf-ms96f" Jul 10 16:00:25.341857 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.341835 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2-tmp\") pod \"opendatahub-operator-controller-manager-7c56c8c4bf-ms96f\" (UID: \"a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c56c8c4bf-ms96f" Jul 10 16:00:25.341992 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.341919 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c56c8c4bf-ms96f\" (UID: \"a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c56c8c4bf-ms96f" Jul 10 16:00:25.342056 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.342034 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c56c8c4bf-ms96f\" (UID: \"a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c56c8c4bf-ms96f" Jul 10 16:00:25.351603 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.351557 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx98b\" (UniqueName: \"kubernetes.io/projected/a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2-kube-api-access-hx98b\") pod \"opendatahub-operator-controller-manager-7c56c8c4bf-ms96f\" (UID: \"a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c56c8c4bf-ms96f" Jul 10 16:00:25.422495 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.422420 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c56c8c4bf-ms96f" Jul 10 16:00:25.562354 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:25.562322 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c56c8c4bf-ms96f"] Jul 10 16:00:25.565530 ip-10-0-136-164 kubenswrapper[2562]: W0710 16:00:25.565506 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8bd47f7_de0d_498e_8b46_d7ff1e4c7db2.slice/crio-4f509774f9b4338b284384f1e4e04d75b7e057c09733f72bcbb1a1f168a0e809 WatchSource:0}: Error finding container 4f509774f9b4338b284384f1e4e04d75b7e057c09733f72bcbb1a1f168a0e809: Status 404 returned error can't find the container with id 4f509774f9b4338b284384f1e4e04d75b7e057c09733f72bcbb1a1f168a0e809 Jul 10 16:00:26.539746 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:26.539707 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c56c8c4bf-ms96f" event={"ID":"a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2","Type":"ContainerStarted","Data":"4f509774f9b4338b284384f1e4e04d75b7e057c09733f72bcbb1a1f168a0e809"} Jul 10 16:00:29.557479 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:29.557443 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c56c8c4bf-ms96f" event={"ID":"a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2","Type":"ContainerStarted","Data":"a584451ebfc9af08b80246bea44a7e8e7ac56db8c00eef22e506cf30a78b25cd"} Jul 10 16:00:30.563533 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:30.563499 2562 generic.go:356] "Generic (PLEG): container finished" podID="a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2" containerID="a584451ebfc9af08b80246bea44a7e8e7ac56db8c00eef22e506cf30a78b25cd" exitCode=0 Jul 10 16:00:30.563921 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:30.563591 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c56c8c4bf-ms96f" event={"ID":"a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2","Type":"ContainerDied","Data":"a584451ebfc9af08b80246bea44a7e8e7ac56db8c00eef22e506cf30a78b25cd"} Jul 10 16:00:31.569564 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:31.569522 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c56c8c4bf-ms96f" event={"ID":"a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2","Type":"ContainerStarted","Data":"7518dd741d6af9f62443c312a6ffd691323c85a95c215e43e5c67d542ed6d5f1"} Jul 10 16:00:31.569974 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:31.569629 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c56c8c4bf-ms96f" Jul 10 16:00:31.594350 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:31.594299 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c56c8c4bf-ms96f" podStartSLOduration=2.209830538 podStartE2EDuration="6.594279936s" totalImagesPullingTime="3.359676919s" totalInitContainerRuntime="1.024772479s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:00:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:00:31.592806726 +0000 UTC m=+331.025291720" watchObservedRunningTime="2026-07-10 16:00:31.594279936 +0000 UTC m=+331.026764931" Jul 10 16:00:42.576299 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:42.576267 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c56c8c4bf-ms96f" Jul 10 16:00:45.196069 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:45.196031 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8457fcdff5-tzc4s"] Jul 10 16:00:45.211142 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:45.211116 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8457fcdff5-tzc4s" Jul 10 16:00:45.214215 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:45.214183 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 10 16:00:45.214393 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:45.214320 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xltxs\"" Jul 10 16:00:45.214393 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:45.214199 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 10 16:00:45.214594 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:45.214558 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 10 16:00:45.215075 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:45.215053 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8457fcdff5-tzc4s"] Jul 10 16:00:45.215236 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:45.215220 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 10 16:00:45.300588 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:45.300537 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82efda26-5970-4087-9fb1-9aab625139f5-tmp\") pod \"kube-auth-proxy-8457fcdff5-tzc4s\" (UID: \"82efda26-5970-4087-9fb1-9aab625139f5\") " pod="openshift-ingress/kube-auth-proxy-8457fcdff5-tzc4s" Jul 10 16:00:45.300763 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:45.300619 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82efda26-5970-4087-9fb1-9aab625139f5-tls-certs\") pod \"kube-auth-proxy-8457fcdff5-tzc4s\" (UID: \"82efda26-5970-4087-9fb1-9aab625139f5\") " pod="openshift-ingress/kube-auth-proxy-8457fcdff5-tzc4s" Jul 10 16:00:45.300763 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:45.300729 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m6zl\" (UniqueName: \"kubernetes.io/projected/82efda26-5970-4087-9fb1-9aab625139f5-kube-api-access-9m6zl\") pod \"kube-auth-proxy-8457fcdff5-tzc4s\" (UID: \"82efda26-5970-4087-9fb1-9aab625139f5\") " pod="openshift-ingress/kube-auth-proxy-8457fcdff5-tzc4s" Jul 10 16:00:45.401353 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:45.401325 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82efda26-5970-4087-9fb1-9aab625139f5-tmp\") pod \"kube-auth-proxy-8457fcdff5-tzc4s\" (UID: \"82efda26-5970-4087-9fb1-9aab625139f5\") " pod="openshift-ingress/kube-auth-proxy-8457fcdff5-tzc4s" Jul 10 16:00:45.401534 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:45.401370 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82efda26-5970-4087-9fb1-9aab625139f5-tls-certs\") pod \"kube-auth-proxy-8457fcdff5-tzc4s\" (UID: \"82efda26-5970-4087-9fb1-9aab625139f5\") " pod="openshift-ingress/kube-auth-proxy-8457fcdff5-tzc4s" Jul 10 16:00:45.401534 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:45.401410 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m6zl\" (UniqueName: \"kubernetes.io/projected/82efda26-5970-4087-9fb1-9aab625139f5-kube-api-access-9m6zl\") pod \"kube-auth-proxy-8457fcdff5-tzc4s\" (UID: \"82efda26-5970-4087-9fb1-9aab625139f5\") " pod="openshift-ingress/kube-auth-proxy-8457fcdff5-tzc4s" Jul 10 16:00:45.403755 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:45.403728 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82efda26-5970-4087-9fb1-9aab625139f5-tmp\") pod \"kube-auth-proxy-8457fcdff5-tzc4s\" (UID: \"82efda26-5970-4087-9fb1-9aab625139f5\") " pod="openshift-ingress/kube-auth-proxy-8457fcdff5-tzc4s" Jul 10 16:00:45.403887 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:45.403869 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82efda26-5970-4087-9fb1-9aab625139f5-tls-certs\") pod \"kube-auth-proxy-8457fcdff5-tzc4s\" (UID: \"82efda26-5970-4087-9fb1-9aab625139f5\") " pod="openshift-ingress/kube-auth-proxy-8457fcdff5-tzc4s" Jul 10 16:00:45.411182 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:45.411156 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m6zl\" (UniqueName: \"kubernetes.io/projected/82efda26-5970-4087-9fb1-9aab625139f5-kube-api-access-9m6zl\") pod \"kube-auth-proxy-8457fcdff5-tzc4s\" (UID: \"82efda26-5970-4087-9fb1-9aab625139f5\") " pod="openshift-ingress/kube-auth-proxy-8457fcdff5-tzc4s" Jul 10 16:00:45.522121 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:45.522039 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8457fcdff5-tzc4s" Jul 10 16:00:45.694127 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:45.694092 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8457fcdff5-tzc4s"] Jul 10 16:00:45.694943 ip-10-0-136-164 kubenswrapper[2562]: W0710 16:00:45.694917 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82efda26_5970_4087_9fb1_9aab625139f5.slice/crio-7d2da5e2c2856b1074168754aa5d0d8f31b97b2974b756fff3a0aa3facec7eb7 WatchSource:0}: Error finding container 7d2da5e2c2856b1074168754aa5d0d8f31b97b2974b756fff3a0aa3facec7eb7: Status 404 returned error can't find the container with id 7d2da5e2c2856b1074168754aa5d0d8f31b97b2974b756fff3a0aa3facec7eb7 Jul 10 16:00:46.639711 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:46.639669 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8457fcdff5-tzc4s" event={"ID":"82efda26-5970-4087-9fb1-9aab625139f5","Type":"ContainerStarted","Data":"7d2da5e2c2856b1074168754aa5d0d8f31b97b2974b756fff3a0aa3facec7eb7"} Jul 10 16:00:50.665746 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:50.665701 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8457fcdff5-tzc4s" event={"ID":"82efda26-5970-4087-9fb1-9aab625139f5","Type":"ContainerStarted","Data":"15c564d0d28dfa05bc36159b5ce8dfb23cccbde2dbc81ee09df073f658629caf"} Jul 10 16:00:50.683731 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:50.683684 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8457fcdff5-tzc4s" podStartSLOduration=1.6499649330000001 podStartE2EDuration="5.683669248s" totalImagesPullingTime="4.033704315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:00:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:00:50.682807165 +0000 UTC m=+350.115292160" watchObservedRunningTime="2026-07-10 16:00:50.683669248 +0000 UTC m=+350.116154241" Jul 10 16:00:56.419753 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:56.419676 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-66568bbc8f-dxbvr"] Jul 10 16:00:56.423103 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:56.423087 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66568bbc8f-dxbvr" Jul 10 16:00:56.440991 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:56.440966 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 10 16:00:56.441454 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:56.441440 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-l6gw6\"" Jul 10 16:00:56.453063 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:56.453042 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66568bbc8f-dxbvr"] Jul 10 16:00:56.456156 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:56.456140 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 10 16:00:56.460053 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:56.460034 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 10 16:00:56.499718 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:56.499686 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e59ebea2-11fb-42f7-bd7f-8b14c30aebd5-cert\") pod \"lws-controller-manager-66568bbc8f-dxbvr\" (UID: \"e59ebea2-11fb-42f7-bd7f-8b14c30aebd5\") " pod="openshift-lws-operator/lws-controller-manager-66568bbc8f-dxbvr" Jul 10 16:00:56.499835 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:56.499762 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e59ebea2-11fb-42f7-bd7f-8b14c30aebd5-metrics-cert\") pod \"lws-controller-manager-66568bbc8f-dxbvr\" (UID: \"e59ebea2-11fb-42f7-bd7f-8b14c30aebd5\") " pod="openshift-lws-operator/lws-controller-manager-66568bbc8f-dxbvr" Jul 10 16:00:56.499835 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:56.499793 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsjxq\" (UniqueName: \"kubernetes.io/projected/e59ebea2-11fb-42f7-bd7f-8b14c30aebd5-kube-api-access-hsjxq\") pod \"lws-controller-manager-66568bbc8f-dxbvr\" (UID: \"e59ebea2-11fb-42f7-bd7f-8b14c30aebd5\") " pod="openshift-lws-operator/lws-controller-manager-66568bbc8f-dxbvr" Jul 10 16:00:56.499835 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:56.499829 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e59ebea2-11fb-42f7-bd7f-8b14c30aebd5-manager-config\") pod \"lws-controller-manager-66568bbc8f-dxbvr\" (UID: \"e59ebea2-11fb-42f7-bd7f-8b14c30aebd5\") " pod="openshift-lws-operator/lws-controller-manager-66568bbc8f-dxbvr" Jul 10 16:00:56.600906 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:56.600873 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e59ebea2-11fb-42f7-bd7f-8b14c30aebd5-metrics-cert\") pod \"lws-controller-manager-66568bbc8f-dxbvr\" (UID: \"e59ebea2-11fb-42f7-bd7f-8b14c30aebd5\") " pod="openshift-lws-operator/lws-controller-manager-66568bbc8f-dxbvr" Jul 10 16:00:56.601051 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:56.600912 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsjxq\" (UniqueName: \"kubernetes.io/projected/e59ebea2-11fb-42f7-bd7f-8b14c30aebd5-kube-api-access-hsjxq\") pod \"lws-controller-manager-66568bbc8f-dxbvr\" (UID: \"e59ebea2-11fb-42f7-bd7f-8b14c30aebd5\") " pod="openshift-lws-operator/lws-controller-manager-66568bbc8f-dxbvr" Jul 10 16:00:56.601051 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:56.600948 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e59ebea2-11fb-42f7-bd7f-8b14c30aebd5-manager-config\") pod \"lws-controller-manager-66568bbc8f-dxbvr\" (UID: \"e59ebea2-11fb-42f7-bd7f-8b14c30aebd5\") " pod="openshift-lws-operator/lws-controller-manager-66568bbc8f-dxbvr" Jul 10 16:00:56.601051 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:56.601013 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e59ebea2-11fb-42f7-bd7f-8b14c30aebd5-cert\") pod \"lws-controller-manager-66568bbc8f-dxbvr\" (UID: \"e59ebea2-11fb-42f7-bd7f-8b14c30aebd5\") " pod="openshift-lws-operator/lws-controller-manager-66568bbc8f-dxbvr" Jul 10 16:00:56.601654 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:56.601631 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e59ebea2-11fb-42f7-bd7f-8b14c30aebd5-manager-config\") pod \"lws-controller-manager-66568bbc8f-dxbvr\" (UID: \"e59ebea2-11fb-42f7-bd7f-8b14c30aebd5\") " pod="openshift-lws-operator/lws-controller-manager-66568bbc8f-dxbvr" Jul 10 16:00:56.603609 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:56.603585 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e59ebea2-11fb-42f7-bd7f-8b14c30aebd5-cert\") pod \"lws-controller-manager-66568bbc8f-dxbvr\" (UID: \"e59ebea2-11fb-42f7-bd7f-8b14c30aebd5\") " pod="openshift-lws-operator/lws-controller-manager-66568bbc8f-dxbvr" Jul 10 16:00:56.603609 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:56.603598 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e59ebea2-11fb-42f7-bd7f-8b14c30aebd5-metrics-cert\") pod \"lws-controller-manager-66568bbc8f-dxbvr\" (UID: \"e59ebea2-11fb-42f7-bd7f-8b14c30aebd5\") " pod="openshift-lws-operator/lws-controller-manager-66568bbc8f-dxbvr" Jul 10 16:00:56.641693 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:56.641672 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsjxq\" (UniqueName: \"kubernetes.io/projected/e59ebea2-11fb-42f7-bd7f-8b14c30aebd5-kube-api-access-hsjxq\") pod \"lws-controller-manager-66568bbc8f-dxbvr\" (UID: \"e59ebea2-11fb-42f7-bd7f-8b14c30aebd5\") " pod="openshift-lws-operator/lws-controller-manager-66568bbc8f-dxbvr" Jul 10 16:00:56.731817 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:56.731757 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66568bbc8f-dxbvr" Jul 10 16:00:56.896497 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:56.896469 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66568bbc8f-dxbvr"] Jul 10 16:00:56.898970 ip-10-0-136-164 kubenswrapper[2562]: W0710 16:00:56.898947 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode59ebea2_11fb_42f7_bd7f_8b14c30aebd5.slice/crio-a1503ac7d9a9c920e11cb04ef78fe241d06487cf54194135569c77dfadeaeed4 WatchSource:0}: Error finding container a1503ac7d9a9c920e11cb04ef78fe241d06487cf54194135569c77dfadeaeed4: Status 404 returned error can't find the container with id a1503ac7d9a9c920e11cb04ef78fe241d06487cf54194135569c77dfadeaeed4 Jul 10 16:00:57.700615 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:57.700547 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66568bbc8f-dxbvr" event={"ID":"e59ebea2-11fb-42f7-bd7f-8b14c30aebd5","Type":"ContainerStarted","Data":"a1503ac7d9a9c920e11cb04ef78fe241d06487cf54194135569c77dfadeaeed4"} Jul 10 16:00:58.712909 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:58.712809 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66568bbc8f-dxbvr" event={"ID":"e59ebea2-11fb-42f7-bd7f-8b14c30aebd5","Type":"ContainerStarted","Data":"04c564676ea27b78047d4e1114d9dd4016e6f58b57191bc0dec9ba2890397e0a"} Jul 10 16:00:58.713352 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:58.712914 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-66568bbc8f-dxbvr" Jul 10 16:00:58.863918 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:00:58.863856 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-66568bbc8f-dxbvr" podStartSLOduration=1.325835296 podStartE2EDuration="2.863835558s" totalImagesPullingTime="1.538000262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:00:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:00:58.860252545 +0000 UTC m=+358.292737539" watchObservedRunningTime="2026-07-10 16:00:58.863835558 +0000 UTC m=+358.296320553" Jul 10 16:01:09.721096 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:01:09.721066 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-66568bbc8f-dxbvr" Jul 10 16:02:01.214307 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:01.214267 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m"] Jul 10 16:02:01.217979 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:01.217956 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m" Jul 10 16:02:01.220984 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:01.220961 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 10 16:02:01.221969 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:01.221954 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 10 16:02:01.222059 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:01.221992 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jlgqs\"" Jul 10 16:02:01.233507 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:01.233480 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m"] Jul 10 16:02:01.351307 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:01.351274 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82c7aa6d-9d6b-4a87-ad16-443679254810-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m\" (UID: \"82c7aa6d-9d6b-4a87-ad16-443679254810\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m" Jul 10 16:02:01.351482 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:01.351313 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqgtn\" (UniqueName: \"kubernetes.io/projected/82c7aa6d-9d6b-4a87-ad16-443679254810-kube-api-access-vqgtn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m\" (UID: \"82c7aa6d-9d6b-4a87-ad16-443679254810\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m" Jul 10 16:02:01.351482 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:01.351344 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82c7aa6d-9d6b-4a87-ad16-443679254810-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m\" (UID: \"82c7aa6d-9d6b-4a87-ad16-443679254810\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m" Jul 10 16:02:01.452777 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:01.452744 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82c7aa6d-9d6b-4a87-ad16-443679254810-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m\" (UID: \"82c7aa6d-9d6b-4a87-ad16-443679254810\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m" Jul 10 16:02:01.452961 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:01.452794 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqgtn\" (UniqueName: \"kubernetes.io/projected/82c7aa6d-9d6b-4a87-ad16-443679254810-kube-api-access-vqgtn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m\" (UID: \"82c7aa6d-9d6b-4a87-ad16-443679254810\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m" Jul 10 16:02:01.452961 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:01.452828 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82c7aa6d-9d6b-4a87-ad16-443679254810-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m\" (UID: \"82c7aa6d-9d6b-4a87-ad16-443679254810\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m" Jul 10 16:02:01.453110 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:01.453089 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82c7aa6d-9d6b-4a87-ad16-443679254810-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m\" (UID: \"82c7aa6d-9d6b-4a87-ad16-443679254810\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m" Jul 10 16:02:01.453183 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:01.453140 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82c7aa6d-9d6b-4a87-ad16-443679254810-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m\" (UID: \"82c7aa6d-9d6b-4a87-ad16-443679254810\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m" Jul 10 16:02:01.462860 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:01.462832 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqgtn\" (UniqueName: \"kubernetes.io/projected/82c7aa6d-9d6b-4a87-ad16-443679254810-kube-api-access-vqgtn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m\" (UID: \"82c7aa6d-9d6b-4a87-ad16-443679254810\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m" Jul 10 16:02:01.526942 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:01.526915 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m" Jul 10 16:02:01.669966 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:01.669936 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m"] Jul 10 16:02:01.675934 ip-10-0-136-164 kubenswrapper[2562]: W0710 16:02:01.675896 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82c7aa6d_9d6b_4a87_ad16_443679254810.slice/crio-526bbc94a90d4af89aacd901503a9f7337d390d6a1590a0fdad100b9e3274bc4 WatchSource:0}: Error finding container 526bbc94a90d4af89aacd901503a9f7337d390d6a1590a0fdad100b9e3274bc4: Status 404 returned error can't find the container with id 526bbc94a90d4af89aacd901503a9f7337d390d6a1590a0fdad100b9e3274bc4 Jul 10 16:02:01.791518 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:01.791490 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf"] Jul 10 16:02:01.794932 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:01.794913 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf" Jul 10 16:02:01.809939 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:01.809912 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf"] Jul 10 16:02:01.854979 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:01.854952 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06549e1e-7d20-4da6-927b-342b47014a44-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf\" (UID: \"06549e1e-7d20-4da6-927b-342b47014a44\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf" Jul 10 16:02:01.855106 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:01.854996 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5j89\" (UniqueName: \"kubernetes.io/projected/06549e1e-7d20-4da6-927b-342b47014a44-kube-api-access-j5j89\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf\" (UID: \"06549e1e-7d20-4da6-927b-342b47014a44\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf" Jul 10 16:02:01.855106 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:01.855022 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06549e1e-7d20-4da6-927b-342b47014a44-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf\" (UID: \"06549e1e-7d20-4da6-927b-342b47014a44\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf" Jul 10 16:02:01.956043 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:01.956006 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5j89\" (UniqueName: \"kubernetes.io/projected/06549e1e-7d20-4da6-927b-342b47014a44-kube-api-access-j5j89\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf\" (UID: \"06549e1e-7d20-4da6-927b-342b47014a44\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf" Jul 10 16:02:01.956245 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:01.956052 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06549e1e-7d20-4da6-927b-342b47014a44-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf\" (UID: \"06549e1e-7d20-4da6-927b-342b47014a44\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf" Jul 10 16:02:01.956245 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:01.956121 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06549e1e-7d20-4da6-927b-342b47014a44-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf\" (UID: \"06549e1e-7d20-4da6-927b-342b47014a44\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf" Jul 10 16:02:01.956513 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:01.956494 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06549e1e-7d20-4da6-927b-342b47014a44-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf\" (UID: \"06549e1e-7d20-4da6-927b-342b47014a44\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf" Jul 10 16:02:01.956625 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:01.956522 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06549e1e-7d20-4da6-927b-342b47014a44-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf\" (UID: \"06549e1e-7d20-4da6-927b-342b47014a44\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf" Jul 10 16:02:01.968349 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:01.968321 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5j89\" (UniqueName: \"kubernetes.io/projected/06549e1e-7d20-4da6-927b-342b47014a44-kube-api-access-j5j89\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf\" (UID: \"06549e1e-7d20-4da6-927b-342b47014a44\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf" Jul 10 16:02:02.011097 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.011061 2562 generic.go:356] "Generic (PLEG): container finished" podID="82c7aa6d-9d6b-4a87-ad16-443679254810" containerID="e49ecc2877e7ae4785c9b042ad62b460e5e086018d20c25e4dc51cd7630dd4e7" exitCode=0 Jul 10 16:02:02.011254 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.011140 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m" event={"ID":"82c7aa6d-9d6b-4a87-ad16-443679254810","Type":"ContainerDied","Data":"e49ecc2877e7ae4785c9b042ad62b460e5e086018d20c25e4dc51cd7630dd4e7"} Jul 10 16:02:02.011254 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.011189 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m" event={"ID":"82c7aa6d-9d6b-4a87-ad16-443679254810","Type":"ContainerStarted","Data":"526bbc94a90d4af89aacd901503a9f7337d390d6a1590a0fdad100b9e3274bc4"} Jul 10 16:02:02.153218 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.153137 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf" Jul 10 16:02:02.305532 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.305496 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf"] Jul 10 16:02:02.309646 ip-10-0-136-164 kubenswrapper[2562]: W0710 16:02:02.309619 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06549e1e_7d20_4da6_927b_342b47014a44.slice/crio-bf56900163c947071766b52ccda124bede1d8df9faac21090b2afb50e3b7418f WatchSource:0}: Error finding container bf56900163c947071766b52ccda124bede1d8df9faac21090b2afb50e3b7418f: Status 404 returned error can't find the container with id bf56900163c947071766b52ccda124bede1d8df9faac21090b2afb50e3b7418f Jul 10 16:02:02.405114 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.405087 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv"] Jul 10 16:02:02.408871 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.408850 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv" Jul 10 16:02:02.424532 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.424505 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv"] Jul 10 16:02:02.459350 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.459323 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1dc74a59-fd5c-440e-850c-bf14d2797a7d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv\" (UID: \"1dc74a59-fd5c-440e-850c-bf14d2797a7d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv" Jul 10 16:02:02.459498 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.459374 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zhlv\" (UniqueName: \"kubernetes.io/projected/1dc74a59-fd5c-440e-850c-bf14d2797a7d-kube-api-access-5zhlv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv\" (UID: \"1dc74a59-fd5c-440e-850c-bf14d2797a7d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv" Jul 10 16:02:02.459498 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.459408 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1dc74a59-fd5c-440e-850c-bf14d2797a7d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv\" (UID: \"1dc74a59-fd5c-440e-850c-bf14d2797a7d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv" Jul 10 16:02:02.560359 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.560326 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zhlv\" (UniqueName: \"kubernetes.io/projected/1dc74a59-fd5c-440e-850c-bf14d2797a7d-kube-api-access-5zhlv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv\" (UID: \"1dc74a59-fd5c-440e-850c-bf14d2797a7d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv" Jul 10 16:02:02.560526 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.560368 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1dc74a59-fd5c-440e-850c-bf14d2797a7d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv\" (UID: \"1dc74a59-fd5c-440e-850c-bf14d2797a7d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv" Jul 10 16:02:02.560526 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.560424 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1dc74a59-fd5c-440e-850c-bf14d2797a7d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv\" (UID: \"1dc74a59-fd5c-440e-850c-bf14d2797a7d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv" Jul 10 16:02:02.560815 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.560800 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1dc74a59-fd5c-440e-850c-bf14d2797a7d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv\" (UID: \"1dc74a59-fd5c-440e-850c-bf14d2797a7d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv" Jul 10 16:02:02.560855 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.560829 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1dc74a59-fd5c-440e-850c-bf14d2797a7d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv\" (UID: \"1dc74a59-fd5c-440e-850c-bf14d2797a7d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv" Jul 10 16:02:02.571042 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.571020 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zhlv\" (UniqueName: \"kubernetes.io/projected/1dc74a59-fd5c-440e-850c-bf14d2797a7d-kube-api-access-5zhlv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv\" (UID: \"1dc74a59-fd5c-440e-850c-bf14d2797a7d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv" Jul 10 16:02:02.778821 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.778789 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv" Jul 10 16:02:02.795970 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.795946 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s"] Jul 10 16:02:02.799815 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.799788 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s" Jul 10 16:02:02.811565 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.811481 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s"] Jul 10 16:02:02.863467 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.863434 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a8f48dd-cd87-4147-b99c-6a438196b169-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s\" (UID: \"8a8f48dd-cd87-4147-b99c-6a438196b169\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s" Jul 10 16:02:02.863467 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.863472 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvgnp\" (UniqueName: \"kubernetes.io/projected/8a8f48dd-cd87-4147-b99c-6a438196b169-kube-api-access-tvgnp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s\" (UID: \"8a8f48dd-cd87-4147-b99c-6a438196b169\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s" Jul 10 16:02:02.863683 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.863605 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a8f48dd-cd87-4147-b99c-6a438196b169-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s\" (UID: \"8a8f48dd-cd87-4147-b99c-6a438196b169\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s" Jul 10 16:02:02.929449 ip-10-0-136-164 kubenswrapper[2562]: W0710 16:02:02.929424 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dc74a59_fd5c_440e_850c_bf14d2797a7d.slice/crio-1f70a1b1295127dfdbbe75bf4d5768084b8050b2c858db9b5e6772c76a2686fb WatchSource:0}: Error finding container 1f70a1b1295127dfdbbe75bf4d5768084b8050b2c858db9b5e6772c76a2686fb: Status 404 returned error can't find the container with id 1f70a1b1295127dfdbbe75bf4d5768084b8050b2c858db9b5e6772c76a2686fb Jul 10 16:02:02.929995 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.929971 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv"] Jul 10 16:02:02.964975 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.964946 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a8f48dd-cd87-4147-b99c-6a438196b169-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s\" (UID: \"8a8f48dd-cd87-4147-b99c-6a438196b169\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s" Jul 10 16:02:02.965052 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.965028 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a8f48dd-cd87-4147-b99c-6a438196b169-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s\" (UID: \"8a8f48dd-cd87-4147-b99c-6a438196b169\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s" Jul 10 16:02:02.965113 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.965060 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvgnp\" (UniqueName: \"kubernetes.io/projected/8a8f48dd-cd87-4147-b99c-6a438196b169-kube-api-access-tvgnp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s\" (UID: \"8a8f48dd-cd87-4147-b99c-6a438196b169\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s" Jul 10 16:02:02.965380 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.965356 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a8f48dd-cd87-4147-b99c-6a438196b169-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s\" (UID: \"8a8f48dd-cd87-4147-b99c-6a438196b169\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s" Jul 10 16:02:02.965534 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.965440 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a8f48dd-cd87-4147-b99c-6a438196b169-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s\" (UID: \"8a8f48dd-cd87-4147-b99c-6a438196b169\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s" Jul 10 16:02:02.976473 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:02.976450 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvgnp\" (UniqueName: \"kubernetes.io/projected/8a8f48dd-cd87-4147-b99c-6a438196b169-kube-api-access-tvgnp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s\" (UID: \"8a8f48dd-cd87-4147-b99c-6a438196b169\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s" Jul 10 16:02:03.020159 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:03.020129 2562 generic.go:356] "Generic (PLEG): container finished" podID="06549e1e-7d20-4da6-927b-342b47014a44" containerID="7d89701c11cf620cd36bad633f3a079e50cd116425d7f27dc419f0d23db884ce" exitCode=0 Jul 10 16:02:03.020288 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:03.020224 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf" event={"ID":"06549e1e-7d20-4da6-927b-342b47014a44","Type":"ContainerDied","Data":"7d89701c11cf620cd36bad633f3a079e50cd116425d7f27dc419f0d23db884ce"} Jul 10 16:02:03.020288 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:03.020274 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf" event={"ID":"06549e1e-7d20-4da6-927b-342b47014a44","Type":"ContainerStarted","Data":"bf56900163c947071766b52ccda124bede1d8df9faac21090b2afb50e3b7418f"} Jul 10 16:02:03.022516 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:03.022491 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m" event={"ID":"82c7aa6d-9d6b-4a87-ad16-443679254810","Type":"ContainerStarted","Data":"a5ab1a61a71cccf8b51d3671e8d8f9cccd14c61ca9dbdcef0bc0abe85f7a2737"} Jul 10 16:02:03.024294 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:03.024268 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv" event={"ID":"1dc74a59-fd5c-440e-850c-bf14d2797a7d","Type":"ContainerStarted","Data":"e8b0ce6a6cf501bc93a844451c98ec6a9f0d622d630955a47f37ee565d026d19"} Jul 10 16:02:03.024371 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:03.024318 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv" event={"ID":"1dc74a59-fd5c-440e-850c-bf14d2797a7d","Type":"ContainerStarted","Data":"1f70a1b1295127dfdbbe75bf4d5768084b8050b2c858db9b5e6772c76a2686fb"} Jul 10 16:02:03.115774 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:03.115744 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s" Jul 10 16:02:03.260036 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:03.260013 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s"] Jul 10 16:02:03.260898 ip-10-0-136-164 kubenswrapper[2562]: W0710 16:02:03.260872 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a8f48dd_cd87_4147_b99c_6a438196b169.slice/crio-721adf99f11985b8ab2693496826a75747105d383ccfdd2cf01467d4af76aef3 WatchSource:0}: Error finding container 721adf99f11985b8ab2693496826a75747105d383ccfdd2cf01467d4af76aef3: Status 404 returned error can't find the container with id 721adf99f11985b8ab2693496826a75747105d383ccfdd2cf01467d4af76aef3 Jul 10 16:02:04.037909 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:04.037876 2562 generic.go:356] "Generic (PLEG): container finished" podID="06549e1e-7d20-4da6-927b-342b47014a44" containerID="b96fb99436508bc03db16d02f3c25a21623878cbb3502d41a17e67a5f2396b92" exitCode=0 Jul 10 16:02:04.038353 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:04.037961 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf" event={"ID":"06549e1e-7d20-4da6-927b-342b47014a44","Type":"ContainerDied","Data":"b96fb99436508bc03db16d02f3c25a21623878cbb3502d41a17e67a5f2396b92"} Jul 10 16:02:04.039871 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:04.039847 2562 generic.go:356] "Generic (PLEG): container finished" podID="82c7aa6d-9d6b-4a87-ad16-443679254810" containerID="a5ab1a61a71cccf8b51d3671e8d8f9cccd14c61ca9dbdcef0bc0abe85f7a2737" exitCode=0 Jul 10 16:02:04.039968 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:04.039912 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m" event={"ID":"82c7aa6d-9d6b-4a87-ad16-443679254810","Type":"ContainerDied","Data":"a5ab1a61a71cccf8b51d3671e8d8f9cccd14c61ca9dbdcef0bc0abe85f7a2737"} Jul 10 16:02:04.041565 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:04.041540 2562 generic.go:356] "Generic (PLEG): container finished" podID="8a8f48dd-cd87-4147-b99c-6a438196b169" containerID="4863a0362f0806ac06270893c45cc0f252c3686d4639cf510e8e03dfe44ed14a" exitCode=0 Jul 10 16:02:04.041702 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:04.041618 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s" event={"ID":"8a8f48dd-cd87-4147-b99c-6a438196b169","Type":"ContainerDied","Data":"4863a0362f0806ac06270893c45cc0f252c3686d4639cf510e8e03dfe44ed14a"} Jul 10 16:02:04.041702 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:04.041662 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s" event={"ID":"8a8f48dd-cd87-4147-b99c-6a438196b169","Type":"ContainerStarted","Data":"721adf99f11985b8ab2693496826a75747105d383ccfdd2cf01467d4af76aef3"} Jul 10 16:02:04.043284 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:04.043262 2562 generic.go:356] "Generic (PLEG): container finished" podID="1dc74a59-fd5c-440e-850c-bf14d2797a7d" containerID="e8b0ce6a6cf501bc93a844451c98ec6a9f0d622d630955a47f37ee565d026d19" exitCode=0 Jul 10 16:02:04.043361 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:04.043339 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv" event={"ID":"1dc74a59-fd5c-440e-850c-bf14d2797a7d","Type":"ContainerDied","Data":"e8b0ce6a6cf501bc93a844451c98ec6a9f0d622d630955a47f37ee565d026d19"} Jul 10 16:02:05.051944 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:05.051871 2562 generic.go:356] "Generic (PLEG): container finished" podID="06549e1e-7d20-4da6-927b-342b47014a44" containerID="c92db4545bed5f8de4582a3fcfa66d4f8c2de147dc8f75205b4dc0c6dfc8cedc" exitCode=0 Jul 10 16:02:05.051944 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:05.051945 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf" event={"ID":"06549e1e-7d20-4da6-927b-342b47014a44","Type":"ContainerDied","Data":"c92db4545bed5f8de4582a3fcfa66d4f8c2de147dc8f75205b4dc0c6dfc8cedc"} Jul 10 16:02:05.054149 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:05.054119 2562 generic.go:356] "Generic (PLEG): container finished" podID="82c7aa6d-9d6b-4a87-ad16-443679254810" containerID="c44ac8f9c64723e70b5fc23085bfef81a0a5a0c9c052e310193fb2a73662b8b8" exitCode=0 Jul 10 16:02:05.054290 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:05.054192 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m" event={"ID":"82c7aa6d-9d6b-4a87-ad16-443679254810","Type":"ContainerDied","Data":"c44ac8f9c64723e70b5fc23085bfef81a0a5a0c9c052e310193fb2a73662b8b8"} Jul 10 16:02:05.055977 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:05.055951 2562 generic.go:356] "Generic (PLEG): container finished" podID="8a8f48dd-cd87-4147-b99c-6a438196b169" containerID="8b420bd9e346252eff0ff573402c85a38e69e20296eec0036e42fffa6e800930" exitCode=0 Jul 10 16:02:05.056086 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:05.056032 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s" event={"ID":"8a8f48dd-cd87-4147-b99c-6a438196b169","Type":"ContainerDied","Data":"8b420bd9e346252eff0ff573402c85a38e69e20296eec0036e42fffa6e800930"} Jul 10 16:02:06.062909 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:06.062879 2562 generic.go:356] "Generic (PLEG): container finished" podID="8a8f48dd-cd87-4147-b99c-6a438196b169" containerID="bb34693c2e2ee91495e78b4ae79252a2ad88e90feaf70777af67c4d1fe721ff9" exitCode=0 Jul 10 16:02:06.063327 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:06.062962 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s" event={"ID":"8a8f48dd-cd87-4147-b99c-6a438196b169","Type":"ContainerDied","Data":"bb34693c2e2ee91495e78b4ae79252a2ad88e90feaf70777af67c4d1fe721ff9"} Jul 10 16:02:06.064714 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:06.064685 2562 generic.go:356] "Generic (PLEG): container finished" podID="1dc74a59-fd5c-440e-850c-bf14d2797a7d" containerID="c40666eb01618f313d7a4a5fb56b714d776cbc74b0fde0cc0e63450257779c29" exitCode=0 Jul 10 16:02:06.064828 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:06.064768 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv" event={"ID":"1dc74a59-fd5c-440e-850c-bf14d2797a7d","Type":"ContainerDied","Data":"c40666eb01618f313d7a4a5fb56b714d776cbc74b0fde0cc0e63450257779c29"} Jul 10 16:02:06.290183 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:06.290157 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m" Jul 10 16:02:06.293264 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:06.293241 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf" Jul 10 16:02:06.394721 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:06.394630 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5j89\" (UniqueName: \"kubernetes.io/projected/06549e1e-7d20-4da6-927b-342b47014a44-kube-api-access-j5j89\") pod \"06549e1e-7d20-4da6-927b-342b47014a44\" (UID: \"06549e1e-7d20-4da6-927b-342b47014a44\") " Jul 10 16:02:06.394721 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:06.394697 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82c7aa6d-9d6b-4a87-ad16-443679254810-util\") pod \"82c7aa6d-9d6b-4a87-ad16-443679254810\" (UID: \"82c7aa6d-9d6b-4a87-ad16-443679254810\") " Jul 10 16:02:06.394939 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:06.394796 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06549e1e-7d20-4da6-927b-342b47014a44-util\") pod \"06549e1e-7d20-4da6-927b-342b47014a44\" (UID: \"06549e1e-7d20-4da6-927b-342b47014a44\") " Jul 10 16:02:06.394939 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:06.394840 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqgtn\" (UniqueName: \"kubernetes.io/projected/82c7aa6d-9d6b-4a87-ad16-443679254810-kube-api-access-vqgtn\") pod \"82c7aa6d-9d6b-4a87-ad16-443679254810\" (UID: \"82c7aa6d-9d6b-4a87-ad16-443679254810\") " Jul 10 16:02:06.394939 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:06.394869 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82c7aa6d-9d6b-4a87-ad16-443679254810-bundle\") pod \"82c7aa6d-9d6b-4a87-ad16-443679254810\" (UID: \"82c7aa6d-9d6b-4a87-ad16-443679254810\") " Jul 10 16:02:06.394939 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:06.394923 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06549e1e-7d20-4da6-927b-342b47014a44-bundle\") pod \"06549e1e-7d20-4da6-927b-342b47014a44\" (UID: \"06549e1e-7d20-4da6-927b-342b47014a44\") " Jul 10 16:02:06.395639 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:06.395540 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06549e1e-7d20-4da6-927b-342b47014a44-bundle" (OuterVolumeSpecName: "bundle") pod "06549e1e-7d20-4da6-927b-342b47014a44" (UID: "06549e1e-7d20-4da6-927b-342b47014a44"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 16:02:06.395639 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:06.395627 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82c7aa6d-9d6b-4a87-ad16-443679254810-bundle" (OuterVolumeSpecName: "bundle") pod "82c7aa6d-9d6b-4a87-ad16-443679254810" (UID: "82c7aa6d-9d6b-4a87-ad16-443679254810"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 16:02:06.397043 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:06.397018 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06549e1e-7d20-4da6-927b-342b47014a44-kube-api-access-j5j89" (OuterVolumeSpecName: "kube-api-access-j5j89") pod "06549e1e-7d20-4da6-927b-342b47014a44" (UID: "06549e1e-7d20-4da6-927b-342b47014a44"). InnerVolumeSpecName "kube-api-access-j5j89". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:02:06.397330 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:06.397308 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82c7aa6d-9d6b-4a87-ad16-443679254810-kube-api-access-vqgtn" (OuterVolumeSpecName: "kube-api-access-vqgtn") pod "82c7aa6d-9d6b-4a87-ad16-443679254810" (UID: "82c7aa6d-9d6b-4a87-ad16-443679254810"). InnerVolumeSpecName "kube-api-access-vqgtn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:02:06.400558 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:06.400521 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82c7aa6d-9d6b-4a87-ad16-443679254810-util" (OuterVolumeSpecName: "util") pod "82c7aa6d-9d6b-4a87-ad16-443679254810" (UID: "82c7aa6d-9d6b-4a87-ad16-443679254810"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 16:02:06.401250 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:06.401228 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06549e1e-7d20-4da6-927b-342b47014a44-util" (OuterVolumeSpecName: "util") pod "06549e1e-7d20-4da6-927b-342b47014a44" (UID: "06549e1e-7d20-4da6-927b-342b47014a44"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 16:02:06.495948 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:06.495914 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06549e1e-7d20-4da6-927b-342b47014a44-util\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:02:06.495948 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:06.495945 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqgtn\" (UniqueName: \"kubernetes.io/projected/82c7aa6d-9d6b-4a87-ad16-443679254810-kube-api-access-vqgtn\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:02:06.496126 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:06.495957 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82c7aa6d-9d6b-4a87-ad16-443679254810-bundle\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:02:06.496126 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:06.495966 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06549e1e-7d20-4da6-927b-342b47014a44-bundle\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:02:06.496126 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:06.495974 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5j89\" (UniqueName: \"kubernetes.io/projected/06549e1e-7d20-4da6-927b-342b47014a44-kube-api-access-j5j89\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:02:06.496126 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:06.495981 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82c7aa6d-9d6b-4a87-ad16-443679254810-util\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:02:07.071772 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:07.071748 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m" Jul 10 16:02:07.071772 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:07.071767 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m" event={"ID":"82c7aa6d-9d6b-4a87-ad16-443679254810","Type":"ContainerDied","Data":"526bbc94a90d4af89aacd901503a9f7337d390d6a1590a0fdad100b9e3274bc4"} Jul 10 16:02:07.072230 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:07.071808 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="526bbc94a90d4af89aacd901503a9f7337d390d6a1590a0fdad100b9e3274bc4" Jul 10 16:02:07.074190 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:07.074164 2562 generic.go:356] "Generic (PLEG): container finished" podID="1dc74a59-fd5c-440e-850c-bf14d2797a7d" containerID="40548a535c8bb8a0b39daf2537a2ca5d6d5ae958c11c06f6b885af3df01d19ab" exitCode=0 Jul 10 16:02:07.074305 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:07.074265 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv" event={"ID":"1dc74a59-fd5c-440e-850c-bf14d2797a7d","Type":"ContainerDied","Data":"40548a535c8bb8a0b39daf2537a2ca5d6d5ae958c11c06f6b885af3df01d19ab"} Jul 10 16:02:07.076167 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:07.076138 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf" event={"ID":"06549e1e-7d20-4da6-927b-342b47014a44","Type":"ContainerDied","Data":"bf56900163c947071766b52ccda124bede1d8df9faac21090b2afb50e3b7418f"} Jul 10 16:02:07.076250 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:07.076198 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf56900163c947071766b52ccda124bede1d8df9faac21090b2afb50e3b7418f" Jul 10 16:02:07.076250 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:07.076165 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf" Jul 10 16:02:07.203667 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:07.203644 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s" Jul 10 16:02:07.300892 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:07.300861 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a8f48dd-cd87-4147-b99c-6a438196b169-util\") pod \"8a8f48dd-cd87-4147-b99c-6a438196b169\" (UID: \"8a8f48dd-cd87-4147-b99c-6a438196b169\") " Jul 10 16:02:07.301037 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:07.300963 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a8f48dd-cd87-4147-b99c-6a438196b169-bundle\") pod \"8a8f48dd-cd87-4147-b99c-6a438196b169\" (UID: \"8a8f48dd-cd87-4147-b99c-6a438196b169\") " Jul 10 16:02:07.301037 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:07.301005 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvgnp\" (UniqueName: \"kubernetes.io/projected/8a8f48dd-cd87-4147-b99c-6a438196b169-kube-api-access-tvgnp\") pod \"8a8f48dd-cd87-4147-b99c-6a438196b169\" (UID: \"8a8f48dd-cd87-4147-b99c-6a438196b169\") " Jul 10 16:02:07.301433 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:07.301395 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a8f48dd-cd87-4147-b99c-6a438196b169-bundle" (OuterVolumeSpecName: "bundle") pod "8a8f48dd-cd87-4147-b99c-6a438196b169" (UID: "8a8f48dd-cd87-4147-b99c-6a438196b169"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 16:02:07.303198 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:07.303177 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a8f48dd-cd87-4147-b99c-6a438196b169-kube-api-access-tvgnp" (OuterVolumeSpecName: "kube-api-access-tvgnp") pod "8a8f48dd-cd87-4147-b99c-6a438196b169" (UID: "8a8f48dd-cd87-4147-b99c-6a438196b169"). InnerVolumeSpecName "kube-api-access-tvgnp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:02:07.308666 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:07.308637 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a8f48dd-cd87-4147-b99c-6a438196b169-util" (OuterVolumeSpecName: "util") pod "8a8f48dd-cd87-4147-b99c-6a438196b169" (UID: "8a8f48dd-cd87-4147-b99c-6a438196b169"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 16:02:07.402112 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:07.402075 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvgnp\" (UniqueName: \"kubernetes.io/projected/8a8f48dd-cd87-4147-b99c-6a438196b169-kube-api-access-tvgnp\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:02:07.402112 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:07.402104 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a8f48dd-cd87-4147-b99c-6a438196b169-util\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:02:07.402112 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:07.402115 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a8f48dd-cd87-4147-b99c-6a438196b169-bundle\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:02:08.083129 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:08.083096 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s" Jul 10 16:02:08.083129 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:08.083116 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s" event={"ID":"8a8f48dd-cd87-4147-b99c-6a438196b169","Type":"ContainerDied","Data":"721adf99f11985b8ab2693496826a75747105d383ccfdd2cf01467d4af76aef3"} Jul 10 16:02:08.083512 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:08.083163 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="721adf99f11985b8ab2693496826a75747105d383ccfdd2cf01467d4af76aef3" Jul 10 16:02:08.211392 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:08.211363 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv" Jul 10 16:02:08.309993 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:08.309962 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1dc74a59-fd5c-440e-850c-bf14d2797a7d-bundle\") pod \"1dc74a59-fd5c-440e-850c-bf14d2797a7d\" (UID: \"1dc74a59-fd5c-440e-850c-bf14d2797a7d\") " Jul 10 16:02:08.310189 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:08.310054 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zhlv\" (UniqueName: \"kubernetes.io/projected/1dc74a59-fd5c-440e-850c-bf14d2797a7d-kube-api-access-5zhlv\") pod \"1dc74a59-fd5c-440e-850c-bf14d2797a7d\" (UID: \"1dc74a59-fd5c-440e-850c-bf14d2797a7d\") " Jul 10 16:02:08.310189 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:08.310075 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1dc74a59-fd5c-440e-850c-bf14d2797a7d-util\") pod \"1dc74a59-fd5c-440e-850c-bf14d2797a7d\" (UID: \"1dc74a59-fd5c-440e-850c-bf14d2797a7d\") " Jul 10 16:02:08.310499 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:08.310473 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dc74a59-fd5c-440e-850c-bf14d2797a7d-bundle" (OuterVolumeSpecName: "bundle") pod "1dc74a59-fd5c-440e-850c-bf14d2797a7d" (UID: "1dc74a59-fd5c-440e-850c-bf14d2797a7d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 16:02:08.312202 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:08.312182 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dc74a59-fd5c-440e-850c-bf14d2797a7d-kube-api-access-5zhlv" (OuterVolumeSpecName: "kube-api-access-5zhlv") pod "1dc74a59-fd5c-440e-850c-bf14d2797a7d" (UID: "1dc74a59-fd5c-440e-850c-bf14d2797a7d"). InnerVolumeSpecName "kube-api-access-5zhlv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:02:08.402712 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:08.402639 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dc74a59-fd5c-440e-850c-bf14d2797a7d-util" (OuterVolumeSpecName: "util") pod "1dc74a59-fd5c-440e-850c-bf14d2797a7d" (UID: "1dc74a59-fd5c-440e-850c-bf14d2797a7d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 16:02:08.410653 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:08.410625 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zhlv\" (UniqueName: \"kubernetes.io/projected/1dc74a59-fd5c-440e-850c-bf14d2797a7d-kube-api-access-5zhlv\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:02:08.410653 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:08.410650 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1dc74a59-fd5c-440e-850c-bf14d2797a7d-util\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:02:08.410773 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:08.410664 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1dc74a59-fd5c-440e-850c-bf14d2797a7d-bundle\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:02:09.089556 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:09.089519 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv" event={"ID":"1dc74a59-fd5c-440e-850c-bf14d2797a7d","Type":"ContainerDied","Data":"1f70a1b1295127dfdbbe75bf4d5768084b8050b2c858db9b5e6772c76a2686fb"} Jul 10 16:02:09.089556 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:09.089551 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv" Jul 10 16:02:09.089980 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:09.089585 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f70a1b1295127dfdbbe75bf4d5768084b8050b2c858db9b5e6772c76a2686fb" Jul 10 16:02:41.841759 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.841721 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-spdjs"] Jul 10 16:02:41.842206 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.842192 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82c7aa6d-9d6b-4a87-ad16-443679254810" containerName="util" Jul 10 16:02:41.842249 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.842209 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="82c7aa6d-9d6b-4a87-ad16-443679254810" containerName="util" Jul 10 16:02:41.842249 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.842232 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06549e1e-7d20-4da6-927b-342b47014a44" containerName="extract" Jul 10 16:02:41.842249 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.842241 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="06549e1e-7d20-4da6-927b-342b47014a44" containerName="extract" Jul 10 16:02:41.842336 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.842255 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dc74a59-fd5c-440e-850c-bf14d2797a7d" containerName="extract" Jul 10 16:02:41.842336 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.842264 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dc74a59-fd5c-440e-850c-bf14d2797a7d" containerName="extract" Jul 10 16:02:41.842336 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.842276 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06549e1e-7d20-4da6-927b-342b47014a44" containerName="util" Jul 10 16:02:41.842336 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.842284 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="06549e1e-7d20-4da6-927b-342b47014a44" containerName="util" Jul 10 16:02:41.842336 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.842295 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82c7aa6d-9d6b-4a87-ad16-443679254810" containerName="pull" Jul 10 16:02:41.842336 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.842303 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="82c7aa6d-9d6b-4a87-ad16-443679254810" containerName="pull" Jul 10 16:02:41.842336 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.842312 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a8f48dd-cd87-4147-b99c-6a438196b169" containerName="extract" Jul 10 16:02:41.842336 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.842319 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a8f48dd-cd87-4147-b99c-6a438196b169" containerName="extract" Jul 10 16:02:41.842336 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.842326 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dc74a59-fd5c-440e-850c-bf14d2797a7d" containerName="pull" Jul 10 16:02:41.842336 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.842333 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dc74a59-fd5c-440e-850c-bf14d2797a7d" containerName="pull" Jul 10 16:02:41.842653 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.842345 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82c7aa6d-9d6b-4a87-ad16-443679254810" containerName="extract" Jul 10 16:02:41.842653 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.842353 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="82c7aa6d-9d6b-4a87-ad16-443679254810" containerName="extract" Jul 10 16:02:41.842653 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.842366 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dc74a59-fd5c-440e-850c-bf14d2797a7d" containerName="util" Jul 10 16:02:41.842653 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.842373 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dc74a59-fd5c-440e-850c-bf14d2797a7d" containerName="util" Jul 10 16:02:41.842653 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.842386 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a8f48dd-cd87-4147-b99c-6a438196b169" containerName="util" Jul 10 16:02:41.842653 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.842393 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a8f48dd-cd87-4147-b99c-6a438196b169" containerName="util" Jul 10 16:02:41.842653 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.842402 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a8f48dd-cd87-4147-b99c-6a438196b169" containerName="pull" Jul 10 16:02:41.842653 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.842410 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a8f48dd-cd87-4147-b99c-6a438196b169" containerName="pull" Jul 10 16:02:41.842653 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.842420 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06549e1e-7d20-4da6-927b-342b47014a44" containerName="pull" Jul 10 16:02:41.842653 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.842427 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="06549e1e-7d20-4da6-927b-342b47014a44" containerName="pull" Jul 10 16:02:41.842653 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.842500 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="82c7aa6d-9d6b-4a87-ad16-443679254810" containerName="extract" Jul 10 16:02:41.842653 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.842512 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dc74a59-fd5c-440e-850c-bf14d2797a7d" containerName="extract" Jul 10 16:02:41.842653 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.842523 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a8f48dd-cd87-4147-b99c-6a438196b169" containerName="extract" Jul 10 16:02:41.842653 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.842532 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="06549e1e-7d20-4da6-927b-342b47014a44" containerName="extract" Jul 10 16:02:41.847243 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.847227 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-spdjs" Jul 10 16:02:41.849810 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.849787 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 10 16:02:41.850013 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.849987 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 10 16:02:41.850142 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.849927 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 10 16:02:41.850200 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.849873 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jlgqs\"" Jul 10 16:02:41.850767 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.850738 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 10 16:02:41.851163 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.851139 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-spdjs"] Jul 10 16:02:41.897313 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.897284 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a3e6fa43-4907-4c12-851a-abe3fa874b14-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-spdjs\" (UID: \"a3e6fa43-4907-4c12-851a-abe3fa874b14\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-spdjs" Jul 10 16:02:41.897455 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.897348 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3e6fa43-4907-4c12-851a-abe3fa874b14-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-spdjs\" (UID: \"a3e6fa43-4907-4c12-851a-abe3fa874b14\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-spdjs" Jul 10 16:02:41.897455 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.897416 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqwrs\" (UniqueName: \"kubernetes.io/projected/a3e6fa43-4907-4c12-851a-abe3fa874b14-kube-api-access-kqwrs\") pod \"kuadrant-console-plugin-66b5774985-spdjs\" (UID: \"a3e6fa43-4907-4c12-851a-abe3fa874b14\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-spdjs" Jul 10 16:02:41.998164 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.998136 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3e6fa43-4907-4c12-851a-abe3fa874b14-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-spdjs\" (UID: \"a3e6fa43-4907-4c12-851a-abe3fa874b14\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-spdjs" Jul 10 16:02:41.998316 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.998187 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqwrs\" (UniqueName: \"kubernetes.io/projected/a3e6fa43-4907-4c12-851a-abe3fa874b14-kube-api-access-kqwrs\") pod \"kuadrant-console-plugin-66b5774985-spdjs\" (UID: \"a3e6fa43-4907-4c12-851a-abe3fa874b14\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-spdjs" Jul 10 16:02:41.998316 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.998229 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a3e6fa43-4907-4c12-851a-abe3fa874b14-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-spdjs\" (UID: \"a3e6fa43-4907-4c12-851a-abe3fa874b14\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-spdjs" Jul 10 16:02:41.998316 ip-10-0-136-164 kubenswrapper[2562]: E0710 16:02:41.998262 2562 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 10 16:02:41.998431 ip-10-0-136-164 kubenswrapper[2562]: E0710 16:02:41.998322 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3e6fa43-4907-4c12-851a-abe3fa874b14-plugin-serving-cert podName:a3e6fa43-4907-4c12-851a-abe3fa874b14 nodeName:}" failed. No retries permitted until 2026-07-10 16:02:42.49830098 +0000 UTC m=+461.930785954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/a3e6fa43-4907-4c12-851a-abe3fa874b14-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-spdjs" (UID: "a3e6fa43-4907-4c12-851a-abe3fa874b14") : secret "plugin-serving-cert" not found Jul 10 16:02:41.998869 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:41.998849 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a3e6fa43-4907-4c12-851a-abe3fa874b14-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-spdjs\" (UID: \"a3e6fa43-4907-4c12-851a-abe3fa874b14\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-spdjs" Jul 10 16:02:42.006877 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:42.006859 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqwrs\" (UniqueName: \"kubernetes.io/projected/a3e6fa43-4907-4c12-851a-abe3fa874b14-kube-api-access-kqwrs\") pod \"kuadrant-console-plugin-66b5774985-spdjs\" (UID: \"a3e6fa43-4907-4c12-851a-abe3fa874b14\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-spdjs" Jul 10 16:02:42.503222 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:42.503182 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3e6fa43-4907-4c12-851a-abe3fa874b14-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-spdjs\" (UID: \"a3e6fa43-4907-4c12-851a-abe3fa874b14\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-spdjs" Jul 10 16:02:42.505802 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:42.505779 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3e6fa43-4907-4c12-851a-abe3fa874b14-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-spdjs\" (UID: \"a3e6fa43-4907-4c12-851a-abe3fa874b14\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-spdjs" Jul 10 16:02:42.757981 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:42.757897 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-spdjs" Jul 10 16:02:42.890892 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:42.890870 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-spdjs"] Jul 10 16:02:42.892884 ip-10-0-136-164 kubenswrapper[2562]: W0710 16:02:42.892852 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3e6fa43_4907_4c12_851a_abe3fa874b14.slice/crio-f988cae02f4965dc76f42dffc27107309fc30b3427393a6556c4010f5a12900d WatchSource:0}: Error finding container f988cae02f4965dc76f42dffc27107309fc30b3427393a6556c4010f5a12900d: Status 404 returned error can't find the container with id f988cae02f4965dc76f42dffc27107309fc30b3427393a6556c4010f5a12900d Jul 10 16:02:43.259424 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:02:43.259388 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-spdjs" event={"ID":"a3e6fa43-4907-4c12-851a-abe3fa874b14","Type":"ContainerStarted","Data":"f988cae02f4965dc76f42dffc27107309fc30b3427393a6556c4010f5a12900d"} Jul 10 16:03:08.409070 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:08.408979 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-spdjs" event={"ID":"a3e6fa43-4907-4c12-851a-abe3fa874b14","Type":"ContainerStarted","Data":"7b0dc548d0c0834cb0306dec7cbe61bcd18b7d2973dfa524fbfab056b43c83a7"} Jul 10 16:03:08.426377 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:08.426326 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-spdjs" podStartSLOduration=2.19757949 podStartE2EDuration="27.426310867s" totalImagesPullingTime="25.228731377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:02:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:03:08.425297465 +0000 UTC m=+487.857782463" watchObservedRunningTime="2026-07-10 16:03:08.426310867 +0000 UTC m=+487.858795861" Jul 10 16:03:16.267633 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:16.267598 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66fc78f9fb-7kj98"] Jul 10 16:03:16.329291 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:16.329251 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66fc78f9fb-7kj98"] Jul 10 16:03:16.329808 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:16.329349 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66fc78f9fb-7kj98" Jul 10 16:03:16.519866 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:16.519775 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a729033-2e3a-4a2d-a578-d0defb737a20-console-oauth-config\") pod \"console-66fc78f9fb-7kj98\" (UID: \"3a729033-2e3a-4a2d-a578-d0defb737a20\") " pod="openshift-console/console-66fc78f9fb-7kj98" Jul 10 16:03:16.519866 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:16.519822 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a729033-2e3a-4a2d-a578-d0defb737a20-console-serving-cert\") pod \"console-66fc78f9fb-7kj98\" (UID: \"3a729033-2e3a-4a2d-a578-d0defb737a20\") " pod="openshift-console/console-66fc78f9fb-7kj98" Jul 10 16:03:16.519866 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:16.519840 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a729033-2e3a-4a2d-a578-d0defb737a20-trusted-ca-bundle\") pod \"console-66fc78f9fb-7kj98\" (UID: \"3a729033-2e3a-4a2d-a578-d0defb737a20\") " pod="openshift-console/console-66fc78f9fb-7kj98" Jul 10 16:03:16.519866 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:16.519864 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a729033-2e3a-4a2d-a578-d0defb737a20-oauth-serving-cert\") pod \"console-66fc78f9fb-7kj98\" (UID: \"3a729033-2e3a-4a2d-a578-d0defb737a20\") " pod="openshift-console/console-66fc78f9fb-7kj98" Jul 10 16:03:16.520107 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:16.519887 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a729033-2e3a-4a2d-a578-d0defb737a20-console-config\") pod \"console-66fc78f9fb-7kj98\" (UID: \"3a729033-2e3a-4a2d-a578-d0defb737a20\") " pod="openshift-console/console-66fc78f9fb-7kj98" Jul 10 16:03:16.520107 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:16.519924 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a729033-2e3a-4a2d-a578-d0defb737a20-service-ca\") pod \"console-66fc78f9fb-7kj98\" (UID: \"3a729033-2e3a-4a2d-a578-d0defb737a20\") " pod="openshift-console/console-66fc78f9fb-7kj98" Jul 10 16:03:16.520107 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:16.519998 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wq68\" (UniqueName: \"kubernetes.io/projected/3a729033-2e3a-4a2d-a578-d0defb737a20-kube-api-access-2wq68\") pod \"console-66fc78f9fb-7kj98\" (UID: \"3a729033-2e3a-4a2d-a578-d0defb737a20\") " pod="openshift-console/console-66fc78f9fb-7kj98" Jul 10 16:03:16.620644 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:16.620610 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a729033-2e3a-4a2d-a578-d0defb737a20-trusted-ca-bundle\") pod \"console-66fc78f9fb-7kj98\" (UID: \"3a729033-2e3a-4a2d-a578-d0defb737a20\") " pod="openshift-console/console-66fc78f9fb-7kj98" Jul 10 16:03:16.620644 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:16.620648 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a729033-2e3a-4a2d-a578-d0defb737a20-oauth-serving-cert\") pod \"console-66fc78f9fb-7kj98\" (UID: \"3a729033-2e3a-4a2d-a578-d0defb737a20\") " pod="openshift-console/console-66fc78f9fb-7kj98" Jul 10 16:03:16.620862 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:16.620676 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a729033-2e3a-4a2d-a578-d0defb737a20-console-config\") pod \"console-66fc78f9fb-7kj98\" (UID: \"3a729033-2e3a-4a2d-a578-d0defb737a20\") " pod="openshift-console/console-66fc78f9fb-7kj98" Jul 10 16:03:16.620862 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:16.620732 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a729033-2e3a-4a2d-a578-d0defb737a20-service-ca\") pod \"console-66fc78f9fb-7kj98\" (UID: \"3a729033-2e3a-4a2d-a578-d0defb737a20\") " pod="openshift-console/console-66fc78f9fb-7kj98" Jul 10 16:03:16.620862 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:16.620816 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wq68\" (UniqueName: \"kubernetes.io/projected/3a729033-2e3a-4a2d-a578-d0defb737a20-kube-api-access-2wq68\") pod \"console-66fc78f9fb-7kj98\" (UID: \"3a729033-2e3a-4a2d-a578-d0defb737a20\") " pod="openshift-console/console-66fc78f9fb-7kj98" Jul 10 16:03:16.620862 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:16.620853 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a729033-2e3a-4a2d-a578-d0defb737a20-console-oauth-config\") pod \"console-66fc78f9fb-7kj98\" (UID: \"3a729033-2e3a-4a2d-a578-d0defb737a20\") " pod="openshift-console/console-66fc78f9fb-7kj98" Jul 10 16:03:16.621050 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:16.620893 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a729033-2e3a-4a2d-a578-d0defb737a20-console-serving-cert\") pod \"console-66fc78f9fb-7kj98\" (UID: \"3a729033-2e3a-4a2d-a578-d0defb737a20\") " pod="openshift-console/console-66fc78f9fb-7kj98" Jul 10 16:03:16.621405 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:16.621373 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a729033-2e3a-4a2d-a578-d0defb737a20-oauth-serving-cert\") pod \"console-66fc78f9fb-7kj98\" (UID: \"3a729033-2e3a-4a2d-a578-d0defb737a20\") " pod="openshift-console/console-66fc78f9fb-7kj98" Jul 10 16:03:16.621526 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:16.621480 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a729033-2e3a-4a2d-a578-d0defb737a20-console-config\") pod \"console-66fc78f9fb-7kj98\" (UID: \"3a729033-2e3a-4a2d-a578-d0defb737a20\") " pod="openshift-console/console-66fc78f9fb-7kj98" Jul 10 16:03:16.621526 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:16.621505 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a729033-2e3a-4a2d-a578-d0defb737a20-trusted-ca-bundle\") pod \"console-66fc78f9fb-7kj98\" (UID: \"3a729033-2e3a-4a2d-a578-d0defb737a20\") " pod="openshift-console/console-66fc78f9fb-7kj98" Jul 10 16:03:16.621526 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:16.621514 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a729033-2e3a-4a2d-a578-d0defb737a20-service-ca\") pod \"console-66fc78f9fb-7kj98\" (UID: \"3a729033-2e3a-4a2d-a578-d0defb737a20\") " pod="openshift-console/console-66fc78f9fb-7kj98" Jul 10 16:03:16.623723 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:16.623699 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a729033-2e3a-4a2d-a578-d0defb737a20-console-oauth-config\") pod \"console-66fc78f9fb-7kj98\" (UID: \"3a729033-2e3a-4a2d-a578-d0defb737a20\") " pod="openshift-console/console-66fc78f9fb-7kj98" Jul 10 16:03:16.623843 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:16.623824 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a729033-2e3a-4a2d-a578-d0defb737a20-console-serving-cert\") pod \"console-66fc78f9fb-7kj98\" (UID: \"3a729033-2e3a-4a2d-a578-d0defb737a20\") " pod="openshift-console/console-66fc78f9fb-7kj98" Jul 10 16:03:16.629192 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:16.629170 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wq68\" (UniqueName: \"kubernetes.io/projected/3a729033-2e3a-4a2d-a578-d0defb737a20-kube-api-access-2wq68\") pod \"console-66fc78f9fb-7kj98\" (UID: \"3a729033-2e3a-4a2d-a578-d0defb737a20\") " pod="openshift-console/console-66fc78f9fb-7kj98" Jul 10 16:03:16.638066 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:16.638046 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66fc78f9fb-7kj98" Jul 10 16:03:16.775133 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:16.775099 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66fc78f9fb-7kj98"] Jul 10 16:03:16.776390 ip-10-0-136-164 kubenswrapper[2562]: W0710 16:03:16.776365 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a729033_2e3a_4a2d_a578_d0defb737a20.slice/crio-9c1412786da5e7136e77a001604f01c18d0761a5c8aff4c95323a43201f8b90d WatchSource:0}: Error finding container 9c1412786da5e7136e77a001604f01c18d0761a5c8aff4c95323a43201f8b90d: Status 404 returned error can't find the container with id 9c1412786da5e7136e77a001604f01c18d0761a5c8aff4c95323a43201f8b90d Jul 10 16:03:17.455041 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:17.455004 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66fc78f9fb-7kj98" event={"ID":"3a729033-2e3a-4a2d-a578-d0defb737a20","Type":"ContainerStarted","Data":"3c233df9ba04a40deefb8b5ed3fe192e30704a4699d74994dad8a48cb3c6a20a"} Jul 10 16:03:17.455445 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:17.455087 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66fc78f9fb-7kj98" event={"ID":"3a729033-2e3a-4a2d-a578-d0defb737a20","Type":"ContainerStarted","Data":"9c1412786da5e7136e77a001604f01c18d0761a5c8aff4c95323a43201f8b90d"} Jul 10 16:03:17.476302 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:17.476249 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66fc78f9fb-7kj98" podStartSLOduration=1.476234923 podStartE2EDuration="1.476234923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:03:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:03:17.47452203 +0000 UTC m=+496.907007034" watchObservedRunningTime="2026-07-10 16:03:17.476234923 +0000 UTC m=+496.908719917" Jul 10 16:03:26.638589 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:26.638523 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66fc78f9fb-7kj98" Jul 10 16:03:26.639058 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:26.638631 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66fc78f9fb-7kj98" Jul 10 16:03:26.643360 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:26.643336 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66fc78f9fb-7kj98" Jul 10 16:03:27.512045 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:27.512018 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66fc78f9fb-7kj98" Jul 10 16:03:27.560549 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:27.560520 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8584664959-z8k5m"] Jul 10 16:03:35.613446 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:35.613409 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:03:35.641268 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:35.641225 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:03:35.641268 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:35.641247 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-vkwrm" Jul 10 16:03:35.642026 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:35.642009 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:03:35.643956 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:35.643938 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 10 16:03:35.686975 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:35.686938 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhn6m\" (UniqueName: \"kubernetes.io/projected/649f88cf-4e1e-414d-a0b3-195b609fcd7a-kube-api-access-nhn6m\") pod \"limitador-limitador-54d6d988d5-vkwrm\" (UID: \"649f88cf-4e1e-414d-a0b3-195b609fcd7a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vkwrm" Jul 10 16:03:35.687149 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:35.687019 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/649f88cf-4e1e-414d-a0b3-195b609fcd7a-config-file\") pod \"limitador-limitador-54d6d988d5-vkwrm\" (UID: \"649f88cf-4e1e-414d-a0b3-195b609fcd7a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vkwrm" Jul 10 16:03:35.788293 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:35.788248 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhn6m\" (UniqueName: \"kubernetes.io/projected/649f88cf-4e1e-414d-a0b3-195b609fcd7a-kube-api-access-nhn6m\") pod \"limitador-limitador-54d6d988d5-vkwrm\" (UID: \"649f88cf-4e1e-414d-a0b3-195b609fcd7a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vkwrm" Jul 10 16:03:35.788490 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:35.788327 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/649f88cf-4e1e-414d-a0b3-195b609fcd7a-config-file\") pod \"limitador-limitador-54d6d988d5-vkwrm\" (UID: \"649f88cf-4e1e-414d-a0b3-195b609fcd7a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vkwrm" Jul 10 16:03:35.789004 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:35.788983 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/649f88cf-4e1e-414d-a0b3-195b609fcd7a-config-file\") pod \"limitador-limitador-54d6d988d5-vkwrm\" (UID: \"649f88cf-4e1e-414d-a0b3-195b609fcd7a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vkwrm" Jul 10 16:03:35.797105 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:35.797072 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhn6m\" (UniqueName: \"kubernetes.io/projected/649f88cf-4e1e-414d-a0b3-195b609fcd7a-kube-api-access-nhn6m\") pod \"limitador-limitador-54d6d988d5-vkwrm\" (UID: \"649f88cf-4e1e-414d-a0b3-195b609fcd7a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vkwrm" Jul 10 16:03:35.952359 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:35.952273 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-vkwrm" Jul 10 16:03:36.090412 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:36.090376 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:03:36.091926 ip-10-0-136-164 kubenswrapper[2562]: W0710 16:03:36.091894 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod649f88cf_4e1e_414d_a0b3_195b609fcd7a.slice/crio-87a6de1aa1134e0ab85acc82f6875d6f0a1a276fe8a2f7e0edda451dc7083185 WatchSource:0}: Error finding container 87a6de1aa1134e0ab85acc82f6875d6f0a1a276fe8a2f7e0edda451dc7083185: Status 404 returned error can't find the container with id 87a6de1aa1134e0ab85acc82f6875d6f0a1a276fe8a2f7e0edda451dc7083185 Jul 10 16:03:36.216257 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:36.216177 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-tfmxf"] Jul 10 16:03:36.221045 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:36.221024 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tfmxf" Jul 10 16:03:36.223349 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:36.223330 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ztqc9\"" Jul 10 16:03:36.227168 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:36.227144 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tfmxf"] Jul 10 16:03:36.294012 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:36.293975 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkzmq\" (UniqueName: \"kubernetes.io/projected/5ee5839e-68b3-4f49-82aa-499dd8effc83-kube-api-access-mkzmq\") pod \"authorino-75d556bd77-tfmxf\" (UID: \"5ee5839e-68b3-4f49-82aa-499dd8effc83\") " pod="kuadrant-system/authorino-75d556bd77-tfmxf" Jul 10 16:03:36.394669 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:36.394638 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkzmq\" (UniqueName: \"kubernetes.io/projected/5ee5839e-68b3-4f49-82aa-499dd8effc83-kube-api-access-mkzmq\") pod \"authorino-75d556bd77-tfmxf\" (UID: \"5ee5839e-68b3-4f49-82aa-499dd8effc83\") " pod="kuadrant-system/authorino-75d556bd77-tfmxf" Jul 10 16:03:36.403429 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:36.403405 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkzmq\" (UniqueName: \"kubernetes.io/projected/5ee5839e-68b3-4f49-82aa-499dd8effc83-kube-api-access-mkzmq\") pod \"authorino-75d556bd77-tfmxf\" (UID: \"5ee5839e-68b3-4f49-82aa-499dd8effc83\") " pod="kuadrant-system/authorino-75d556bd77-tfmxf" Jul 10 16:03:36.531832 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:36.531755 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tfmxf" Jul 10 16:03:36.559594 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:36.559532 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-vkwrm" event={"ID":"649f88cf-4e1e-414d-a0b3-195b609fcd7a","Type":"ContainerStarted","Data":"87a6de1aa1134e0ab85acc82f6875d6f0a1a276fe8a2f7e0edda451dc7083185"} Jul 10 16:03:36.711268 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:36.711207 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tfmxf"] Jul 10 16:03:36.711777 ip-10-0-136-164 kubenswrapper[2562]: W0710 16:03:36.711724 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ee5839e_68b3_4f49_82aa_499dd8effc83.slice/crio-01e55c5089e408007202f9b6067b5b9c51f9ee63b0d6c338d0a6804c61b6cc3d WatchSource:0}: Error finding container 01e55c5089e408007202f9b6067b5b9c51f9ee63b0d6c338d0a6804c61b6cc3d: Status 404 returned error can't find the container with id 01e55c5089e408007202f9b6067b5b9c51f9ee63b0d6c338d0a6804c61b6cc3d Jul 10 16:03:37.568772 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:37.568734 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tfmxf" event={"ID":"5ee5839e-68b3-4f49-82aa-499dd8effc83","Type":"ContainerStarted","Data":"01e55c5089e408007202f9b6067b5b9c51f9ee63b0d6c338d0a6804c61b6cc3d"} Jul 10 16:03:40.588378 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:40.588348 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-vkwrm" event={"ID":"649f88cf-4e1e-414d-a0b3-195b609fcd7a","Type":"ContainerStarted","Data":"480bce688e71faf5a091f73819c5216a0e04948a318b3ff2e654c17c941312a1"} Jul 10 16:03:40.588781 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:40.588441 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-vkwrm" Jul 10 16:03:40.608262 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:40.608218 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-vkwrm" podStartSLOduration=1.251100744 podStartE2EDuration="5.608200022s" totalImagesPullingTime="4.357099278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:03:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:03:40.605258297 +0000 UTC m=+520.037743290" watchObservedRunningTime="2026-07-10 16:03:40.608200022 +0000 UTC m=+520.040685018" Jul 10 16:03:41.594734 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:41.594696 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tfmxf" event={"ID":"5ee5839e-68b3-4f49-82aa-499dd8effc83","Type":"ContainerStarted","Data":"65d5ec1cc50510f0051d064e2e93b3d934ee6ae5d7dee7d1e7e9feeddd8a673d"} Jul 10 16:03:41.610632 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:41.610584 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-tfmxf" podStartSLOduration=1.794473867 podStartE2EDuration="5.610546464s" totalImagesPullingTime="3.816072597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:03:41.609684667 +0000 UTC m=+521.042169661" watchObservedRunningTime="2026-07-10 16:03:41.610546464 +0000 UTC m=+521.043031459" Jul 10 16:03:51.596136 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:51.596054 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-vkwrm" Jul 10 16:03:52.581659 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:52.581615 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8584664959-z8k5m" podUID="81d0ff10-85b2-4092-8d0b-68911890cc7b" containerName="console" containerID="cri-o://563f27d61b1713fbbf5b768acb58104e4ed3e22322fe217e8a8ca8657f4f3f77" gracePeriod=15 Jul 10 16:03:52.842697 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:52.842636 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8584664959-z8k5m" Jul 10 16:03:52.948650 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:52.948619 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81d0ff10-85b2-4092-8d0b-68911890cc7b-console-serving-cert\") pod \"81d0ff10-85b2-4092-8d0b-68911890cc7b\" (UID: \"81d0ff10-85b2-4092-8d0b-68911890cc7b\") " Jul 10 16:03:52.948812 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:52.948677 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81d0ff10-85b2-4092-8d0b-68911890cc7b-oauth-serving-cert\") pod \"81d0ff10-85b2-4092-8d0b-68911890cc7b\" (UID: \"81d0ff10-85b2-4092-8d0b-68911890cc7b\") " Jul 10 16:03:52.948812 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:52.948712 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81d0ff10-85b2-4092-8d0b-68911890cc7b-console-oauth-config\") pod \"81d0ff10-85b2-4092-8d0b-68911890cc7b\" (UID: \"81d0ff10-85b2-4092-8d0b-68911890cc7b\") " Jul 10 16:03:52.948896 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:52.948879 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81d0ff10-85b2-4092-8d0b-68911890cc7b-service-ca\") pod \"81d0ff10-85b2-4092-8d0b-68911890cc7b\" (UID: \"81d0ff10-85b2-4092-8d0b-68911890cc7b\") " Jul 10 16:03:52.948951 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:52.948928 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81d0ff10-85b2-4092-8d0b-68911890cc7b-console-config\") pod \"81d0ff10-85b2-4092-8d0b-68911890cc7b\" (UID: \"81d0ff10-85b2-4092-8d0b-68911890cc7b\") " Jul 10 16:03:52.949002 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:52.948971 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81d0ff10-85b2-4092-8d0b-68911890cc7b-trusted-ca-bundle\") pod \"81d0ff10-85b2-4092-8d0b-68911890cc7b\" (UID: \"81d0ff10-85b2-4092-8d0b-68911890cc7b\") " Jul 10 16:03:52.949084 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:52.949061 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfm4j\" (UniqueName: \"kubernetes.io/projected/81d0ff10-85b2-4092-8d0b-68911890cc7b-kube-api-access-vfm4j\") pod \"81d0ff10-85b2-4092-8d0b-68911890cc7b\" (UID: \"81d0ff10-85b2-4092-8d0b-68911890cc7b\") " Jul 10 16:03:52.949220 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:52.949176 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81d0ff10-85b2-4092-8d0b-68911890cc7b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "81d0ff10-85b2-4092-8d0b-68911890cc7b" (UID: "81d0ff10-85b2-4092-8d0b-68911890cc7b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 16:03:52.949364 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:52.949234 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81d0ff10-85b2-4092-8d0b-68911890cc7b-service-ca" (OuterVolumeSpecName: "service-ca") pod "81d0ff10-85b2-4092-8d0b-68911890cc7b" (UID: "81d0ff10-85b2-4092-8d0b-68911890cc7b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 16:03:52.949364 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:52.949337 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81d0ff10-85b2-4092-8d0b-68911890cc7b-console-config" (OuterVolumeSpecName: "console-config") pod "81d0ff10-85b2-4092-8d0b-68911890cc7b" (UID: "81d0ff10-85b2-4092-8d0b-68911890cc7b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 16:03:52.949493 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:52.949442 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81d0ff10-85b2-4092-8d0b-68911890cc7b-oauth-serving-cert\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:03:52.949493 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:52.949461 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81d0ff10-85b2-4092-8d0b-68911890cc7b-service-ca\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:03:52.949493 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:52.949475 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81d0ff10-85b2-4092-8d0b-68911890cc7b-console-config\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:03:52.949734 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:52.949702 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81d0ff10-85b2-4092-8d0b-68911890cc7b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "81d0ff10-85b2-4092-8d0b-68911890cc7b" (UID: "81d0ff10-85b2-4092-8d0b-68911890cc7b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 16:03:52.951092 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:52.951062 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81d0ff10-85b2-4092-8d0b-68911890cc7b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "81d0ff10-85b2-4092-8d0b-68911890cc7b" (UID: "81d0ff10-85b2-4092-8d0b-68911890cc7b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 16:03:52.951179 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:52.951109 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81d0ff10-85b2-4092-8d0b-68911890cc7b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "81d0ff10-85b2-4092-8d0b-68911890cc7b" (UID: "81d0ff10-85b2-4092-8d0b-68911890cc7b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 16:03:52.951232 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:52.951212 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81d0ff10-85b2-4092-8d0b-68911890cc7b-kube-api-access-vfm4j" (OuterVolumeSpecName: "kube-api-access-vfm4j") pod "81d0ff10-85b2-4092-8d0b-68911890cc7b" (UID: "81d0ff10-85b2-4092-8d0b-68911890cc7b"). InnerVolumeSpecName "kube-api-access-vfm4j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:03:53.050940 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:53.050909 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81d0ff10-85b2-4092-8d0b-68911890cc7b-console-oauth-config\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:03:53.050940 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:53.050938 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81d0ff10-85b2-4092-8d0b-68911890cc7b-trusted-ca-bundle\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:03:53.051111 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:53.050953 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfm4j\" (UniqueName: \"kubernetes.io/projected/81d0ff10-85b2-4092-8d0b-68911890cc7b-kube-api-access-vfm4j\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:03:53.051111 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:53.050967 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81d0ff10-85b2-4092-8d0b-68911890cc7b-console-serving-cert\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:03:53.657968 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:53.657927 2562 generic.go:356] "Generic (PLEG): container finished" podID="81d0ff10-85b2-4092-8d0b-68911890cc7b" containerID="563f27d61b1713fbbf5b768acb58104e4ed3e22322fe217e8a8ca8657f4f3f77" exitCode=0 Jul 10 16:03:53.658136 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:53.657975 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8584664959-z8k5m" Jul 10 16:03:53.658136 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:53.658013 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8584664959-z8k5m" event={"ID":"81d0ff10-85b2-4092-8d0b-68911890cc7b","Type":"ContainerDied","Data":"563f27d61b1713fbbf5b768acb58104e4ed3e22322fe217e8a8ca8657f4f3f77"} Jul 10 16:03:53.658136 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:53.658065 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8584664959-z8k5m" event={"ID":"81d0ff10-85b2-4092-8d0b-68911890cc7b","Type":"ContainerDied","Data":"ac00a9338034f08d04333361a6d77336bb2bf664cf2fb5b2fde8dc7636e92d85"} Jul 10 16:03:53.658136 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:53.658085 2562 scope.go:117] "RemoveContainer" containerID="563f27d61b1713fbbf5b768acb58104e4ed3e22322fe217e8a8ca8657f4f3f77" Jul 10 16:03:53.666830 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:53.666813 2562 scope.go:117] "RemoveContainer" containerID="563f27d61b1713fbbf5b768acb58104e4ed3e22322fe217e8a8ca8657f4f3f77" Jul 10 16:03:53.667106 ip-10-0-136-164 kubenswrapper[2562]: E0710 16:03:53.667081 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"563f27d61b1713fbbf5b768acb58104e4ed3e22322fe217e8a8ca8657f4f3f77\": container with ID starting with 563f27d61b1713fbbf5b768acb58104e4ed3e22322fe217e8a8ca8657f4f3f77 not found: ID does not exist" containerID="563f27d61b1713fbbf5b768acb58104e4ed3e22322fe217e8a8ca8657f4f3f77" Jul 10 16:03:53.667145 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:53.667114 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"563f27d61b1713fbbf5b768acb58104e4ed3e22322fe217e8a8ca8657f4f3f77"} err="failed to get container status \"563f27d61b1713fbbf5b768acb58104e4ed3e22322fe217e8a8ca8657f4f3f77\": rpc error: code = NotFound desc = could not find container \"563f27d61b1713fbbf5b768acb58104e4ed3e22322fe217e8a8ca8657f4f3f77\": container with ID starting with 563f27d61b1713fbbf5b768acb58104e4ed3e22322fe217e8a8ca8657f4f3f77 not found: ID does not exist" Jul 10 16:03:53.695443 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:53.695419 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8584664959-z8k5m"] Jul 10 16:03:53.711131 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:53.711111 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8584664959-z8k5m"] Jul 10 16:03:54.988441 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:03:54.988409 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81d0ff10-85b2-4092-8d0b-68911890cc7b" path="/var/lib/kubelet/pods/81d0ff10-85b2-4092-8d0b-68911890cc7b/volumes" Jul 10 16:04:09.730861 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:04:09.730826 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tfmxf"] Jul 10 16:04:09.731303 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:04:09.731008 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-tfmxf" podUID="5ee5839e-68b3-4f49-82aa-499dd8effc83" containerName="authorino" containerID="cri-o://65d5ec1cc50510f0051d064e2e93b3d934ee6ae5d7dee7d1e7e9feeddd8a673d" gracePeriod=30 Jul 10 16:04:09.987139 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:04:09.987085 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tfmxf" Jul 10 16:04:10.096843 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:04:10.096797 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkzmq\" (UniqueName: \"kubernetes.io/projected/5ee5839e-68b3-4f49-82aa-499dd8effc83-kube-api-access-mkzmq\") pod \"5ee5839e-68b3-4f49-82aa-499dd8effc83\" (UID: \"5ee5839e-68b3-4f49-82aa-499dd8effc83\") " Jul 10 16:04:10.099065 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:04:10.099038 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ee5839e-68b3-4f49-82aa-499dd8effc83-kube-api-access-mkzmq" (OuterVolumeSpecName: "kube-api-access-mkzmq") pod "5ee5839e-68b3-4f49-82aa-499dd8effc83" (UID: "5ee5839e-68b3-4f49-82aa-499dd8effc83"). InnerVolumeSpecName "kube-api-access-mkzmq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:04:10.197836 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:04:10.197807 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkzmq\" (UniqueName: \"kubernetes.io/projected/5ee5839e-68b3-4f49-82aa-499dd8effc83-kube-api-access-mkzmq\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:04:10.746483 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:04:10.746441 2562 generic.go:356] "Generic (PLEG): container finished" podID="5ee5839e-68b3-4f49-82aa-499dd8effc83" containerID="65d5ec1cc50510f0051d064e2e93b3d934ee6ae5d7dee7d1e7e9feeddd8a673d" exitCode=0 Jul 10 16:04:10.746964 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:04:10.746488 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tfmxf" Jul 10 16:04:10.746964 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:04:10.746535 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tfmxf" event={"ID":"5ee5839e-68b3-4f49-82aa-499dd8effc83","Type":"ContainerDied","Data":"65d5ec1cc50510f0051d064e2e93b3d934ee6ae5d7dee7d1e7e9feeddd8a673d"} Jul 10 16:04:10.746964 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:04:10.746609 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tfmxf" event={"ID":"5ee5839e-68b3-4f49-82aa-499dd8effc83","Type":"ContainerDied","Data":"01e55c5089e408007202f9b6067b5b9c51f9ee63b0d6c338d0a6804c61b6cc3d"} Jul 10 16:04:10.746964 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:04:10.746635 2562 scope.go:117] "RemoveContainer" containerID="65d5ec1cc50510f0051d064e2e93b3d934ee6ae5d7dee7d1e7e9feeddd8a673d" Jul 10 16:04:10.756475 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:04:10.756459 2562 scope.go:117] "RemoveContainer" containerID="65d5ec1cc50510f0051d064e2e93b3d934ee6ae5d7dee7d1e7e9feeddd8a673d" Jul 10 16:04:10.756813 ip-10-0-136-164 kubenswrapper[2562]: E0710 16:04:10.756792 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65d5ec1cc50510f0051d064e2e93b3d934ee6ae5d7dee7d1e7e9feeddd8a673d\": container with ID starting with 65d5ec1cc50510f0051d064e2e93b3d934ee6ae5d7dee7d1e7e9feeddd8a673d not found: ID does not exist" containerID="65d5ec1cc50510f0051d064e2e93b3d934ee6ae5d7dee7d1e7e9feeddd8a673d" Jul 10 16:04:10.756893 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:04:10.756824 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65d5ec1cc50510f0051d064e2e93b3d934ee6ae5d7dee7d1e7e9feeddd8a673d"} err="failed to get container status \"65d5ec1cc50510f0051d064e2e93b3d934ee6ae5d7dee7d1e7e9feeddd8a673d\": rpc error: code = NotFound desc = could not find container \"65d5ec1cc50510f0051d064e2e93b3d934ee6ae5d7dee7d1e7e9feeddd8a673d\": container with ID starting with 65d5ec1cc50510f0051d064e2e93b3d934ee6ae5d7dee7d1e7e9feeddd8a673d not found: ID does not exist" Jul 10 16:04:10.773783 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:04:10.773745 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tfmxf"] Jul 10 16:04:10.777187 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:04:10.777164 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tfmxf"] Jul 10 16:04:10.989524 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:04:10.989487 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ee5839e-68b3-4f49-82aa-499dd8effc83" path="/var/lib/kubelet/pods/5ee5839e-68b3-4f49-82aa-499dd8effc83/volumes" Jul 10 16:04:54.576386 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:04:54.576337 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:05:14.353544 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:05:14.353506 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:05:23.883244 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:05:23.883205 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:05:33.347443 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:05:33.347406 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:06:02.636800 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:06:02.636763 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:06:21.936530 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:06:21.936495 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:06:37.265599 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:06:37.265544 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:08:33.411401 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:08:33.411367 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-867c57d584-kbf8n"] Jul 10 16:08:33.411919 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:08:33.411766 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ee5839e-68b3-4f49-82aa-499dd8effc83" containerName="authorino" Jul 10 16:08:33.411919 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:08:33.411778 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ee5839e-68b3-4f49-82aa-499dd8effc83" containerName="authorino" Jul 10 16:08:33.411919 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:08:33.411795 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81d0ff10-85b2-4092-8d0b-68911890cc7b" containerName="console" Jul 10 16:08:33.411919 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:08:33.411801 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="81d0ff10-85b2-4092-8d0b-68911890cc7b" containerName="console" Jul 10 16:08:33.411919 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:08:33.411860 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ee5839e-68b3-4f49-82aa-499dd8effc83" containerName="authorino" Jul 10 16:08:33.411919 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:08:33.411868 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="81d0ff10-85b2-4092-8d0b-68911890cc7b" containerName="console" Jul 10 16:08:33.414841 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:08:33.414822 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-867c57d584-kbf8n" Jul 10 16:08:33.418510 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:08:33.418490 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 10 16:08:33.419677 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:08:33.419662 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ztqc9\"" Jul 10 16:08:33.464703 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:08:33.464667 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-867c57d584-kbf8n"] Jul 10 16:08:33.481061 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:08:33.481027 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4dcn\" (UniqueName: \"kubernetes.io/projected/1f925758-2bce-4046-be81-a540c2f41eb5-kube-api-access-s4dcn\") pod \"authorino-867c57d584-kbf8n\" (UID: \"1f925758-2bce-4046-be81-a540c2f41eb5\") " pod="kuadrant-system/authorino-867c57d584-kbf8n" Jul 10 16:08:33.481259 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:08:33.481095 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1f925758-2bce-4046-be81-a540c2f41eb5-tls-cert\") pod \"authorino-867c57d584-kbf8n\" (UID: \"1f925758-2bce-4046-be81-a540c2f41eb5\") " pod="kuadrant-system/authorino-867c57d584-kbf8n" Jul 10 16:08:33.582554 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:08:33.582507 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1f925758-2bce-4046-be81-a540c2f41eb5-tls-cert\") pod \"authorino-867c57d584-kbf8n\" (UID: \"1f925758-2bce-4046-be81-a540c2f41eb5\") " pod="kuadrant-system/authorino-867c57d584-kbf8n" Jul 10 16:08:33.582739 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:08:33.582603 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4dcn\" (UniqueName: \"kubernetes.io/projected/1f925758-2bce-4046-be81-a540c2f41eb5-kube-api-access-s4dcn\") pod \"authorino-867c57d584-kbf8n\" (UID: \"1f925758-2bce-4046-be81-a540c2f41eb5\") " pod="kuadrant-system/authorino-867c57d584-kbf8n" Jul 10 16:08:33.585361 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:08:33.585336 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1f925758-2bce-4046-be81-a540c2f41eb5-tls-cert\") pod \"authorino-867c57d584-kbf8n\" (UID: \"1f925758-2bce-4046-be81-a540c2f41eb5\") " pod="kuadrant-system/authorino-867c57d584-kbf8n" Jul 10 16:08:33.595912 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:08:33.595883 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4dcn\" (UniqueName: \"kubernetes.io/projected/1f925758-2bce-4046-be81-a540c2f41eb5-kube-api-access-s4dcn\") pod \"authorino-867c57d584-kbf8n\" (UID: \"1f925758-2bce-4046-be81-a540c2f41eb5\") " pod="kuadrant-system/authorino-867c57d584-kbf8n" Jul 10 16:08:33.724737 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:08:33.724638 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-867c57d584-kbf8n" Jul 10 16:08:33.881002 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:08:33.880975 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-867c57d584-kbf8n"] Jul 10 16:08:33.882854 ip-10-0-136-164 kubenswrapper[2562]: W0710 16:08:33.882829 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f925758_2bce_4046_be81_a540c2f41eb5.slice/crio-0adc2af8b2056b87f66d226391be9d9a192df8a5a35334bf48167b4d5671d9ed WatchSource:0}: Error finding container 0adc2af8b2056b87f66d226391be9d9a192df8a5a35334bf48167b4d5671d9ed: Status 404 returned error can't find the container with id 0adc2af8b2056b87f66d226391be9d9a192df8a5a35334bf48167b4d5671d9ed Jul 10 16:08:33.884157 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:08:33.884138 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 16:08:34.137472 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:08:34.137431 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-867c57d584-kbf8n" event={"ID":"1f925758-2bce-4046-be81-a540c2f41eb5","Type":"ContainerStarted","Data":"0adc2af8b2056b87f66d226391be9d9a192df8a5a35334bf48167b4d5671d9ed"} Jul 10 16:08:35.145449 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:08:35.145412 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-867c57d584-kbf8n" event={"ID":"1f925758-2bce-4046-be81-a540c2f41eb5","Type":"ContainerStarted","Data":"2e94d32d362d1cf40f0a6b23db987f3b33894b0f242ee1172d4e94f946753230"} Jul 10 16:08:35.225595 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:08:35.225497 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-867c57d584-kbf8n" podStartSLOduration=1.66186897 podStartE2EDuration="2.225462074s" totalImagesPullingTime="563.593104ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:08:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:08:35.213490842 +0000 UTC m=+814.645975835" watchObservedRunningTime="2026-07-10 16:08:35.225462074 +0000 UTC m=+814.657947062" Jul 10 16:09:05.484463 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:09:05.484422 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:09:15.473696 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:09:15.473656 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:09:26.289526 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:09:26.289490 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:09:35.142559 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:09:35.142521 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:09:46.357064 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:09:46.357025 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:10:57.743459 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:10:57.743424 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:11:07.642239 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:11:07.642195 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:11:16.529830 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:11:16.529794 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:11:26.239327 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:11:26.239288 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:11:37.443156 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:11:37.443119 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:11:49.335195 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:11:49.335158 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:11:59.940062 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:11:59.940015 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:12:10.351667 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:12:10.351632 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:12:32.539835 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:12:32.539799 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:12:44.536853 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:12:44.536818 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:13:09.144016 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:13:09.143927 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:13:27.545508 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:13:27.545465 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:13:38.642478 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:13:38.642436 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:13:55.828780 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:13:55.828738 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:14:09.939177 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:14:09.939142 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:14:21.438349 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:14:21.438267 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:16:08.033954 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:16:08.033912 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:16:19.140909 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:16:19.140868 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:16:28.130331 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:16:28.130292 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:16:40.203011 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:16:40.202972 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:16:51.041805 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:16:51.041769 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:17:02.441195 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:17:02.441160 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:17:11.140243 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:17:11.140211 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:17:22.544912 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:17:22.544834 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:17:33.242779 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:17:33.242745 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:17:42.240919 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:17:42.240875 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:17:53.149299 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:17:53.149260 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:18:19.241635 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:18:19.241591 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:18:26.741750 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:18:26.741715 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:18:37.257467 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:18:37.257430 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:18:47.153471 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:18:47.153426 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:18:54.238059 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:18:54.237969 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:19:11.048468 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:19:11.048430 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:19:21.737099 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:19:21.737066 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:19:31.140998 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:19:31.140963 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:19:41.640757 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:19:41.640718 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:19:51.043735 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:19:51.043698 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:20:00.943630 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:20:00.943589 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:20:14.240308 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:20:14.240265 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:20:23.747226 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:20:23.747179 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:20:38.431565 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:20:38.431528 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:20:49.240457 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:20:49.240421 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:21:01.754888 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:21:01.754850 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:21:10.334761 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:21:10.334724 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:21:22.342104 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:21:22.342066 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:21:33.934396 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:21:33.934360 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:21:43.531864 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:21:43.531822 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:21:55.335837 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:21:55.335757 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:22:11.726472 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:22:11.726433 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:22:22.744307 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:22:22.744271 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:22:34.934165 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:22:34.934124 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:22:44.729241 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:22:44.729203 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:22:52.535469 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:22:52.535434 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:23:01.645855 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:23:01.645812 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:24:23.639794 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:24:23.639758 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:24:31.682817 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:24:31.682777 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:24:39.844991 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:24:39.844954 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:24:47.854541 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:24:47.854505 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:24:58.644907 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:24:58.644868 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:25:30.249308 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:25:30.249269 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:25:42.436886 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:25:42.436854 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:25:57.145234 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:25:57.145195 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:26:07.142763 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:26:07.142724 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:26:16.856422 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:26:16.856385 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:27:02.144846 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:27:02.144808 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:27:11.650889 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:27:11.650854 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:27:24.999671 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:27:24.999633 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:28:11.768920 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:28:11.768833 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:28:12.266307 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:28:12.266268 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-efe9d3-784579dffd-m726d"] Jul 10 16:28:12.269918 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:28:12.269896 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-efe9d3-784579dffd-m726d" Jul 10 16:28:12.272738 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:28:12.272714 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 10 16:28:12.272922 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:28:12.272781 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 10 16:28:12.273033 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:28:12.272785 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-efe9d3-serving-cert\"" Jul 10 16:28:12.273637 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:28:12.273617 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-xbv8r\"" Jul 10 16:28:12.283673 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:28:12.283637 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-efe9d3-784579dffd-m726d"] Jul 10 16:28:12.366750 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:28:12.366719 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8e3ba18-2720-4963-803e-1e7d8dfc099b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-efe9d3-784579dffd-m726d\" (UID: \"b8e3ba18-2720-4963-803e-1e7d8dfc099b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-efe9d3-784579dffd-m726d" Jul 10 16:28:12.366911 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:28:12.366763 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpgns\" (UniqueName: \"kubernetes.io/projected/b8e3ba18-2720-4963-803e-1e7d8dfc099b-kube-api-access-rpgns\") pod \"maas-api-e2e-inf-b-efe9d3-784579dffd-m726d\" (UID: \"b8e3ba18-2720-4963-803e-1e7d8dfc099b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-efe9d3-784579dffd-m726d" Jul 10 16:28:12.366911 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:28:12.366881 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8e3ba18-2720-4963-803e-1e7d8dfc099b-maas-api-tls\") pod \"maas-api-e2e-inf-b-efe9d3-784579dffd-m726d\" (UID: \"b8e3ba18-2720-4963-803e-1e7d8dfc099b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-efe9d3-784579dffd-m726d" Jul 10 16:28:12.467274 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:28:12.467237 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpgns\" (UniqueName: \"kubernetes.io/projected/b8e3ba18-2720-4963-803e-1e7d8dfc099b-kube-api-access-rpgns\") pod \"maas-api-e2e-inf-b-efe9d3-784579dffd-m726d\" (UID: \"b8e3ba18-2720-4963-803e-1e7d8dfc099b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-efe9d3-784579dffd-m726d" Jul 10 16:28:12.467451 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:28:12.467306 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8e3ba18-2720-4963-803e-1e7d8dfc099b-maas-api-tls\") pod \"maas-api-e2e-inf-b-efe9d3-784579dffd-m726d\" (UID: \"b8e3ba18-2720-4963-803e-1e7d8dfc099b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-efe9d3-784579dffd-m726d" Jul 10 16:28:12.467451 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:28:12.467335 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8e3ba18-2720-4963-803e-1e7d8dfc099b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-efe9d3-784579dffd-m726d\" (UID: \"b8e3ba18-2720-4963-803e-1e7d8dfc099b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-efe9d3-784579dffd-m726d" Jul 10 16:28:12.468001 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:28:12.467978 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8e3ba18-2720-4963-803e-1e7d8dfc099b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-efe9d3-784579dffd-m726d\" (UID: \"b8e3ba18-2720-4963-803e-1e7d8dfc099b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-efe9d3-784579dffd-m726d" Jul 10 16:28:12.469880 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:28:12.469859 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8e3ba18-2720-4963-803e-1e7d8dfc099b-maas-api-tls\") pod \"maas-api-e2e-inf-b-efe9d3-784579dffd-m726d\" (UID: \"b8e3ba18-2720-4963-803e-1e7d8dfc099b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-efe9d3-784579dffd-m726d" Jul 10 16:28:12.476059 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:28:12.476036 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpgns\" (UniqueName: \"kubernetes.io/projected/b8e3ba18-2720-4963-803e-1e7d8dfc099b-kube-api-access-rpgns\") pod \"maas-api-e2e-inf-b-efe9d3-784579dffd-m726d\" (UID: \"b8e3ba18-2720-4963-803e-1e7d8dfc099b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-efe9d3-784579dffd-m726d" Jul 10 16:28:12.583693 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:28:12.583662 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-efe9d3-784579dffd-m726d" Jul 10 16:28:12.725298 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:28:12.725272 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-efe9d3-784579dffd-m726d"] Jul 10 16:28:12.726434 ip-10-0-136-164 kubenswrapper[2562]: W0710 16:28:12.726402 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8e3ba18_2720_4963_803e_1e7d8dfc099b.slice/crio-91160a7050fd95e56e35bad90a9bfaeb4213c8e0de9bcb82f6668c231b79a0c3 WatchSource:0}: Error finding container 91160a7050fd95e56e35bad90a9bfaeb4213c8e0de9bcb82f6668c231b79a0c3: Status 404 returned error can't find the container with id 91160a7050fd95e56e35bad90a9bfaeb4213c8e0de9bcb82f6668c231b79a0c3 Jul 10 16:28:12.728028 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:28:12.728008 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 16:28:13.268826 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:28:13.268748 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-efe9d3-784579dffd-m726d" event={"ID":"b8e3ba18-2720-4963-803e-1e7d8dfc099b","Type":"ContainerStarted","Data":"91160a7050fd95e56e35bad90a9bfaeb4213c8e0de9bcb82f6668c231b79a0c3"} Jul 10 16:28:15.281280 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:28:15.281236 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-efe9d3-784579dffd-m726d" event={"ID":"b8e3ba18-2720-4963-803e-1e7d8dfc099b","Type":"ContainerStarted","Data":"627b3b45b16abe56393a1996c0f303b7e476d7f633a71f303c6e37bc8518f158"} Jul 10 16:28:15.281668 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:28:15.281303 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-efe9d3-784579dffd-m726d" Jul 10 16:28:15.301263 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:28:15.301207 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-efe9d3-784579dffd-m726d" podStartSLOduration=1.762541347 podStartE2EDuration="3.3011891s" totalImagesPullingTime="1.538647753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:28:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:28:15.299104753 +0000 UTC m=+1994.731589811" watchObservedRunningTime="2026-07-10 16:28:15.3011891 +0000 UTC m=+1994.733674116" Jul 10 16:28:21.292800 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:28:21.292761 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-efe9d3-784579dffd-m726d" Jul 10 16:28:26.438919 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:28:26.438884 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:29:07.839982 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:29:07.839942 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:29:25.443635 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:29:25.443594 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:30:00.142292 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:00.142258 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728350-lfx4q"] Jul 10 16:30:00.145769 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:00.145751 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728350-lfx4q" Jul 10 16:30:00.148263 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:00.148242 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rf26q\"" Jul 10 16:30:00.153285 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:00.153260 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728350-lfx4q"] Jul 10 16:30:00.157396 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:00.157378 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728350-lfx4q" Jul 10 16:30:00.297283 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:00.297241 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728350-lfx4q"] Jul 10 16:30:00.299028 ip-10-0-136-164 kubenswrapper[2562]: W0710 16:30:00.299000 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04a72295_ef39_497e_8b6d_9b64dec6618d.slice/crio-ff09094b71e7d219ce3cf166fcc662b4b9dfd11efd4b95c44f4cc6e7b411ceb9 WatchSource:0}: Error finding container ff09094b71e7d219ce3cf166fcc662b4b9dfd11efd4b95c44f4cc6e7b411ceb9: Status 404 returned error can't find the container with id ff09094b71e7d219ce3cf166fcc662b4b9dfd11efd4b95c44f4cc6e7b411ceb9 Jul 10 16:30:00.835521 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:00.835479 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728350-lfx4q" event={"ID":"04a72295-ef39-497e-8b6d-9b64dec6618d","Type":"ContainerStarted","Data":"ff09094b71e7d219ce3cf166fcc662b4b9dfd11efd4b95c44f4cc6e7b411ceb9"} Jul 10 16:30:03.854480 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:03.854436 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728350-lfx4q" event={"ID":"04a72295-ef39-497e-8b6d-9b64dec6618d","Type":"ContainerStarted","Data":"0df016b214c41a46b13537f1426305f17a3894290622481a9a0deeeebb5f76aa"} Jul 10 16:30:03.873176 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:03.873123 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728350-lfx4q" podStartSLOduration=1.593027849 podStartE2EDuration="3.873108875s" totalImagesPullingTime="2.280081026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:30:03.871417299 +0000 UTC m=+2103.303902295" watchObservedRunningTime="2026-07-10 16:30:03.873108875 +0000 UTC m=+2103.305593868" Jul 10 16:30:05.733744 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:05.733705 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-efe9d3-784579dffd-m726d"] Jul 10 16:30:05.734208 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:05.733965 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-efe9d3-784579dffd-m726d" podUID="b8e3ba18-2720-4963-803e-1e7d8dfc099b" containerName="maas-api" containerID="cri-o://627b3b45b16abe56393a1996c0f303b7e476d7f633a71f303c6e37bc8518f158" gracePeriod=30 Jul 10 16:30:06.179089 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:06.179062 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-efe9d3-784579dffd-m726d" Jul 10 16:30:06.261680 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:06.261652 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8e3ba18-2720-4963-803e-1e7d8dfc099b-openshift-service-ca\") pod \"b8e3ba18-2720-4963-803e-1e7d8dfc099b\" (UID: \"b8e3ba18-2720-4963-803e-1e7d8dfc099b\") " Jul 10 16:30:06.261815 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:06.261694 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpgns\" (UniqueName: \"kubernetes.io/projected/b8e3ba18-2720-4963-803e-1e7d8dfc099b-kube-api-access-rpgns\") pod \"b8e3ba18-2720-4963-803e-1e7d8dfc099b\" (UID: \"b8e3ba18-2720-4963-803e-1e7d8dfc099b\") " Jul 10 16:30:06.261815 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:06.261754 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8e3ba18-2720-4963-803e-1e7d8dfc099b-maas-api-tls\") pod \"b8e3ba18-2720-4963-803e-1e7d8dfc099b\" (UID: \"b8e3ba18-2720-4963-803e-1e7d8dfc099b\") " Jul 10 16:30:06.262031 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:06.262007 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8e3ba18-2720-4963-803e-1e7d8dfc099b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b8e3ba18-2720-4963-803e-1e7d8dfc099b" (UID: "b8e3ba18-2720-4963-803e-1e7d8dfc099b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 16:30:06.263925 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:06.263897 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8e3ba18-2720-4963-803e-1e7d8dfc099b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b8e3ba18-2720-4963-803e-1e7d8dfc099b" (UID: "b8e3ba18-2720-4963-803e-1e7d8dfc099b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 16:30:06.264060 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:06.264035 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8e3ba18-2720-4963-803e-1e7d8dfc099b-kube-api-access-rpgns" (OuterVolumeSpecName: "kube-api-access-rpgns") pod "b8e3ba18-2720-4963-803e-1e7d8dfc099b" (UID: "b8e3ba18-2720-4963-803e-1e7d8dfc099b"). InnerVolumeSpecName "kube-api-access-rpgns". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:30:06.363293 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:06.363262 2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8e3ba18-2720-4963-803e-1e7d8dfc099b-maas-api-tls\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:30:06.363293 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:06.363290 2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8e3ba18-2720-4963-803e-1e7d8dfc099b-openshift-service-ca\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:30:06.363293 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:06.363300 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpgns\" (UniqueName: \"kubernetes.io/projected/b8e3ba18-2720-4963-803e-1e7d8dfc099b-kube-api-access-rpgns\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:30:06.876489 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:06.876453 2562 generic.go:356] "Generic (PLEG): container finished" podID="b8e3ba18-2720-4963-803e-1e7d8dfc099b" containerID="627b3b45b16abe56393a1996c0f303b7e476d7f633a71f303c6e37bc8518f158" exitCode=0 Jul 10 16:30:06.876930 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:06.876497 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-efe9d3-784579dffd-m726d" Jul 10 16:30:06.876930 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:06.876536 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-efe9d3-784579dffd-m726d" event={"ID":"b8e3ba18-2720-4963-803e-1e7d8dfc099b","Type":"ContainerDied","Data":"627b3b45b16abe56393a1996c0f303b7e476d7f633a71f303c6e37bc8518f158"} Jul 10 16:30:06.876930 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:06.876607 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-efe9d3-784579dffd-m726d" event={"ID":"b8e3ba18-2720-4963-803e-1e7d8dfc099b","Type":"ContainerDied","Data":"91160a7050fd95e56e35bad90a9bfaeb4213c8e0de9bcb82f6668c231b79a0c3"} Jul 10 16:30:06.876930 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:06.876629 2562 scope.go:117] "RemoveContainer" containerID="627b3b45b16abe56393a1996c0f303b7e476d7f633a71f303c6e37bc8518f158" Jul 10 16:30:06.886056 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:06.886035 2562 scope.go:117] "RemoveContainer" containerID="627b3b45b16abe56393a1996c0f303b7e476d7f633a71f303c6e37bc8518f158" Jul 10 16:30:06.886330 ip-10-0-136-164 kubenswrapper[2562]: E0710 16:30:06.886310 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"627b3b45b16abe56393a1996c0f303b7e476d7f633a71f303c6e37bc8518f158\": container with ID starting with 627b3b45b16abe56393a1996c0f303b7e476d7f633a71f303c6e37bc8518f158 not found: ID does not exist" containerID="627b3b45b16abe56393a1996c0f303b7e476d7f633a71f303c6e37bc8518f158" Jul 10 16:30:06.886381 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:06.886340 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"627b3b45b16abe56393a1996c0f303b7e476d7f633a71f303c6e37bc8518f158"} err="failed to get container status \"627b3b45b16abe56393a1996c0f303b7e476d7f633a71f303c6e37bc8518f158\": rpc error: code = NotFound desc = could not find container \"627b3b45b16abe56393a1996c0f303b7e476d7f633a71f303c6e37bc8518f158\": container with ID starting with 627b3b45b16abe56393a1996c0f303b7e476d7f633a71f303c6e37bc8518f158 not found: ID does not exist" Jul 10 16:30:06.899345 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:06.899318 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-efe9d3-784579dffd-m726d"] Jul 10 16:30:06.903657 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:06.903633 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-efe9d3-784579dffd-m726d"] Jul 10 16:30:06.989844 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:06.989814 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8e3ba18-2720-4963-803e-1e7d8dfc099b" path="/var/lib/kubelet/pods/b8e3ba18-2720-4963-803e-1e7d8dfc099b/volumes" Jul 10 16:30:09.136335 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:09.136291 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:30:16.739211 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:16.739176 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp"] Jul 10 16:30:16.739689 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:16.739560 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8e3ba18-2720-4963-803e-1e7d8dfc099b" containerName="maas-api" Jul 10 16:30:16.739689 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:16.739589 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8e3ba18-2720-4963-803e-1e7d8dfc099b" containerName="maas-api" Jul 10 16:30:16.739689 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:16.739650 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8e3ba18-2720-4963-803e-1e7d8dfc099b" containerName="maas-api" Jul 10 16:30:16.743901 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:16.743879 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp" Jul 10 16:30:16.746391 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:16.746306 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 10 16:30:16.746516 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:16.746387 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 10 16:30:16.748076 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:16.747600 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-xbv8r\"" Jul 10 16:30:16.748178 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:16.748155 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-2b206a-serving-cert\"" Jul 10 16:30:16.751305 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:16.751283 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp"] Jul 10 16:30:16.850134 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:16.850107 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70675279-fb1d-4c0c-9f1c-601aad58042a-maas-api-tls\") pod \"maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp\" (UID: \"70675279-fb1d-4c0c-9f1c-601aad58042a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp" Jul 10 16:30:16.850295 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:16.850163 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-766rh\" (UniqueName: \"kubernetes.io/projected/70675279-fb1d-4c0c-9f1c-601aad58042a-kube-api-access-766rh\") pod \"maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp\" (UID: \"70675279-fb1d-4c0c-9f1c-601aad58042a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp" Jul 10 16:30:16.850295 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:16.850197 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70675279-fb1d-4c0c-9f1c-601aad58042a-openshift-service-ca\") pod \"maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp\" (UID: \"70675279-fb1d-4c0c-9f1c-601aad58042a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp" Jul 10 16:30:16.951203 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:16.951170 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-766rh\" (UniqueName: \"kubernetes.io/projected/70675279-fb1d-4c0c-9f1c-601aad58042a-kube-api-access-766rh\") pod \"maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp\" (UID: \"70675279-fb1d-4c0c-9f1c-601aad58042a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp" Jul 10 16:30:16.951374 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:16.951209 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70675279-fb1d-4c0c-9f1c-601aad58042a-openshift-service-ca\") pod \"maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp\" (UID: \"70675279-fb1d-4c0c-9f1c-601aad58042a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp" Jul 10 16:30:16.951374 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:16.951279 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70675279-fb1d-4c0c-9f1c-601aad58042a-maas-api-tls\") pod \"maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp\" (UID: \"70675279-fb1d-4c0c-9f1c-601aad58042a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp" Jul 10 16:30:16.952027 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:16.952002 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70675279-fb1d-4c0c-9f1c-601aad58042a-openshift-service-ca\") pod \"maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp\" (UID: \"70675279-fb1d-4c0c-9f1c-601aad58042a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp" Jul 10 16:30:16.953889 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:16.953871 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70675279-fb1d-4c0c-9f1c-601aad58042a-maas-api-tls\") pod \"maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp\" (UID: \"70675279-fb1d-4c0c-9f1c-601aad58042a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp" Jul 10 16:30:16.959267 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:16.959240 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-766rh\" (UniqueName: \"kubernetes.io/projected/70675279-fb1d-4c0c-9f1c-601aad58042a-kube-api-access-766rh\") pod \"maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp\" (UID: \"70675279-fb1d-4c0c-9f1c-601aad58042a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp" Jul 10 16:30:17.058064 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:17.058035 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp" Jul 10 16:30:17.199001 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:17.198974 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp"] Jul 10 16:30:17.200907 ip-10-0-136-164 kubenswrapper[2562]: W0710 16:30:17.200879 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70675279_fb1d_4c0c_9f1c_601aad58042a.slice/crio-043165aa5702b3ba0a7f298e8a2a24b26b53a19b42b32b5c231045c597789d78 WatchSource:0}: Error finding container 043165aa5702b3ba0a7f298e8a2a24b26b53a19b42b32b5c231045c597789d78: Status 404 returned error can't find the container with id 043165aa5702b3ba0a7f298e8a2a24b26b53a19b42b32b5c231045c597789d78 Jul 10 16:30:17.934542 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:17.934444 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp" event={"ID":"70675279-fb1d-4c0c-9f1c-601aad58042a","Type":"ContainerStarted","Data":"4cca3b17dbcc84830ca6c0513cb8285b93ac055001d6d11044dc7c50a7a68dcf"} Jul 10 16:30:17.934542 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:17.934501 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp" event={"ID":"70675279-fb1d-4c0c-9f1c-601aad58042a","Type":"ContainerStarted","Data":"043165aa5702b3ba0a7f298e8a2a24b26b53a19b42b32b5c231045c597789d78"} Jul 10 16:30:17.934542 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:17.934542 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp" Jul 10 16:30:17.962471 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:17.962424 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp" podStartSLOduration=1.481237379 podStartE2EDuration="1.962409381s" totalImagesPullingTime="481.172002ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:30:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:30:17.960500352 +0000 UTC m=+2117.392985343" watchObservedRunningTime="2026-07-10 16:30:17.962409381 +0000 UTC m=+2117.394894375" Jul 10 16:30:23.946317 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:23.946286 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp" Jul 10 16:30:24.328518 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:24.328484 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:30:37.386713 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:37.386681 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp"] Jul 10 16:30:37.387216 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:37.386911 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp" podUID="70675279-fb1d-4c0c-9f1c-601aad58042a" containerName="maas-api" containerID="cri-o://4cca3b17dbcc84830ca6c0513cb8285b93ac055001d6d11044dc7c50a7a68dcf" gracePeriod=30 Jul 10 16:30:37.628834 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:37.628811 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp" Jul 10 16:30:37.733305 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:37.733234 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-766rh\" (UniqueName: \"kubernetes.io/projected/70675279-fb1d-4c0c-9f1c-601aad58042a-kube-api-access-766rh\") pod \"70675279-fb1d-4c0c-9f1c-601aad58042a\" (UID: \"70675279-fb1d-4c0c-9f1c-601aad58042a\") " Jul 10 16:30:37.733461 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:37.733324 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70675279-fb1d-4c0c-9f1c-601aad58042a-maas-api-tls\") pod \"70675279-fb1d-4c0c-9f1c-601aad58042a\" (UID: \"70675279-fb1d-4c0c-9f1c-601aad58042a\") " Jul 10 16:30:37.733461 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:37.733356 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70675279-fb1d-4c0c-9f1c-601aad58042a-openshift-service-ca\") pod \"70675279-fb1d-4c0c-9f1c-601aad58042a\" (UID: \"70675279-fb1d-4c0c-9f1c-601aad58042a\") " Jul 10 16:30:37.733808 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:37.733780 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70675279-fb1d-4c0c-9f1c-601aad58042a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "70675279-fb1d-4c0c-9f1c-601aad58042a" (UID: "70675279-fb1d-4c0c-9f1c-601aad58042a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 16:30:37.735519 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:37.735493 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70675279-fb1d-4c0c-9f1c-601aad58042a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "70675279-fb1d-4c0c-9f1c-601aad58042a" (UID: "70675279-fb1d-4c0c-9f1c-601aad58042a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 16:30:37.735647 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:37.735548 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70675279-fb1d-4c0c-9f1c-601aad58042a-kube-api-access-766rh" (OuterVolumeSpecName: "kube-api-access-766rh") pod "70675279-fb1d-4c0c-9f1c-601aad58042a" (UID: "70675279-fb1d-4c0c-9f1c-601aad58042a"). InnerVolumeSpecName "kube-api-access-766rh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:30:37.834388 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:37.834361 2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70675279-fb1d-4c0c-9f1c-601aad58042a-maas-api-tls\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:30:37.834388 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:37.834383 2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70675279-fb1d-4c0c-9f1c-601aad58042a-openshift-service-ca\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:30:37.834388 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:37.834392 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-766rh\" (UniqueName: \"kubernetes.io/projected/70675279-fb1d-4c0c-9f1c-601aad58042a-kube-api-access-766rh\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:30:38.046688 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:38.046647 2562 generic.go:356] "Generic (PLEG): container finished" podID="70675279-fb1d-4c0c-9f1c-601aad58042a" containerID="4cca3b17dbcc84830ca6c0513cb8285b93ac055001d6d11044dc7c50a7a68dcf" exitCode=0 Jul 10 16:30:38.046853 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:38.046687 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp" event={"ID":"70675279-fb1d-4c0c-9f1c-601aad58042a","Type":"ContainerDied","Data":"4cca3b17dbcc84830ca6c0513cb8285b93ac055001d6d11044dc7c50a7a68dcf"} Jul 10 16:30:38.046853 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:38.046711 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp" Jul 10 16:30:38.046853 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:38.046773 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp" event={"ID":"70675279-fb1d-4c0c-9f1c-601aad58042a","Type":"ContainerDied","Data":"043165aa5702b3ba0a7f298e8a2a24b26b53a19b42b32b5c231045c597789d78"} Jul 10 16:30:38.046853 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:38.046797 2562 scope.go:117] "RemoveContainer" containerID="4cca3b17dbcc84830ca6c0513cb8285b93ac055001d6d11044dc7c50a7a68dcf" Jul 10 16:30:38.056808 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:38.056783 2562 scope.go:117] "RemoveContainer" containerID="4cca3b17dbcc84830ca6c0513cb8285b93ac055001d6d11044dc7c50a7a68dcf" Jul 10 16:30:38.057108 ip-10-0-136-164 kubenswrapper[2562]: E0710 16:30:38.057089 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cca3b17dbcc84830ca6c0513cb8285b93ac055001d6d11044dc7c50a7a68dcf\": container with ID starting with 4cca3b17dbcc84830ca6c0513cb8285b93ac055001d6d11044dc7c50a7a68dcf not found: ID does not exist" containerID="4cca3b17dbcc84830ca6c0513cb8285b93ac055001d6d11044dc7c50a7a68dcf" Jul 10 16:30:38.057158 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:38.057117 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cca3b17dbcc84830ca6c0513cb8285b93ac055001d6d11044dc7c50a7a68dcf"} err="failed to get container status \"4cca3b17dbcc84830ca6c0513cb8285b93ac055001d6d11044dc7c50a7a68dcf\": rpc error: code = NotFound desc = could not find container \"4cca3b17dbcc84830ca6c0513cb8285b93ac055001d6d11044dc7c50a7a68dcf\": container with ID starting with 4cca3b17dbcc84830ca6c0513cb8285b93ac055001d6d11044dc7c50a7a68dcf not found: ID does not exist" Jul 10 16:30:38.069283 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:38.069251 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp"] Jul 10 16:30:38.072583 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:38.072549 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2b206a-b96f497b5-l7ppp"] Jul 10 16:30:38.989582 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:38.989536 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70675279-fb1d-4c0c-9f1c-601aad58042a" path="/var/lib/kubelet/pods/70675279-fb1d-4c0c-9f1c-601aad58042a/volumes" Jul 10 16:30:41.437662 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:41.437622 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:30:54.963916 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:30:54.963830 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:31:00.013218 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:00.013182 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728350-lfx4q"] Jul 10 16:31:00.013676 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:00.013418 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728350-lfx4q" podUID="04a72295-ef39-497e-8b6d-9b64dec6618d" containerName="cleanup" containerID="cri-o://0df016b214c41a46b13537f1426305f17a3894290622481a9a0deeeebb5f76aa" gracePeriod=30 Jul 10 16:31:02.281044 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:02.281011 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d"] Jul 10 16:31:02.281400 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:02.281368 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70675279-fb1d-4c0c-9f1c-601aad58042a" containerName="maas-api" Jul 10 16:31:02.281400 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:02.281378 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="70675279-fb1d-4c0c-9f1c-601aad58042a" containerName="maas-api" Jul 10 16:31:02.281477 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:02.281432 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="70675279-fb1d-4c0c-9f1c-601aad58042a" containerName="maas-api" Jul 10 16:31:02.285952 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:02.285935 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d" Jul 10 16:31:02.292776 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:02.292756 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-xbv8r\"" Jul 10 16:31:02.293429 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:02.293415 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 10 16:31:02.293618 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:02.293603 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-466b1a-serving-cert\"" Jul 10 16:31:02.294015 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:02.293999 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 10 16:31:02.325508 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:02.325476 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d"] Jul 10 16:31:02.354251 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:02.354217 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11e5a906-9c59-4ad2-ab1e-4872d69a0a95-maas-api-tls\") pod \"maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d\" (UID: \"11e5a906-9c59-4ad2-ab1e-4872d69a0a95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d" Jul 10 16:31:02.354419 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:02.354261 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn6mj\" (UniqueName: \"kubernetes.io/projected/11e5a906-9c59-4ad2-ab1e-4872d69a0a95-kube-api-access-bn6mj\") pod \"maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d\" (UID: \"11e5a906-9c59-4ad2-ab1e-4872d69a0a95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d" Jul 10 16:31:02.354419 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:02.354342 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11e5a906-9c59-4ad2-ab1e-4872d69a0a95-openshift-service-ca\") pod \"maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d\" (UID: \"11e5a906-9c59-4ad2-ab1e-4872d69a0a95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d" Jul 10 16:31:02.454933 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:02.454894 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11e5a906-9c59-4ad2-ab1e-4872d69a0a95-openshift-service-ca\") pod \"maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d\" (UID: \"11e5a906-9c59-4ad2-ab1e-4872d69a0a95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d" Jul 10 16:31:02.455126 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:02.455009 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11e5a906-9c59-4ad2-ab1e-4872d69a0a95-maas-api-tls\") pod \"maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d\" (UID: \"11e5a906-9c59-4ad2-ab1e-4872d69a0a95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d" Jul 10 16:31:02.455126 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:02.455037 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn6mj\" (UniqueName: \"kubernetes.io/projected/11e5a906-9c59-4ad2-ab1e-4872d69a0a95-kube-api-access-bn6mj\") pod \"maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d\" (UID: \"11e5a906-9c59-4ad2-ab1e-4872d69a0a95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d" Jul 10 16:31:02.455243 ip-10-0-136-164 kubenswrapper[2562]: E0710 16:31:02.455144 2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-466b1a-serving-cert: secret "maas-api-e2e-shared-b-466b1a-serving-cert" not found Jul 10 16:31:02.455243 ip-10-0-136-164 kubenswrapper[2562]: E0710 16:31:02.455218 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11e5a906-9c59-4ad2-ab1e-4872d69a0a95-maas-api-tls podName:11e5a906-9c59-4ad2-ab1e-4872d69a0a95 nodeName:}" failed. No retries permitted until 2026-07-10 16:31:02.955201477 +0000 UTC m=+2162.387686448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/11e5a906-9c59-4ad2-ab1e-4872d69a0a95-maas-api-tls") pod "maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d" (UID: "11e5a906-9c59-4ad2-ab1e-4872d69a0a95") : secret "maas-api-e2e-shared-b-466b1a-serving-cert" not found Jul 10 16:31:02.455705 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:02.455680 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11e5a906-9c59-4ad2-ab1e-4872d69a0a95-openshift-service-ca\") pod \"maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d\" (UID: \"11e5a906-9c59-4ad2-ab1e-4872d69a0a95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d" Jul 10 16:31:02.492698 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:02.492666 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn6mj\" (UniqueName: \"kubernetes.io/projected/11e5a906-9c59-4ad2-ab1e-4872d69a0a95-kube-api-access-bn6mj\") pod \"maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d\" (UID: \"11e5a906-9c59-4ad2-ab1e-4872d69a0a95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d" Jul 10 16:31:02.959498 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:02.959463 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11e5a906-9c59-4ad2-ab1e-4872d69a0a95-maas-api-tls\") pod \"maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d\" (UID: \"11e5a906-9c59-4ad2-ab1e-4872d69a0a95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d" Jul 10 16:31:02.962624 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:02.962600 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11e5a906-9c59-4ad2-ab1e-4872d69a0a95-maas-api-tls\") pod \"maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d\" (UID: \"11e5a906-9c59-4ad2-ab1e-4872d69a0a95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d" Jul 10 16:31:03.196073 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:03.196038 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d" Jul 10 16:31:03.336037 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:03.336012 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d"] Jul 10 16:31:03.338184 ip-10-0-136-164 kubenswrapper[2562]: W0710 16:31:03.338156 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11e5a906_9c59_4ad2_ab1e_4872d69a0a95.slice/crio-becb754dafcdca06ffa62064f608eff856414ec4f9377ef1c18e64dc9918af31 WatchSource:0}: Error finding container becb754dafcdca06ffa62064f608eff856414ec4f9377ef1c18e64dc9918af31: Status 404 returned error can't find the container with id becb754dafcdca06ffa62064f608eff856414ec4f9377ef1c18e64dc9918af31 Jul 10 16:31:04.196464 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:04.196418 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d" event={"ID":"11e5a906-9c59-4ad2-ab1e-4872d69a0a95","Type":"ContainerStarted","Data":"e516c0919cf0d4d282bf980531cdaa6cdc90e00dd6ba796c1aa4d3bca69c7850"} Jul 10 16:31:04.196648 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:04.196604 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d" Jul 10 16:31:04.196648 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:04.196634 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d" event={"ID":"11e5a906-9c59-4ad2-ab1e-4872d69a0a95","Type":"ContainerStarted","Data":"becb754dafcdca06ffa62064f608eff856414ec4f9377ef1c18e64dc9918af31"} Jul 10 16:31:04.220906 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:04.220860 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d" podStartSLOduration=1.784094719 podStartE2EDuration="2.220844085s" totalImagesPullingTime="436.749366ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:31:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:31:04.220095536 +0000 UTC m=+2163.652580533" watchObservedRunningTime="2026-07-10 16:31:04.220844085 +0000 UTC m=+2163.653329078" Jul 10 16:31:10.208534 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:10.208502 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d" Jul 10 16:31:10.946757 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:10.946721 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:31:22.178776 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:22.178742 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:31:30.191981 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:30.191957 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728350-lfx4q" Jul 10 16:31:30.345048 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:30.345015 2562 generic.go:356] "Generic (PLEG): container finished" podID="04a72295-ef39-497e-8b6d-9b64dec6618d" containerID="0df016b214c41a46b13537f1426305f17a3894290622481a9a0deeeebb5f76aa" exitCode=137 Jul 10 16:31:30.345223 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:30.345060 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728350-lfx4q" Jul 10 16:31:30.345223 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:30.345065 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728350-lfx4q" event={"ID":"04a72295-ef39-497e-8b6d-9b64dec6618d","Type":"ContainerDied","Data":"0df016b214c41a46b13537f1426305f17a3894290622481a9a0deeeebb5f76aa"} Jul 10 16:31:30.345223 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:30.345164 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728350-lfx4q" event={"ID":"04a72295-ef39-497e-8b6d-9b64dec6618d","Type":"ContainerDied","Data":"ff09094b71e7d219ce3cf166fcc662b4b9dfd11efd4b95c44f4cc6e7b411ceb9"} Jul 10 16:31:30.345223 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:30.345185 2562 scope.go:117] "RemoveContainer" containerID="0df016b214c41a46b13537f1426305f17a3894290622481a9a0deeeebb5f76aa" Jul 10 16:31:30.354114 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:30.354096 2562 scope.go:117] "RemoveContainer" containerID="0df016b214c41a46b13537f1426305f17a3894290622481a9a0deeeebb5f76aa" Jul 10 16:31:30.354387 ip-10-0-136-164 kubenswrapper[2562]: E0710 16:31:30.354367 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0df016b214c41a46b13537f1426305f17a3894290622481a9a0deeeebb5f76aa\": container with ID starting with 0df016b214c41a46b13537f1426305f17a3894290622481a9a0deeeebb5f76aa not found: ID does not exist" containerID="0df016b214c41a46b13537f1426305f17a3894290622481a9a0deeeebb5f76aa" Jul 10 16:31:30.354439 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:30.354396 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0df016b214c41a46b13537f1426305f17a3894290622481a9a0deeeebb5f76aa"} err="failed to get container status \"0df016b214c41a46b13537f1426305f17a3894290622481a9a0deeeebb5f76aa\": rpc error: code = NotFound desc = could not find container \"0df016b214c41a46b13537f1426305f17a3894290622481a9a0deeeebb5f76aa\": container with ID starting with 0df016b214c41a46b13537f1426305f17a3894290622481a9a0deeeebb5f76aa not found: ID does not exist" Jul 10 16:31:30.369641 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:30.369615 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728350-lfx4q"] Jul 10 16:31:30.378709 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:30.378689 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728350-lfx4q"] Jul 10 16:31:30.989321 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:30.989291 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04a72295-ef39-497e-8b6d-9b64dec6618d" path="/var/lib/kubelet/pods/04a72295-ef39-497e-8b6d-9b64dec6618d/volumes" Jul 10 16:31:43.737110 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:31:43.737073 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:32:01.240537 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:32:01.240502 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:32:19.236857 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:32:19.236819 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:32:37.246431 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:32:37.246379 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:32:51.832770 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:32:51.832737 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:33:09.028654 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:33:09.028622 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:33:28.831452 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:33:28.831407 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:33:48.105277 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:33:48.105239 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:34:04.144759 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:34:04.144720 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:34:37.333225 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:34:37.333185 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:34:57.833772 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:34:57.833733 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:35:22.738149 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:22.738062 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:35:23.548894 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:23.548858 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j"] Jul 10 16:35:23.549293 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:23.549275 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04a72295-ef39-497e-8b6d-9b64dec6618d" containerName="cleanup" Jul 10 16:35:23.549379 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:23.549296 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="04a72295-ef39-497e-8b6d-9b64dec6618d" containerName="cleanup" Jul 10 16:35:23.549433 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:23.549390 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="04a72295-ef39-497e-8b6d-9b64dec6618d" containerName="cleanup" Jul 10 16:35:23.552599 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:23.552553 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" Jul 10 16:35:23.556274 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:23.556251 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c32d0d\"/\"rate-test-model-c32d0d-kserve-self-signed-certs\"" Jul 10 16:35:23.556274 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:23.556263 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c32d0d\"/\"default-dockercfg-jxbmd\"" Jul 10 16:35:23.556452 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:23.556268 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c32d0d\"/\"kube-root-ca.crt\"" Jul 10 16:35:23.556452 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:23.556251 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c32d0d\"/\"openshift-service-ca.crt\"" Jul 10 16:35:23.563592 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:23.563550 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j"] Jul 10 16:35:23.613861 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:23.613821 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3af75a34-5a7d-4025-9e0e-1949f068d72e-model-cache\") pod \"rate-test-model-c32d0d-kserve-75b5466d8c-tc27j\" (UID: \"3af75a34-5a7d-4025-9e0e-1949f068d72e\") " pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" Jul 10 16:35:23.614050 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:23.613880 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qxjd\" (UniqueName: \"kubernetes.io/projected/3af75a34-5a7d-4025-9e0e-1949f068d72e-kube-api-access-2qxjd\") pod \"rate-test-model-c32d0d-kserve-75b5466d8c-tc27j\" (UID: \"3af75a34-5a7d-4025-9e0e-1949f068d72e\") " pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" Jul 10 16:35:23.614050 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:23.613970 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3af75a34-5a7d-4025-9e0e-1949f068d72e-tmp-dir\") pod \"rate-test-model-c32d0d-kserve-75b5466d8c-tc27j\" (UID: \"3af75a34-5a7d-4025-9e0e-1949f068d72e\") " pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" Jul 10 16:35:23.614050 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:23.614020 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3af75a34-5a7d-4025-9e0e-1949f068d72e-dshm\") pod \"rate-test-model-c32d0d-kserve-75b5466d8c-tc27j\" (UID: \"3af75a34-5a7d-4025-9e0e-1949f068d72e\") " pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" Jul 10 16:35:23.614180 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:23.614061 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3af75a34-5a7d-4025-9e0e-1949f068d72e-home\") pod \"rate-test-model-c32d0d-kserve-75b5466d8c-tc27j\" (UID: \"3af75a34-5a7d-4025-9e0e-1949f068d72e\") " pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" Jul 10 16:35:23.614180 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:23.614092 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3af75a34-5a7d-4025-9e0e-1949f068d72e-tls-certs\") pod \"rate-test-model-c32d0d-kserve-75b5466d8c-tc27j\" (UID: \"3af75a34-5a7d-4025-9e0e-1949f068d72e\") " pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" Jul 10 16:35:23.715336 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:23.715294 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3af75a34-5a7d-4025-9e0e-1949f068d72e-home\") pod \"rate-test-model-c32d0d-kserve-75b5466d8c-tc27j\" (UID: \"3af75a34-5a7d-4025-9e0e-1949f068d72e\") " pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" Jul 10 16:35:23.715541 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:23.715345 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3af75a34-5a7d-4025-9e0e-1949f068d72e-tls-certs\") pod \"rate-test-model-c32d0d-kserve-75b5466d8c-tc27j\" (UID: \"3af75a34-5a7d-4025-9e0e-1949f068d72e\") " pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" Jul 10 16:35:23.715541 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:23.715372 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3af75a34-5a7d-4025-9e0e-1949f068d72e-model-cache\") pod \"rate-test-model-c32d0d-kserve-75b5466d8c-tc27j\" (UID: \"3af75a34-5a7d-4025-9e0e-1949f068d72e\") " pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" Jul 10 16:35:23.715541 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:23.715401 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qxjd\" (UniqueName: \"kubernetes.io/projected/3af75a34-5a7d-4025-9e0e-1949f068d72e-kube-api-access-2qxjd\") pod \"rate-test-model-c32d0d-kserve-75b5466d8c-tc27j\" (UID: \"3af75a34-5a7d-4025-9e0e-1949f068d72e\") " pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" Jul 10 16:35:23.715541 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:23.715477 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3af75a34-5a7d-4025-9e0e-1949f068d72e-tmp-dir\") pod \"rate-test-model-c32d0d-kserve-75b5466d8c-tc27j\" (UID: \"3af75a34-5a7d-4025-9e0e-1949f068d72e\") " pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" Jul 10 16:35:23.715541 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:23.715529 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3af75a34-5a7d-4025-9e0e-1949f068d72e-dshm\") pod \"rate-test-model-c32d0d-kserve-75b5466d8c-tc27j\" (UID: \"3af75a34-5a7d-4025-9e0e-1949f068d72e\") " pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" Jul 10 16:35:23.715853 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:23.715776 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3af75a34-5a7d-4025-9e0e-1949f068d72e-home\") pod \"rate-test-model-c32d0d-kserve-75b5466d8c-tc27j\" (UID: \"3af75a34-5a7d-4025-9e0e-1949f068d72e\") " pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" Jul 10 16:35:23.715853 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:23.715813 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3af75a34-5a7d-4025-9e0e-1949f068d72e-model-cache\") pod \"rate-test-model-c32d0d-kserve-75b5466d8c-tc27j\" (UID: \"3af75a34-5a7d-4025-9e0e-1949f068d72e\") " pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" Jul 10 16:35:23.715952 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:23.715886 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3af75a34-5a7d-4025-9e0e-1949f068d72e-tmp-dir\") pod \"rate-test-model-c32d0d-kserve-75b5466d8c-tc27j\" (UID: \"3af75a34-5a7d-4025-9e0e-1949f068d72e\") " pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" Jul 10 16:35:23.717877 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:23.717857 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3af75a34-5a7d-4025-9e0e-1949f068d72e-dshm\") pod \"rate-test-model-c32d0d-kserve-75b5466d8c-tc27j\" (UID: \"3af75a34-5a7d-4025-9e0e-1949f068d72e\") " pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" Jul 10 16:35:23.718112 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:23.718096 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3af75a34-5a7d-4025-9e0e-1949f068d72e-tls-certs\") pod \"rate-test-model-c32d0d-kserve-75b5466d8c-tc27j\" (UID: \"3af75a34-5a7d-4025-9e0e-1949f068d72e\") " pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" Jul 10 16:35:23.725990 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:23.725968 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qxjd\" (UniqueName: \"kubernetes.io/projected/3af75a34-5a7d-4025-9e0e-1949f068d72e-kube-api-access-2qxjd\") pod \"rate-test-model-c32d0d-kserve-75b5466d8c-tc27j\" (UID: \"3af75a34-5a7d-4025-9e0e-1949f068d72e\") " pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" Jul 10 16:35:23.862636 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:23.862527 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" Jul 10 16:35:24.002400 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:24.002352 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j"] Jul 10 16:35:24.004720 ip-10-0-136-164 kubenswrapper[2562]: W0710 16:35:24.004689 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3af75a34_5a7d_4025_9e0e_1949f068d72e.slice/crio-5ffd35a60e55fb897bd6f311a6bdb7535bc52d1422e7c225ae79de023c2d2a89 WatchSource:0}: Error finding container 5ffd35a60e55fb897bd6f311a6bdb7535bc52d1422e7c225ae79de023c2d2a89: Status 404 returned error can't find the container with id 5ffd35a60e55fb897bd6f311a6bdb7535bc52d1422e7c225ae79de023c2d2a89 Jul 10 16:35:24.006708 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:24.006690 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 16:35:24.589132 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:24.589086 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" event={"ID":"3af75a34-5a7d-4025-9e0e-1949f068d72e","Type":"ContainerStarted","Data":"5ffd35a60e55fb897bd6f311a6bdb7535bc52d1422e7c225ae79de023c2d2a89"} Jul 10 16:35:25.596246 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:25.596200 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" event={"ID":"3af75a34-5a7d-4025-9e0e-1949f068d72e","Type":"ContainerStarted","Data":"f9662ed3cc4b0d6b53df531fbabfc6c9a7b86e1e3903e08f46129c8b0d58c2f6"} Jul 10 16:35:25.615899 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:25.615853 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" podStartSLOduration=1.3951553890000001 podStartE2EDuration="2.615837033s" totalImagesPullingTime="1.220681644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:35:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:35:25.614879389 +0000 UTC m=+2425.047364383" watchObservedRunningTime="2026-07-10 16:35:25.615837033 +0000 UTC m=+2425.048322026" Jul 10 16:35:33.863610 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:33.863547 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" Jul 10 16:35:33.864088 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:33.863628 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" Jul 10 16:35:33.876455 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:33.876421 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" Jul 10 16:35:34.655930 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:34.655899 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" Jul 10 16:35:35.446635 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:35.446597 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:35:53.147430 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:35:53.147391 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:36:17.436337 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:17.436302 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:36:31.933413 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:31.933372 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:36:38.413058 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:38.413025 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j"] Jul 10 16:36:40.404426 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:40.404392 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7386-140418301118384"] Jul 10 16:36:40.407858 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:40.407842 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7386-140418301118384" Jul 10 16:36:40.410345 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:40.410318 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-k85bv\"" Jul 10 16:36:40.414132 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:40.414105 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7386-140418301118384"] Jul 10 16:36:40.503929 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:40.503896 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s86ft\" (UniqueName: \"kubernetes.io/projected/b75308b4-041f-414c-abe0-4f2f6eaf7081-kube-api-access-s86ft\") pod \"test-curl-7386-140418301118384\" (UID: \"b75308b4-041f-414c-abe0-4f2f6eaf7081\") " pod="openshift-ingress/test-curl-7386-140418301118384" Jul 10 16:36:40.604480 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:40.604442 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s86ft\" (UniqueName: \"kubernetes.io/projected/b75308b4-041f-414c-abe0-4f2f6eaf7081-kube-api-access-s86ft\") pod \"test-curl-7386-140418301118384\" (UID: \"b75308b4-041f-414c-abe0-4f2f6eaf7081\") " pod="openshift-ingress/test-curl-7386-140418301118384" Jul 10 16:36:40.612642 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:40.612609 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s86ft\" (UniqueName: \"kubernetes.io/projected/b75308b4-041f-414c-abe0-4f2f6eaf7081-kube-api-access-s86ft\") pod \"test-curl-7386-140418301118384\" (UID: \"b75308b4-041f-414c-abe0-4f2f6eaf7081\") " pod="openshift-ingress/test-curl-7386-140418301118384" Jul 10 16:36:40.718307 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:40.718206 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7386-140418301118384" Jul 10 16:36:40.848723 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:40.848699 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7386-140418301118384"] Jul 10 16:36:40.850662 ip-10-0-136-164 kubenswrapper[2562]: W0710 16:36:40.850626 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb75308b4_041f_414c_abe0_4f2f6eaf7081.slice/crio-37695e6d4b121b492b5e3d5e76d05148b306aaae9b2084e96af1a07b9b1af997 WatchSource:0}: Error finding container 37695e6d4b121b492b5e3d5e76d05148b306aaae9b2084e96af1a07b9b1af997: Status 404 returned error can't find the container with id 37695e6d4b121b492b5e3d5e76d05148b306aaae9b2084e96af1a07b9b1af997 Jul 10 16:36:40.991065 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:40.990986 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7386-140418301118384" event={"ID":"b75308b4-041f-414c-abe0-4f2f6eaf7081","Type":"ContainerStarted","Data":"37695e6d4b121b492b5e3d5e76d05148b306aaae9b2084e96af1a07b9b1af997"} Jul 10 16:36:41.997362 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:41.997276 2562 generic.go:356] "Generic (PLEG): container finished" podID="b75308b4-041f-414c-abe0-4f2f6eaf7081" containerID="d5a62e3076d7563cae56bd3fbc871642c3d6346c971e4edab10bc4a52059ee92" exitCode=0 Jul 10 16:36:41.997362 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:41.997324 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7386-140418301118384" event={"ID":"b75308b4-041f-414c-abe0-4f2f6eaf7081","Type":"ContainerDied","Data":"d5a62e3076d7563cae56bd3fbc871642c3d6346c971e4edab10bc4a52059ee92"} Jul 10 16:36:43.141936 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:43.141912 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7386-140418301118384" Jul 10 16:36:43.182780 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:43.182749 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7386-140418301118384_b75308b4-041f-414c-abe0-4f2f6eaf7081/test-curl-7386-140418301118384/0.log" Jul 10 16:36:43.208193 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:43.208163 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7386-140418301118384"] Jul 10 16:36:43.211718 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:43.211696 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7386-140418301118384"] Jul 10 16:36:43.225604 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:43.225562 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s86ft\" (UniqueName: \"kubernetes.io/projected/b75308b4-041f-414c-abe0-4f2f6eaf7081-kube-api-access-s86ft\") pod \"b75308b4-041f-414c-abe0-4f2f6eaf7081\" (UID: \"b75308b4-041f-414c-abe0-4f2f6eaf7081\") " Jul 10 16:36:43.227918 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:43.227897 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b75308b4-041f-414c-abe0-4f2f6eaf7081-kube-api-access-s86ft" (OuterVolumeSpecName: "kube-api-access-s86ft") pod "b75308b4-041f-414c-abe0-4f2f6eaf7081" (UID: "b75308b4-041f-414c-abe0-4f2f6eaf7081"). InnerVolumeSpecName "kube-api-access-s86ft". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:36:43.326920 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:43.326886 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s86ft\" (UniqueName: \"kubernetes.io/projected/b75308b4-041f-414c-abe0-4f2f6eaf7081-kube-api-access-s86ft\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:36:43.334901 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:43.334874 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7386-140418301084080"] Jul 10 16:36:43.335254 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:43.335242 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b75308b4-041f-414c-abe0-4f2f6eaf7081" containerName="test-curl-7386-140418301118384" Jul 10 16:36:43.335298 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:43.335256 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b75308b4-041f-414c-abe0-4f2f6eaf7081" containerName="test-curl-7386-140418301118384" Jul 10 16:36:43.335332 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:43.335326 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b75308b4-041f-414c-abe0-4f2f6eaf7081" containerName="test-curl-7386-140418301118384" Jul 10 16:36:43.338284 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:43.338270 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7386-140418301084080" Jul 10 16:36:43.344184 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:43.344160 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7386-140418301084080"] Jul 10 16:36:43.428066 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:43.428033 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d95z\" (UniqueName: \"kubernetes.io/projected/fc53faa8-cd80-487d-9e96-de7229cd91d9-kube-api-access-9d95z\") pod \"test-curl-7386-140418301084080\" (UID: \"fc53faa8-cd80-487d-9e96-de7229cd91d9\") " pod="openshift-ingress/test-curl-7386-140418301084080" Jul 10 16:36:43.529360 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:43.529316 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d95z\" (UniqueName: \"kubernetes.io/projected/fc53faa8-cd80-487d-9e96-de7229cd91d9-kube-api-access-9d95z\") pod \"test-curl-7386-140418301084080\" (UID: \"fc53faa8-cd80-487d-9e96-de7229cd91d9\") " pod="openshift-ingress/test-curl-7386-140418301084080" Jul 10 16:36:43.537596 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:43.537537 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d95z\" (UniqueName: \"kubernetes.io/projected/fc53faa8-cd80-487d-9e96-de7229cd91d9-kube-api-access-9d95z\") pod \"test-curl-7386-140418301084080\" (UID: \"fc53faa8-cd80-487d-9e96-de7229cd91d9\") " pod="openshift-ingress/test-curl-7386-140418301084080" Jul 10 16:36:43.648605 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:43.648477 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7386-140418301084080" Jul 10 16:36:43.782804 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:43.782782 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7386-140418301084080"] Jul 10 16:36:43.784456 ip-10-0-136-164 kubenswrapper[2562]: W0710 16:36:43.784420 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc53faa8_cd80_487d_9e96_de7229cd91d9.slice/crio-fde010b8bca6b69a8e139c523ec7d0a6d7b4f9ec24d6b82ac77e81d22013c7e4 WatchSource:0}: Error finding container fde010b8bca6b69a8e139c523ec7d0a6d7b4f9ec24d6b82ac77e81d22013c7e4: Status 404 returned error can't find the container with id fde010b8bca6b69a8e139c523ec7d0a6d7b4f9ec24d6b82ac77e81d22013c7e4 Jul 10 16:36:44.009024 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:44.008936 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37695e6d4b121b492b5e3d5e76d05148b306aaae9b2084e96af1a07b9b1af997" Jul 10 16:36:44.009024 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:44.008962 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7386-140418301118384" Jul 10 16:36:44.010058 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:44.010035 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7386-140418301084080" event={"ID":"fc53faa8-cd80-487d-9e96-de7229cd91d9","Type":"ContainerStarted","Data":"fde010b8bca6b69a8e139c523ec7d0a6d7b4f9ec24d6b82ac77e81d22013c7e4"} Jul 10 16:36:44.020264 ip-10-0-136-164 kubenswrapper[2562]: E0710 16:36:44.020236 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7386-140418301118384\" is forbidden: User \"system:node:ip-10-0-136-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-136-164.ec2.internal' and this object" podUID="b75308b4-041f-414c-abe0-4f2f6eaf7081" pod="openshift-ingress/test-curl-7386-140418301118384" Jul 10 16:36:44.995872 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:44.995833 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b75308b4-041f-414c-abe0-4f2f6eaf7081" path="/var/lib/kubelet/pods/b75308b4-041f-414c-abe0-4f2f6eaf7081/volumes" Jul 10 16:36:45.017166 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:45.017099 2562 generic.go:356] "Generic (PLEG): container finished" podID="fc53faa8-cd80-487d-9e96-de7229cd91d9" containerID="bfe97ba9ecae7189304a3374793d27bfc14a30c0e2c8554ebcf3540b170652ec" exitCode=0 Jul 10 16:36:45.017358 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:45.017206 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7386-140418301084080" event={"ID":"fc53faa8-cd80-487d-9e96-de7229cd91d9","Type":"ContainerDied","Data":"bfe97ba9ecae7189304a3374793d27bfc14a30c0e2c8554ebcf3540b170652ec"} Jul 10 16:36:45.737805 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:45.737764 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:36:46.161739 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:46.161717 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7386-140418301084080" Jul 10 16:36:46.183940 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:46.183905 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7386-140418301084080_fc53faa8-cd80-487d-9e96-de7229cd91d9/test-curl-7386-140418301084080/0.log" Jul 10 16:36:46.209919 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:46.209888 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7386-140418301084080"] Jul 10 16:36:46.215373 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:46.215350 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7386-140418301084080"] Jul 10 16:36:46.252863 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:46.252831 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9d95z\" (UniqueName: \"kubernetes.io/projected/fc53faa8-cd80-487d-9e96-de7229cd91d9-kube-api-access-9d95z\") pod \"fc53faa8-cd80-487d-9e96-de7229cd91d9\" (UID: \"fc53faa8-cd80-487d-9e96-de7229cd91d9\") " Jul 10 16:36:46.255069 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:46.255044 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc53faa8-cd80-487d-9e96-de7229cd91d9-kube-api-access-9d95z" (OuterVolumeSpecName: "kube-api-access-9d95z") pod "fc53faa8-cd80-487d-9e96-de7229cd91d9" (UID: "fc53faa8-cd80-487d-9e96-de7229cd91d9"). InnerVolumeSpecName "kube-api-access-9d95z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:36:46.354257 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:46.354217 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9d95z\" (UniqueName: \"kubernetes.io/projected/fc53faa8-cd80-487d-9e96-de7229cd91d9-kube-api-access-9d95z\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:36:46.398237 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:46.398205 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7386-140418300929056"] Jul 10 16:36:46.398587 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:46.398559 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc53faa8-cd80-487d-9e96-de7229cd91d9" containerName="test-curl-7386-140418301084080" Jul 10 16:36:46.398587 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:46.398585 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc53faa8-cd80-487d-9e96-de7229cd91d9" containerName="test-curl-7386-140418301084080" Jul 10 16:36:46.398669 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:46.398655 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc53faa8-cd80-487d-9e96-de7229cd91d9" containerName="test-curl-7386-140418301084080" Jul 10 16:36:46.401756 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:46.401740 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7386-140418300929056" Jul 10 16:36:46.407788 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:46.407746 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7386-140418300929056"] Jul 10 16:36:46.556257 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:46.556224 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhkjf\" (UniqueName: \"kubernetes.io/projected/58f7f247-c272-4e17-ac4b-6eac5935e2db-kube-api-access-bhkjf\") pod \"test-curl-7386-140418300929056\" (UID: \"58f7f247-c272-4e17-ac4b-6eac5935e2db\") " pod="openshift-ingress/test-curl-7386-140418300929056" Jul 10 16:36:46.657823 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:46.657736 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhkjf\" (UniqueName: \"kubernetes.io/projected/58f7f247-c272-4e17-ac4b-6eac5935e2db-kube-api-access-bhkjf\") pod \"test-curl-7386-140418300929056\" (UID: \"58f7f247-c272-4e17-ac4b-6eac5935e2db\") " pod="openshift-ingress/test-curl-7386-140418300929056" Jul 10 16:36:46.666452 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:46.666415 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhkjf\" (UniqueName: \"kubernetes.io/projected/58f7f247-c272-4e17-ac4b-6eac5935e2db-kube-api-access-bhkjf\") pod \"test-curl-7386-140418300929056\" (UID: \"58f7f247-c272-4e17-ac4b-6eac5935e2db\") " pod="openshift-ingress/test-curl-7386-140418300929056" Jul 10 16:36:46.712513 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:46.712477 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7386-140418300929056" Jul 10 16:36:46.841674 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:46.841645 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7386-140418300929056"] Jul 10 16:36:46.843411 ip-10-0-136-164 kubenswrapper[2562]: W0710 16:36:46.843383 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58f7f247_c272_4e17_ac4b_6eac5935e2db.slice/crio-32801ff081e07d05eeff51f2f7e1eee2b2e42d2ba3efc855e6b33210bdd51d8c WatchSource:0}: Error finding container 32801ff081e07d05eeff51f2f7e1eee2b2e42d2ba3efc855e6b33210bdd51d8c: Status 404 returned error can't find the container with id 32801ff081e07d05eeff51f2f7e1eee2b2e42d2ba3efc855e6b33210bdd51d8c Jul 10 16:36:46.991305 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:46.991212 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc53faa8-cd80-487d-9e96-de7229cd91d9" path="/var/lib/kubelet/pods/fc53faa8-cd80-487d-9e96-de7229cd91d9/volumes" Jul 10 16:36:47.028087 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:47.028048 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7386-140418300929056" event={"ID":"58f7f247-c272-4e17-ac4b-6eac5935e2db","Type":"ContainerStarted","Data":"32801ff081e07d05eeff51f2f7e1eee2b2e42d2ba3efc855e6b33210bdd51d8c"} Jul 10 16:36:47.029366 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:47.029346 2562 scope.go:117] "RemoveContainer" containerID="bfe97ba9ecae7189304a3374793d27bfc14a30c0e2c8554ebcf3540b170652ec" Jul 10 16:36:47.029514 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:47.029381 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7386-140418301084080" Jul 10 16:36:48.037107 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:48.037072 2562 generic.go:356] "Generic (PLEG): container finished" podID="58f7f247-c272-4e17-ac4b-6eac5935e2db" containerID="ecfa954665852604a9983a3c918d3f7fbb5709f911af91c819749551faf44d08" exitCode=0 Jul 10 16:36:48.037485 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:48.037159 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7386-140418300929056" event={"ID":"58f7f247-c272-4e17-ac4b-6eac5935e2db","Type":"ContainerDied","Data":"ecfa954665852604a9983a3c918d3f7fbb5709f911af91c819749551faf44d08"} Jul 10 16:36:49.183723 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:49.183701 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7386-140418300929056" Jul 10 16:36:49.204998 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:49.204971 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7386-140418300929056_58f7f247-c272-4e17-ac4b-6eac5935e2db/test-curl-7386-140418300929056/0.log" Jul 10 16:36:49.229311 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:49.229282 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7386-140418300929056"] Jul 10 16:36:49.233262 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:49.233239 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7386-140418300929056"] Jul 10 16:36:49.282123 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:49.282093 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhkjf\" (UniqueName: \"kubernetes.io/projected/58f7f247-c272-4e17-ac4b-6eac5935e2db-kube-api-access-bhkjf\") pod \"58f7f247-c272-4e17-ac4b-6eac5935e2db\" (UID: \"58f7f247-c272-4e17-ac4b-6eac5935e2db\") " Jul 10 16:36:49.284258 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:49.284234 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58f7f247-c272-4e17-ac4b-6eac5935e2db-kube-api-access-bhkjf" (OuterVolumeSpecName: "kube-api-access-bhkjf") pod "58f7f247-c272-4e17-ac4b-6eac5935e2db" (UID: "58f7f247-c272-4e17-ac4b-6eac5935e2db"). InnerVolumeSpecName "kube-api-access-bhkjf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:36:49.351951 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:49.351867 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7386-140418300929056"] Jul 10 16:36:49.352235 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:49.352222 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58f7f247-c272-4e17-ac4b-6eac5935e2db" containerName="test-curl-7386-140418300929056" Jul 10 16:36:49.352278 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:49.352237 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="58f7f247-c272-4e17-ac4b-6eac5935e2db" containerName="test-curl-7386-140418300929056" Jul 10 16:36:49.352332 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:49.352322 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="58f7f247-c272-4e17-ac4b-6eac5935e2db" containerName="test-curl-7386-140418300929056" Jul 10 16:36:49.355389 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:49.355375 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7386-140418300929056" Jul 10 16:36:49.360359 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:49.360334 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7386-140418300929056"] Jul 10 16:36:49.382868 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:49.382835 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhkjf\" (UniqueName: \"kubernetes.io/projected/58f7f247-c272-4e17-ac4b-6eac5935e2db-kube-api-access-bhkjf\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:36:49.483706 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:49.483664 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhwvm\" (UniqueName: \"kubernetes.io/projected/865d3f2e-9e94-4c24-a549-071628ec8e67-kube-api-access-vhwvm\") pod \"test-curl-7386-140418300929056\" (UID: \"865d3f2e-9e94-4c24-a549-071628ec8e67\") " pod="openshift-ingress/test-curl-7386-140418300929056" Jul 10 16:36:49.584916 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:49.584874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhwvm\" (UniqueName: \"kubernetes.io/projected/865d3f2e-9e94-4c24-a549-071628ec8e67-kube-api-access-vhwvm\") pod \"test-curl-7386-140418300929056\" (UID: \"865d3f2e-9e94-4c24-a549-071628ec8e67\") " pod="openshift-ingress/test-curl-7386-140418300929056" Jul 10 16:36:49.593856 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:49.593830 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhwvm\" (UniqueName: \"kubernetes.io/projected/865d3f2e-9e94-4c24-a549-071628ec8e67-kube-api-access-vhwvm\") pod \"test-curl-7386-140418300929056\" (UID: \"865d3f2e-9e94-4c24-a549-071628ec8e67\") " pod="openshift-ingress/test-curl-7386-140418300929056" Jul 10 16:36:49.665443 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:49.665358 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7386-140418300929056" Jul 10 16:36:49.801595 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:49.799875 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7386-140418300929056"] Jul 10 16:36:50.048579 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:50.048547 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7386-140418300929056" Jul 10 16:36:50.048769 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:50.048563 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32801ff081e07d05eeff51f2f7e1eee2b2e42d2ba3efc855e6b33210bdd51d8c" Jul 10 16:36:50.049796 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:50.049773 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7386-140418300929056" event={"ID":"865d3f2e-9e94-4c24-a549-071628ec8e67","Type":"ContainerStarted","Data":"83d4d98f615fff8a115f29193a3960d824fa1420447df32874dc3282580c8a88"} Jul 10 16:36:50.060799 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:50.060767 2562 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7386-140418300929056" oldPodUID="58f7f247-c272-4e17-ac4b-6eac5935e2db" podUID="865d3f2e-9e94-4c24-a549-071628ec8e67" Jul 10 16:36:50.992021 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:50.991985 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58f7f247-c272-4e17-ac4b-6eac5935e2db" path="/var/lib/kubelet/pods/58f7f247-c272-4e17-ac4b-6eac5935e2db/volumes" Jul 10 16:36:51.057230 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:51.057197 2562 generic.go:356] "Generic (PLEG): container finished" podID="865d3f2e-9e94-4c24-a549-071628ec8e67" containerID="b5b6ca6ab43f4bfbaebf1c656f2123fabd90322f384b2bc33481dae5d530507c" exitCode=0 Jul 10 16:36:51.057391 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:51.057261 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7386-140418300929056" event={"ID":"865d3f2e-9e94-4c24-a549-071628ec8e67","Type":"ContainerDied","Data":"b5b6ca6ab43f4bfbaebf1c656f2123fabd90322f384b2bc33481dae5d530507c"} Jul 10 16:36:52.209375 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:52.209347 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7386-140418300929056" Jul 10 16:36:52.230144 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:52.230088 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7386-140418300929056_865d3f2e-9e94-4c24-a549-071628ec8e67/test-curl-7386-140418300929056/0.log" Jul 10 16:36:52.255542 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:52.255506 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7386-140418300929056"] Jul 10 16:36:52.259646 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:52.259624 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7386-140418300929056"] Jul 10 16:36:52.312093 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:52.312063 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhwvm\" (UniqueName: \"kubernetes.io/projected/865d3f2e-9e94-4c24-a549-071628ec8e67-kube-api-access-vhwvm\") pod \"865d3f2e-9e94-4c24-a549-071628ec8e67\" (UID: \"865d3f2e-9e94-4c24-a549-071628ec8e67\") " Jul 10 16:36:52.314432 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:52.314382 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/865d3f2e-9e94-4c24-a549-071628ec8e67-kube-api-access-vhwvm" (OuterVolumeSpecName: "kube-api-access-vhwvm") pod "865d3f2e-9e94-4c24-a549-071628ec8e67" (UID: "865d3f2e-9e94-4c24-a549-071628ec8e67"). InnerVolumeSpecName "kube-api-access-vhwvm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:36:52.377086 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:52.377049 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7386-140418300930064"] Jul 10 16:36:52.377495 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:52.377477 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="865d3f2e-9e94-4c24-a549-071628ec8e67" containerName="test-curl-7386-140418300929056" Jul 10 16:36:52.377618 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:52.377501 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="865d3f2e-9e94-4c24-a549-071628ec8e67" containerName="test-curl-7386-140418300929056" Jul 10 16:36:52.377618 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:52.377604 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="865d3f2e-9e94-4c24-a549-071628ec8e67" containerName="test-curl-7386-140418300929056" Jul 10 16:36:52.380583 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:52.380547 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7386-140418300930064" Jul 10 16:36:52.384674 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:52.384651 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7386-140418300930064"] Jul 10 16:36:52.413214 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:52.413179 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhwvm\" (UniqueName: \"kubernetes.io/projected/865d3f2e-9e94-4c24-a549-071628ec8e67-kube-api-access-vhwvm\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:36:52.514600 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:52.514538 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzbzl\" (UniqueName: \"kubernetes.io/projected/d3c88862-e031-4be8-b60a-490cd547c641-kube-api-access-fzbzl\") pod \"test-curl-7386-140418300930064\" (UID: \"d3c88862-e031-4be8-b60a-490cd547c641\") " pod="openshift-ingress/test-curl-7386-140418300930064" Jul 10 16:36:52.615485 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:52.615391 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzbzl\" (UniqueName: \"kubernetes.io/projected/d3c88862-e031-4be8-b60a-490cd547c641-kube-api-access-fzbzl\") pod \"test-curl-7386-140418300930064\" (UID: \"d3c88862-e031-4be8-b60a-490cd547c641\") " pod="openshift-ingress/test-curl-7386-140418300930064" Jul 10 16:36:52.623366 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:52.623335 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzbzl\" (UniqueName: \"kubernetes.io/projected/d3c88862-e031-4be8-b60a-490cd547c641-kube-api-access-fzbzl\") pod \"test-curl-7386-140418300930064\" (UID: \"d3c88862-e031-4be8-b60a-490cd547c641\") " pod="openshift-ingress/test-curl-7386-140418300930064" Jul 10 16:36:52.691339 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:52.691299 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7386-140418300930064" Jul 10 16:36:52.825239 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:52.825070 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7386-140418300930064"] Jul 10 16:36:52.827301 ip-10-0-136-164 kubenswrapper[2562]: W0710 16:36:52.827272 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3c88862_e031_4be8_b60a_490cd547c641.slice/crio-8761cf118dfac14db14a7aa03bf5eb35c5ee2590da666dfccc11cf264289cedb WatchSource:0}: Error finding container 8761cf118dfac14db14a7aa03bf5eb35c5ee2590da666dfccc11cf264289cedb: Status 404 returned error can't find the container with id 8761cf118dfac14db14a7aa03bf5eb35c5ee2590da666dfccc11cf264289cedb Jul 10 16:36:52.990281 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:52.990198 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="865d3f2e-9e94-4c24-a549-071628ec8e67" path="/var/lib/kubelet/pods/865d3f2e-9e94-4c24-a549-071628ec8e67/volumes" Jul 10 16:36:53.068421 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:53.068391 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7386-140418300930064" event={"ID":"d3c88862-e031-4be8-b60a-490cd547c641","Type":"ContainerStarted","Data":"8761cf118dfac14db14a7aa03bf5eb35c5ee2590da666dfccc11cf264289cedb"} Jul 10 16:36:53.069663 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:53.069636 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7386-140418300929056" Jul 10 16:36:53.069793 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:53.069679 2562 scope.go:117] "RemoveContainer" containerID="b5b6ca6ab43f4bfbaebf1c656f2123fabd90322f384b2bc33481dae5d530507c" Jul 10 16:36:53.999773 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:53.999680 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" podUID="3af75a34-5a7d-4025-9e0e-1949f068d72e" containerName="main" containerID="cri-o://f9662ed3cc4b0d6b53df531fbabfc6c9a7b86e1e3903e08f46129c8b0d58c2f6" gracePeriod=45 Jul 10 16:36:54.077417 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:54.077377 2562 generic.go:356] "Generic (PLEG): container finished" podID="d3c88862-e031-4be8-b60a-490cd547c641" containerID="f6933db6ed99b76a8b99a117a723c00f6ae7a1e4d7e0e908095a9d1bffb23de4" exitCode=0 Jul 10 16:36:54.077598 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:54.077460 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7386-140418300930064" event={"ID":"d3c88862-e031-4be8-b60a-490cd547c641","Type":"ContainerDied","Data":"f6933db6ed99b76a8b99a117a723c00f6ae7a1e4d7e0e908095a9d1bffb23de4"} Jul 10 16:36:54.263608 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:54.263528 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" Jul 10 16:36:54.429881 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:54.429845 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3af75a34-5a7d-4025-9e0e-1949f068d72e-home\") pod \"3af75a34-5a7d-4025-9e0e-1949f068d72e\" (UID: \"3af75a34-5a7d-4025-9e0e-1949f068d72e\") " Jul 10 16:36:54.429881 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:54.429888 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3af75a34-5a7d-4025-9e0e-1949f068d72e-tls-certs\") pod \"3af75a34-5a7d-4025-9e0e-1949f068d72e\" (UID: \"3af75a34-5a7d-4025-9e0e-1949f068d72e\") " Jul 10 16:36:54.430134 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:54.429910 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3af75a34-5a7d-4025-9e0e-1949f068d72e-model-cache\") pod \"3af75a34-5a7d-4025-9e0e-1949f068d72e\" (UID: \"3af75a34-5a7d-4025-9e0e-1949f068d72e\") " Jul 10 16:36:54.430134 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:54.429927 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qxjd\" (UniqueName: \"kubernetes.io/projected/3af75a34-5a7d-4025-9e0e-1949f068d72e-kube-api-access-2qxjd\") pod \"3af75a34-5a7d-4025-9e0e-1949f068d72e\" (UID: \"3af75a34-5a7d-4025-9e0e-1949f068d72e\") " Jul 10 16:36:54.430134 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:54.429990 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3af75a34-5a7d-4025-9e0e-1949f068d72e-tmp-dir\") pod \"3af75a34-5a7d-4025-9e0e-1949f068d72e\" (UID: \"3af75a34-5a7d-4025-9e0e-1949f068d72e\") " Jul 10 16:36:54.430134 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:54.430011 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3af75a34-5a7d-4025-9e0e-1949f068d72e-dshm\") pod \"3af75a34-5a7d-4025-9e0e-1949f068d72e\" (UID: \"3af75a34-5a7d-4025-9e0e-1949f068d72e\") " Jul 10 16:36:54.430325 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:54.430217 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3af75a34-5a7d-4025-9e0e-1949f068d72e-home" (OuterVolumeSpecName: "home") pod "3af75a34-5a7d-4025-9e0e-1949f068d72e" (UID: "3af75a34-5a7d-4025-9e0e-1949f068d72e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 16:36:54.430325 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:54.430229 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3af75a34-5a7d-4025-9e0e-1949f068d72e-model-cache" (OuterVolumeSpecName: "model-cache") pod "3af75a34-5a7d-4025-9e0e-1949f068d72e" (UID: "3af75a34-5a7d-4025-9e0e-1949f068d72e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 16:36:54.430325 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:54.430301 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3af75a34-5a7d-4025-9e0e-1949f068d72e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3af75a34-5a7d-4025-9e0e-1949f068d72e" (UID: "3af75a34-5a7d-4025-9e0e-1949f068d72e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 16:36:54.432372 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:54.432343 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3af75a34-5a7d-4025-9e0e-1949f068d72e-kube-api-access-2qxjd" (OuterVolumeSpecName: "kube-api-access-2qxjd") pod "3af75a34-5a7d-4025-9e0e-1949f068d72e" (UID: "3af75a34-5a7d-4025-9e0e-1949f068d72e"). InnerVolumeSpecName "kube-api-access-2qxjd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:36:54.432372 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:54.432359 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3af75a34-5a7d-4025-9e0e-1949f068d72e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3af75a34-5a7d-4025-9e0e-1949f068d72e" (UID: "3af75a34-5a7d-4025-9e0e-1949f068d72e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 16:36:54.432546 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:54.432411 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3af75a34-5a7d-4025-9e0e-1949f068d72e-dshm" (OuterVolumeSpecName: "dshm") pod "3af75a34-5a7d-4025-9e0e-1949f068d72e" (UID: "3af75a34-5a7d-4025-9e0e-1949f068d72e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 16:36:54.531445 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:54.531409 2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3af75a34-5a7d-4025-9e0e-1949f068d72e-tmp-dir\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:36:54.531445 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:54.531445 2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3af75a34-5a7d-4025-9e0e-1949f068d72e-dshm\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:36:54.531660 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:54.531454 2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3af75a34-5a7d-4025-9e0e-1949f068d72e-home\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:36:54.531660 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:54.531462 2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3af75a34-5a7d-4025-9e0e-1949f068d72e-tls-certs\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:36:54.531660 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:54.531470 2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3af75a34-5a7d-4025-9e0e-1949f068d72e-model-cache\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:36:54.531660 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:54.531478 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qxjd\" (UniqueName: \"kubernetes.io/projected/3af75a34-5a7d-4025-9e0e-1949f068d72e-kube-api-access-2qxjd\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:36:55.084783 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.084746 2562 generic.go:356] "Generic (PLEG): container finished" podID="3af75a34-5a7d-4025-9e0e-1949f068d72e" containerID="f9662ed3cc4b0d6b53df531fbabfc6c9a7b86e1e3903e08f46129c8b0d58c2f6" exitCode=0 Jul 10 16:36:55.084783 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.084782 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" Jul 10 16:36:55.085300 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.084838 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" event={"ID":"3af75a34-5a7d-4025-9e0e-1949f068d72e","Type":"ContainerDied","Data":"f9662ed3cc4b0d6b53df531fbabfc6c9a7b86e1e3903e08f46129c8b0d58c2f6"} Jul 10 16:36:55.085300 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.084879 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j" event={"ID":"3af75a34-5a7d-4025-9e0e-1949f068d72e","Type":"ContainerDied","Data":"5ffd35a60e55fb897bd6f311a6bdb7535bc52d1422e7c225ae79de023c2d2a89"} Jul 10 16:36:55.085300 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.084901 2562 scope.go:117] "RemoveContainer" containerID="f9662ed3cc4b0d6b53df531fbabfc6c9a7b86e1e3903e08f46129c8b0d58c2f6" Jul 10 16:36:55.095009 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.094991 2562 scope.go:117] "RemoveContainer" containerID="f9662ed3cc4b0d6b53df531fbabfc6c9a7b86e1e3903e08f46129c8b0d58c2f6" Jul 10 16:36:55.095276 ip-10-0-136-164 kubenswrapper[2562]: E0710 16:36:55.095256 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9662ed3cc4b0d6b53df531fbabfc6c9a7b86e1e3903e08f46129c8b0d58c2f6\": container with ID starting with f9662ed3cc4b0d6b53df531fbabfc6c9a7b86e1e3903e08f46129c8b0d58c2f6 not found: ID does not exist" containerID="f9662ed3cc4b0d6b53df531fbabfc6c9a7b86e1e3903e08f46129c8b0d58c2f6" Jul 10 16:36:55.095342 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.095283 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9662ed3cc4b0d6b53df531fbabfc6c9a7b86e1e3903e08f46129c8b0d58c2f6"} err="failed to get container status \"f9662ed3cc4b0d6b53df531fbabfc6c9a7b86e1e3903e08f46129c8b0d58c2f6\": rpc error: code = NotFound desc = could not find container \"f9662ed3cc4b0d6b53df531fbabfc6c9a7b86e1e3903e08f46129c8b0d58c2f6\": container with ID starting with f9662ed3cc4b0d6b53df531fbabfc6c9a7b86e1e3903e08f46129c8b0d58c2f6 not found: ID does not exist" Jul 10 16:36:55.107357 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.107324 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j"] Jul 10 16:36:55.115079 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.115053 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-c32d0d/rate-test-model-c32d0d-kserve-75b5466d8c-tc27j"] Jul 10 16:36:55.237647 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.237623 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7386-140418300930064" Jul 10 16:36:55.260121 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.260054 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7386-140418300930064_d3c88862-e031-4be8-b60a-490cd547c641/test-curl-7386-140418300930064/0.log" Jul 10 16:36:55.285196 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.285160 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7386-140418300930064"] Jul 10 16:36:55.288637 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.288612 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7386-140418300930064"] Jul 10 16:36:55.338325 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.338292 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzbzl\" (UniqueName: \"kubernetes.io/projected/d3c88862-e031-4be8-b60a-490cd547c641-kube-api-access-fzbzl\") pod \"d3c88862-e031-4be8-b60a-490cd547c641\" (UID: \"d3c88862-e031-4be8-b60a-490cd547c641\") " Jul 10 16:36:55.340427 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.340403 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3c88862-e031-4be8-b60a-490cd547c641-kube-api-access-fzbzl" (OuterVolumeSpecName: "kube-api-access-fzbzl") pod "d3c88862-e031-4be8-b60a-490cd547c641" (UID: "d3c88862-e031-4be8-b60a-490cd547c641"). InnerVolumeSpecName "kube-api-access-fzbzl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:36:55.416517 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.416474 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7386-140418300930064"] Jul 10 16:36:55.416869 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.416856 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3af75a34-5a7d-4025-9e0e-1949f068d72e" containerName="main" Jul 10 16:36:55.416927 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.416870 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3af75a34-5a7d-4025-9e0e-1949f068d72e" containerName="main" Jul 10 16:36:55.416927 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.416879 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3c88862-e031-4be8-b60a-490cd547c641" containerName="test-curl-7386-140418300930064" Jul 10 16:36:55.416927 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.416885 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3c88862-e031-4be8-b60a-490cd547c641" containerName="test-curl-7386-140418300930064" Jul 10 16:36:55.417017 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.416947 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3af75a34-5a7d-4025-9e0e-1949f068d72e" containerName="main" Jul 10 16:36:55.417017 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.416958 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3c88862-e031-4be8-b60a-490cd547c641" containerName="test-curl-7386-140418300930064" Jul 10 16:36:55.419990 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.419974 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7386-140418300930064" Jul 10 16:36:55.426007 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.425980 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7386-140418300930064"] Jul 10 16:36:55.440010 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.439984 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzbzl\" (UniqueName: \"kubernetes.io/projected/d3c88862-e031-4be8-b60a-490cd547c641-kube-api-access-fzbzl\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:36:55.541062 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.541026 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2lnf\" (UniqueName: \"kubernetes.io/projected/174110f3-394a-409e-b14a-30799616f6ca-kube-api-access-p2lnf\") pod \"test-curl-7386-140418300930064\" (UID: \"174110f3-394a-409e-b14a-30799616f6ca\") " pod="openshift-ingress/test-curl-7386-140418300930064" Jul 10 16:36:55.642362 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.642330 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2lnf\" (UniqueName: \"kubernetes.io/projected/174110f3-394a-409e-b14a-30799616f6ca-kube-api-access-p2lnf\") pod \"test-curl-7386-140418300930064\" (UID: \"174110f3-394a-409e-b14a-30799616f6ca\") " pod="openshift-ingress/test-curl-7386-140418300930064" Jul 10 16:36:55.650988 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.650950 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2lnf\" (UniqueName: \"kubernetes.io/projected/174110f3-394a-409e-b14a-30799616f6ca-kube-api-access-p2lnf\") pod \"test-curl-7386-140418300930064\" (UID: \"174110f3-394a-409e-b14a-30799616f6ca\") " pod="openshift-ingress/test-curl-7386-140418300930064" Jul 10 16:36:55.730821 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.730775 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7386-140418300930064" Jul 10 16:36:55.868105 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:55.868081 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7386-140418300930064"] Jul 10 16:36:55.869117 ip-10-0-136-164 kubenswrapper[2562]: W0710 16:36:55.869094 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod174110f3_394a_409e_b14a_30799616f6ca.slice/crio-c5513f661470b68ff8cee4a8e513f3a3451288206122d29c12e1618f02780e50 WatchSource:0}: Error finding container c5513f661470b68ff8cee4a8e513f3a3451288206122d29c12e1618f02780e50: Status 404 returned error can't find the container with id c5513f661470b68ff8cee4a8e513f3a3451288206122d29c12e1618f02780e50 Jul 10 16:36:56.092447 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:56.092364 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7386-140418300930064" Jul 10 16:36:56.092875 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:56.092363 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8761cf118dfac14db14a7aa03bf5eb35c5ee2590da666dfccc11cf264289cedb" Jul 10 16:36:56.094520 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:56.094494 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7386-140418300930064" event={"ID":"174110f3-394a-409e-b14a-30799616f6ca","Type":"ContainerStarted","Data":"c5513f661470b68ff8cee4a8e513f3a3451288206122d29c12e1618f02780e50"} Jul 10 16:36:56.103866 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:56.103840 2562 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7386-140418300930064" oldPodUID="d3c88862-e031-4be8-b60a-490cd547c641" podUID="174110f3-394a-409e-b14a-30799616f6ca" Jul 10 16:36:56.989289 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:56.989257 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3af75a34-5a7d-4025-9e0e-1949f068d72e" path="/var/lib/kubelet/pods/3af75a34-5a7d-4025-9e0e-1949f068d72e/volumes" Jul 10 16:36:56.989614 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:56.989600 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3c88862-e031-4be8-b60a-490cd547c641" path="/var/lib/kubelet/pods/d3c88862-e031-4be8-b60a-490cd547c641/volumes" Jul 10 16:36:57.100984 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:57.100955 2562 generic.go:356] "Generic (PLEG): container finished" podID="174110f3-394a-409e-b14a-30799616f6ca" containerID="548fc141b73c1d8c815861fd300a056fecb4097ac869d433884241d94a69a7f4" exitCode=0 Jul 10 16:36:57.101343 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:57.101041 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7386-140418300930064" event={"ID":"174110f3-394a-409e-b14a-30799616f6ca","Type":"ContainerDied","Data":"548fc141b73c1d8c815861fd300a056fecb4097ac869d433884241d94a69a7f4"} Jul 10 16:36:58.252065 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:58.252037 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7386-140418300930064" Jul 10 16:36:58.273408 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:58.273381 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7386-140418300930064_174110f3-394a-409e-b14a-30799616f6ca/test-curl-7386-140418300930064/0.log" Jul 10 16:36:58.298697 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:58.298665 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7386-140418300930064"] Jul 10 16:36:58.300669 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:58.300649 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7386-140418300930064"] Jul 10 16:36:58.367862 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:58.367767 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2lnf\" (UniqueName: \"kubernetes.io/projected/174110f3-394a-409e-b14a-30799616f6ca-kube-api-access-p2lnf\") pod \"174110f3-394a-409e-b14a-30799616f6ca\" (UID: \"174110f3-394a-409e-b14a-30799616f6ca\") " Jul 10 16:36:58.370003 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:58.369980 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/174110f3-394a-409e-b14a-30799616f6ca-kube-api-access-p2lnf" (OuterVolumeSpecName: "kube-api-access-p2lnf") pod "174110f3-394a-409e-b14a-30799616f6ca" (UID: "174110f3-394a-409e-b14a-30799616f6ca"). InnerVolumeSpecName "kube-api-access-p2lnf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:36:58.469407 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:58.469362 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2lnf\" (UniqueName: \"kubernetes.io/projected/174110f3-394a-409e-b14a-30799616f6ca-kube-api-access-p2lnf\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:36:58.989239 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:58.989207 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="174110f3-394a-409e-b14a-30799616f6ca" path="/var/lib/kubelet/pods/174110f3-394a-409e-b14a-30799616f6ca/volumes" Jul 10 16:36:59.113901 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:59.113868 2562 scope.go:117] "RemoveContainer" containerID="548fc141b73c1d8c815861fd300a056fecb4097ac869d433884241d94a69a7f4" Jul 10 16:36:59.113901 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:36:59.113885 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7386-140418300930064" Jul 10 16:37:03.028244 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:03.028214 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:37:06.660138 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:06.660101 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d"] Jul 10 16:37:06.660639 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:06.660369 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d" podUID="11e5a906-9c59-4ad2-ab1e-4872d69a0a95" containerName="maas-api" containerID="cri-o://e516c0919cf0d4d282bf980531cdaa6cdc90e00dd6ba796c1aa4d3bca69c7850" gracePeriod=30 Jul 10 16:37:07.115054 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:07.115023 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d" Jul 10 16:37:07.149468 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:07.149431 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11e5a906-9c59-4ad2-ab1e-4872d69a0a95-openshift-service-ca\") pod \"11e5a906-9c59-4ad2-ab1e-4872d69a0a95\" (UID: \"11e5a906-9c59-4ad2-ab1e-4872d69a0a95\") " Jul 10 16:37:07.149698 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:07.149508 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bn6mj\" (UniqueName: \"kubernetes.io/projected/11e5a906-9c59-4ad2-ab1e-4872d69a0a95-kube-api-access-bn6mj\") pod \"11e5a906-9c59-4ad2-ab1e-4872d69a0a95\" (UID: \"11e5a906-9c59-4ad2-ab1e-4872d69a0a95\") " Jul 10 16:37:07.149892 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:07.149866 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11e5a906-9c59-4ad2-ab1e-4872d69a0a95-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "11e5a906-9c59-4ad2-ab1e-4872d69a0a95" (UID: "11e5a906-9c59-4ad2-ab1e-4872d69a0a95"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 16:37:07.151798 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:07.151774 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11e5a906-9c59-4ad2-ab1e-4872d69a0a95-kube-api-access-bn6mj" (OuterVolumeSpecName: "kube-api-access-bn6mj") pod "11e5a906-9c59-4ad2-ab1e-4872d69a0a95" (UID: "11e5a906-9c59-4ad2-ab1e-4872d69a0a95"). InnerVolumeSpecName "kube-api-access-bn6mj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 16:37:07.159958 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:07.159928 2562 generic.go:356] "Generic (PLEG): container finished" podID="11e5a906-9c59-4ad2-ab1e-4872d69a0a95" containerID="e516c0919cf0d4d282bf980531cdaa6cdc90e00dd6ba796c1aa4d3bca69c7850" exitCode=0 Jul 10 16:37:07.160128 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:07.159977 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d" Jul 10 16:37:07.160128 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:07.160020 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d" event={"ID":"11e5a906-9c59-4ad2-ab1e-4872d69a0a95","Type":"ContainerDied","Data":"e516c0919cf0d4d282bf980531cdaa6cdc90e00dd6ba796c1aa4d3bca69c7850"} Jul 10 16:37:07.160128 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:07.160079 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d" event={"ID":"11e5a906-9c59-4ad2-ab1e-4872d69a0a95","Type":"ContainerDied","Data":"becb754dafcdca06ffa62064f608eff856414ec4f9377ef1c18e64dc9918af31"} Jul 10 16:37:07.160128 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:07.160108 2562 scope.go:117] "RemoveContainer" containerID="e516c0919cf0d4d282bf980531cdaa6cdc90e00dd6ba796c1aa4d3bca69c7850" Jul 10 16:37:07.169248 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:07.169214 2562 scope.go:117] "RemoveContainer" containerID="e516c0919cf0d4d282bf980531cdaa6cdc90e00dd6ba796c1aa4d3bca69c7850" Jul 10 16:37:07.169535 ip-10-0-136-164 kubenswrapper[2562]: E0710 16:37:07.169511 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e516c0919cf0d4d282bf980531cdaa6cdc90e00dd6ba796c1aa4d3bca69c7850\": container with ID starting with e516c0919cf0d4d282bf980531cdaa6cdc90e00dd6ba796c1aa4d3bca69c7850 not found: ID does not exist" containerID="e516c0919cf0d4d282bf980531cdaa6cdc90e00dd6ba796c1aa4d3bca69c7850" Jul 10 16:37:07.169695 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:07.169544 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e516c0919cf0d4d282bf980531cdaa6cdc90e00dd6ba796c1aa4d3bca69c7850"} err="failed to get container status \"e516c0919cf0d4d282bf980531cdaa6cdc90e00dd6ba796c1aa4d3bca69c7850\": rpc error: code = NotFound desc = could not find container \"e516c0919cf0d4d282bf980531cdaa6cdc90e00dd6ba796c1aa4d3bca69c7850\": container with ID starting with e516c0919cf0d4d282bf980531cdaa6cdc90e00dd6ba796c1aa4d3bca69c7850 not found: ID does not exist" Jul 10 16:37:07.250795 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:07.250692 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11e5a906-9c59-4ad2-ab1e-4872d69a0a95-maas-api-tls\") pod \"11e5a906-9c59-4ad2-ab1e-4872d69a0a95\" (UID: \"11e5a906-9c59-4ad2-ab1e-4872d69a0a95\") " Jul 10 16:37:07.250967 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:07.250898 2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11e5a906-9c59-4ad2-ab1e-4872d69a0a95-openshift-service-ca\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:37:07.250967 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:07.250909 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bn6mj\" (UniqueName: \"kubernetes.io/projected/11e5a906-9c59-4ad2-ab1e-4872d69a0a95-kube-api-access-bn6mj\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:37:07.253021 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:07.252998 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11e5a906-9c59-4ad2-ab1e-4872d69a0a95-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "11e5a906-9c59-4ad2-ab1e-4872d69a0a95" (UID: "11e5a906-9c59-4ad2-ab1e-4872d69a0a95"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 16:37:07.351965 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:07.351924 2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11e5a906-9c59-4ad2-ab1e-4872d69a0a95-maas-api-tls\") on node \"ip-10-0-136-164.ec2.internal\" DevicePath \"\"" Jul 10 16:37:07.481644 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:07.481609 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d"] Jul 10 16:37:07.484975 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:07.484948 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-466b1a-68bfdc7c78-dms5d"] Jul 10 16:37:08.989481 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:08.989446 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11e5a906-9c59-4ad2-ab1e-4872d69a0a95" path="/var/lib/kubelet/pods/11e5a906-9c59-4ad2-ab1e-4872d69a0a95/volumes" Jul 10 16:37:11.843268 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:11.843220 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vkwrm"] Jul 10 16:37:13.470992 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:13.470950 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-867c57d584-kbf8n_1f925758-2bce-4046-be81-a540c2f41eb5/authorino/0.log" Jul 10 16:37:19.249831 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:19.249799 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c56c8c4bf-ms96f_a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2/copy-manifests/0.log" Jul 10 16:37:19.257535 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:19.257499 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c56c8c4bf-ms96f_a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2/manager/0.log" Jul 10 16:37:20.661686 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:20.661652 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv_1dc74a59-fd5c-440e-850c-bf14d2797a7d/util/0.log" Jul 10 16:37:20.668792 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:20.668770 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv_1dc74a59-fd5c-440e-850c-bf14d2797a7d/pull/0.log" Jul 10 16:37:20.676208 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:20.676184 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv_1dc74a59-fd5c-440e-850c-bf14d2797a7d/extract/0.log" Jul 10 16:37:20.790244 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:20.790211 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s_8a8f48dd-cd87-4147-b99c-6a438196b169/util/0.log" Jul 10 16:37:20.797647 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:20.797621 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s_8a8f48dd-cd87-4147-b99c-6a438196b169/pull/0.log" Jul 10 16:37:20.804658 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:20.804634 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s_8a8f48dd-cd87-4147-b99c-6a438196b169/extract/0.log" Jul 10 16:37:20.918603 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:20.918489 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m_82c7aa6d-9d6b-4a87-ad16-443679254810/util/0.log" Jul 10 16:37:20.925732 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:20.925709 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m_82c7aa6d-9d6b-4a87-ad16-443679254810/pull/0.log" Jul 10 16:37:20.932914 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:20.932894 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m_82c7aa6d-9d6b-4a87-ad16-443679254810/extract/0.log" Jul 10 16:37:21.049464 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:21.049434 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf_06549e1e-7d20-4da6-927b-342b47014a44/extract/0.log" Jul 10 16:37:21.056242 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:21.056219 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf_06549e1e-7d20-4da6-927b-342b47014a44/util/0.log" Jul 10 16:37:21.064118 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:21.064096 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf_06549e1e-7d20-4da6-927b-342b47014a44/pull/0.log" Jul 10 16:37:21.178639 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:21.178550 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-867c57d584-kbf8n_1f925758-2bce-4046-be81-a540c2f41eb5/authorino/0.log" Jul 10 16:37:21.534965 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:21.534937 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-spdjs_a3e6fa43-4907-4c12-851a-abe3fa874b14/kuadrant-console-plugin/0.log" Jul 10 16:37:21.912070 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:21.911993 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-vkwrm_649f88cf-4e1e-414d-a0b3-195b609fcd7a/limitador/0.log" Jul 10 16:37:22.738109 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:22.738080 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8457fcdff5-tzc4s_82efda26-5970-4087-9fb1-9aab625139f5/kube-auth-proxy/0.log" Jul 10 16:37:28.578471 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:28.578435 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wrzbj/must-gather-slrxw"] Jul 10 16:37:28.578879 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:28.578831 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="174110f3-394a-409e-b14a-30799616f6ca" containerName="test-curl-7386-140418300930064" Jul 10 16:37:28.578879 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:28.578844 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="174110f3-394a-409e-b14a-30799616f6ca" containerName="test-curl-7386-140418300930064" Jul 10 16:37:28.578879 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:28.578862 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11e5a906-9c59-4ad2-ab1e-4872d69a0a95" containerName="maas-api" Jul 10 16:37:28.578879 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:28.578867 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="11e5a906-9c59-4ad2-ab1e-4872d69a0a95" containerName="maas-api" Jul 10 16:37:28.579032 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:28.578934 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="174110f3-394a-409e-b14a-30799616f6ca" containerName="test-curl-7386-140418300930064" Jul 10 16:37:28.579032 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:28.578943 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="11e5a906-9c59-4ad2-ab1e-4872d69a0a95" containerName="maas-api" Jul 10 16:37:28.583964 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:28.583943 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wrzbj/must-gather-slrxw" Jul 10 16:37:28.586590 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:28.586549 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wrzbj\"/\"kube-root-ca.crt\"" Jul 10 16:37:28.587754 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:28.587722 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wrzbj\"/\"openshift-service-ca.crt\"" Jul 10 16:37:28.587754 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:28.587729 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wrzbj\"/\"default-dockercfg-bbxt2\"" Jul 10 16:37:28.591339 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:28.591315 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wrzbj/must-gather-slrxw"] Jul 10 16:37:28.622285 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:28.622240 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3c6c6346-3a29-4236-acdd-5fe4d3e66dcd-must-gather-output\") pod \"must-gather-slrxw\" (UID: \"3c6c6346-3a29-4236-acdd-5fe4d3e66dcd\") " pod="openshift-must-gather-wrzbj/must-gather-slrxw" Jul 10 16:37:28.622453 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:28.622308 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsbpz\" (UniqueName: \"kubernetes.io/projected/3c6c6346-3a29-4236-acdd-5fe4d3e66dcd-kube-api-access-xsbpz\") pod \"must-gather-slrxw\" (UID: \"3c6c6346-3a29-4236-acdd-5fe4d3e66dcd\") " pod="openshift-must-gather-wrzbj/must-gather-slrxw" Jul 10 16:37:28.723403 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:28.723363 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3c6c6346-3a29-4236-acdd-5fe4d3e66dcd-must-gather-output\") pod \"must-gather-slrxw\" (UID: \"3c6c6346-3a29-4236-acdd-5fe4d3e66dcd\") " pod="openshift-must-gather-wrzbj/must-gather-slrxw" Jul 10 16:37:28.723403 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:28.723409 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsbpz\" (UniqueName: \"kubernetes.io/projected/3c6c6346-3a29-4236-acdd-5fe4d3e66dcd-kube-api-access-xsbpz\") pod \"must-gather-slrxw\" (UID: \"3c6c6346-3a29-4236-acdd-5fe4d3e66dcd\") " pod="openshift-must-gather-wrzbj/must-gather-slrxw" Jul 10 16:37:28.723785 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:28.723764 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3c6c6346-3a29-4236-acdd-5fe4d3e66dcd-must-gather-output\") pod \"must-gather-slrxw\" (UID: \"3c6c6346-3a29-4236-acdd-5fe4d3e66dcd\") " pod="openshift-must-gather-wrzbj/must-gather-slrxw" Jul 10 16:37:28.732109 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:28.732079 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsbpz\" (UniqueName: \"kubernetes.io/projected/3c6c6346-3a29-4236-acdd-5fe4d3e66dcd-kube-api-access-xsbpz\") pod \"must-gather-slrxw\" (UID: \"3c6c6346-3a29-4236-acdd-5fe4d3e66dcd\") " pod="openshift-must-gather-wrzbj/must-gather-slrxw" Jul 10 16:37:28.895182 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:28.895091 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wrzbj/must-gather-slrxw" Jul 10 16:37:29.031803 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:29.031777 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wrzbj/must-gather-slrxw"] Jul 10 16:37:29.034538 ip-10-0-136-164 kubenswrapper[2562]: W0710 16:37:29.034510 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c6c6346_3a29_4236_acdd_5fe4d3e66dcd.slice/crio-1f6135d0fcc6cb24527687c7893ab573c39cc95d586d08d83879038e92f6189d WatchSource:0}: Error finding container 1f6135d0fcc6cb24527687c7893ab573c39cc95d586d08d83879038e92f6189d: Status 404 returned error can't find the container with id 1f6135d0fcc6cb24527687c7893ab573c39cc95d586d08d83879038e92f6189d Jul 10 16:37:29.278591 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:29.278531 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wrzbj/must-gather-slrxw" event={"ID":"3c6c6346-3a29-4236-acdd-5fe4d3e66dcd","Type":"ContainerStarted","Data":"1f6135d0fcc6cb24527687c7893ab573c39cc95d586d08d83879038e92f6189d"} Jul 10 16:37:31.297408 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:31.297358 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wrzbj/must-gather-slrxw" event={"ID":"3c6c6346-3a29-4236-acdd-5fe4d3e66dcd","Type":"ContainerStarted","Data":"6aa3e1864054e90c565d49beab9bf486d7b1fedd8bb005ab2cd01f34d5f0ef4a"} Jul 10 16:37:31.297990 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:31.297423 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wrzbj/must-gather-slrxw" event={"ID":"3c6c6346-3a29-4236-acdd-5fe4d3e66dcd","Type":"ContainerStarted","Data":"2d5feb80c14172d9422a62c9111362cf78ad2c2a3f0627a92a4cbf03af629520"} Jul 10 16:37:31.317908 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:31.317666 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wrzbj/must-gather-slrxw" podStartSLOduration=2.09904532 podStartE2EDuration="3.317638875s" totalImagesPullingTime="1.218593555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:37:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:37:31.313060415 +0000 UTC m=+2550.745545400" watchObservedRunningTime="2026-07-10 16:37:31.317638875 +0000 UTC m=+2550.750123871" Jul 10 16:37:31.982089 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:31.982059 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rw8tw_6bfcca1c-4216-4bff-afc4-751789a422f1/global-pull-secret-syncer/0.log" Jul 10 16:37:32.114134 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:32.114092 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-w9r4g_b0c331ff-5e5f-46f2-af72-86afa6e6c6c4/konnectivity-agent/0.log" Jul 10 16:37:32.168740 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:32.168709 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-164.ec2.internal_bf7065f98e0473976e9b61c34610e8e3/haproxy/0.log" Jul 10 16:37:37.021418 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:37.021374 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv_1dc74a59-fd5c-440e-850c-bf14d2797a7d/extract/0.log" Jul 10 16:37:37.061840 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:37.061802 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv_1dc74a59-fd5c-440e-850c-bf14d2797a7d/util/0.log" Jul 10 16:37:37.088116 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:37.088049 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ltcnv_1dc74a59-fd5c-440e-850c-bf14d2797a7d/pull/0.log" Jul 10 16:37:37.116315 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:37.116226 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s_8a8f48dd-cd87-4147-b99c-6a438196b169/extract/0.log" Jul 10 16:37:37.138998 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:37.138971 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s_8a8f48dd-cd87-4147-b99c-6a438196b169/util/0.log" Jul 10 16:37:37.165208 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:37.165172 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09bw9s_8a8f48dd-cd87-4147-b99c-6a438196b169/pull/0.log" Jul 10 16:37:37.205481 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:37.205454 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m_82c7aa6d-9d6b-4a87-ad16-443679254810/extract/0.log" Jul 10 16:37:37.231144 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:37.231117 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m_82c7aa6d-9d6b-4a87-ad16-443679254810/util/0.log" Jul 10 16:37:37.255713 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:37.255670 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h6j6m_82c7aa6d-9d6b-4a87-ad16-443679254810/pull/0.log" Jul 10 16:37:37.286761 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:37.286732 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf_06549e1e-7d20-4da6-927b-342b47014a44/extract/0.log" Jul 10 16:37:37.311699 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:37.311671 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf_06549e1e-7d20-4da6-927b-342b47014a44/util/0.log" Jul 10 16:37:37.336652 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:37.336619 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17qvjf_06549e1e-7d20-4da6-927b-342b47014a44/pull/0.log" Jul 10 16:37:37.747561 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:37.747180 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-867c57d584-kbf8n_1f925758-2bce-4046-be81-a540c2f41eb5/authorino/0.log" Jul 10 16:37:37.840111 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:37.840080 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-spdjs_a3e6fa43-4907-4c12-851a-abe3fa874b14/kuadrant-console-plugin/0.log" Jul 10 16:37:38.005195 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:38.005106 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-vkwrm_649f88cf-4e1e-414d-a0b3-195b609fcd7a/limitador/0.log" Jul 10 16:37:39.727058 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:39.727029 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_16f68e38-0805-4827-bec3-6f7782a34505/alertmanager/0.log" Jul 10 16:37:39.750429 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:39.750402 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_16f68e38-0805-4827-bec3-6f7782a34505/config-reloader/0.log" Jul 10 16:37:39.773007 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:39.772964 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_16f68e38-0805-4827-bec3-6f7782a34505/kube-rbac-proxy-web/0.log" Jul 10 16:37:39.797125 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:39.797097 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_16f68e38-0805-4827-bec3-6f7782a34505/kube-rbac-proxy/0.log" Jul 10 16:37:39.822227 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:39.822203 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_16f68e38-0805-4827-bec3-6f7782a34505/kube-rbac-proxy-metric/0.log" Jul 10 16:37:39.846158 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:39.846115 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_16f68e38-0805-4827-bec3-6f7782a34505/prom-label-proxy/0.log" Jul 10 16:37:39.869269 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:39.869236 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_16f68e38-0805-4827-bec3-6f7782a34505/init-config-reloader/0.log" Jul 10 16:37:39.936914 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:39.936876 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-cmmk5_355ba7a5-930f-49d7-b8a4-6e64bf8f11ec/kube-state-metrics/0.log" Jul 10 16:37:39.957162 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:39.957136 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-cmmk5_355ba7a5-930f-49d7-b8a4-6e64bf8f11ec/kube-rbac-proxy-main/0.log" Jul 10 16:37:39.982117 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:39.982035 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-cmmk5_355ba7a5-930f-49d7-b8a4-6e64bf8f11ec/kube-rbac-proxy-self/0.log" Jul 10 16:37:40.012895 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:40.012864 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-fc56d5dbc-lmmww_6a93a6d2-18a7-4561-9d26-7a2d53ddf3a9/metrics-server/0.log" Jul 10 16:37:40.081757 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:40.081730 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9qhdn_57aa6454-baf4-4c62-8497-484be0ced21a/node-exporter/0.log" Jul 10 16:37:40.110531 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:40.110488 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9qhdn_57aa6454-baf4-4c62-8497-484be0ced21a/kube-rbac-proxy/0.log" Jul 10 16:37:40.168934 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:40.168906 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9qhdn_57aa6454-baf4-4c62-8497-484be0ced21a/init-textfile/0.log" Jul 10 16:37:40.823051 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:40.823022 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-vs6n2_ee69e146-3cd0-41db-8827-6918843ff5ec/prometheus-operator/0.log" Jul 10 16:37:40.842909 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:40.842884 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-vs6n2_ee69e146-3cd0-41db-8827-6918843ff5ec/kube-rbac-proxy/0.log" Jul 10 16:37:40.866884 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:40.866855 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-6cjz4_984cef67-7804-4ef8-84a4-34d0998c644b/prometheus-operator-admission-webhook/0.log" Jul 10 16:37:40.894628 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:40.894596 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-647995b8b9-ngxrd_71e58bd6-3651-4401-8415-21953920c1b7/telemeter-client/0.log" Jul 10 16:37:40.916588 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:40.916540 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-647995b8b9-ngxrd_71e58bd6-3651-4401-8415-21953920c1b7/reload/0.log" Jul 10 16:37:40.937058 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:40.937027 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-647995b8b9-ngxrd_71e58bd6-3651-4401-8415-21953920c1b7/kube-rbac-proxy/0.log" Jul 10 16:37:41.909225 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:41.909183 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wrzbj/perf-node-gather-daemonset-h7fzd"] Jul 10 16:37:41.916963 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:41.916936 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wrzbj/perf-node-gather-daemonset-h7fzd" Jul 10 16:37:41.923965 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:41.923935 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wrzbj/perf-node-gather-daemonset-h7fzd"] Jul 10 16:37:41.973059 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:41.973016 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/40a03f31-c2d9-4391-8025-2d024732570c-proc\") pod \"perf-node-gather-daemonset-h7fzd\" (UID: \"40a03f31-c2d9-4391-8025-2d024732570c\") " pod="openshift-must-gather-wrzbj/perf-node-gather-daemonset-h7fzd" Jul 10 16:37:41.973311 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:41.973290 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/40a03f31-c2d9-4391-8025-2d024732570c-lib-modules\") pod \"perf-node-gather-daemonset-h7fzd\" (UID: \"40a03f31-c2d9-4391-8025-2d024732570c\") " pod="openshift-must-gather-wrzbj/perf-node-gather-daemonset-h7fzd" Jul 10 16:37:41.973483 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:41.973465 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gl8p\" (UniqueName: \"kubernetes.io/projected/40a03f31-c2d9-4391-8025-2d024732570c-kube-api-access-2gl8p\") pod \"perf-node-gather-daemonset-h7fzd\" (UID: \"40a03f31-c2d9-4391-8025-2d024732570c\") " pod="openshift-must-gather-wrzbj/perf-node-gather-daemonset-h7fzd" Jul 10 16:37:41.973696 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:41.973678 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40a03f31-c2d9-4391-8025-2d024732570c-sys\") pod \"perf-node-gather-daemonset-h7fzd\" (UID: \"40a03f31-c2d9-4391-8025-2d024732570c\") " pod="openshift-must-gather-wrzbj/perf-node-gather-daemonset-h7fzd" Jul 10 16:37:41.973845 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:41.973828 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/40a03f31-c2d9-4391-8025-2d024732570c-podres\") pod \"perf-node-gather-daemonset-h7fzd\" (UID: \"40a03f31-c2d9-4391-8025-2d024732570c\") " pod="openshift-must-gather-wrzbj/perf-node-gather-daemonset-h7fzd" Jul 10 16:37:42.075540 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:42.075497 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40a03f31-c2d9-4391-8025-2d024732570c-sys\") pod \"perf-node-gather-daemonset-h7fzd\" (UID: \"40a03f31-c2d9-4391-8025-2d024732570c\") " pod="openshift-must-gather-wrzbj/perf-node-gather-daemonset-h7fzd" Jul 10 16:37:42.075751 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:42.075584 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/40a03f31-c2d9-4391-8025-2d024732570c-podres\") pod \"perf-node-gather-daemonset-h7fzd\" (UID: \"40a03f31-c2d9-4391-8025-2d024732570c\") " pod="openshift-must-gather-wrzbj/perf-node-gather-daemonset-h7fzd" Jul 10 16:37:42.075751 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:42.075633 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/40a03f31-c2d9-4391-8025-2d024732570c-proc\") pod \"perf-node-gather-daemonset-h7fzd\" (UID: \"40a03f31-c2d9-4391-8025-2d024732570c\") " pod="openshift-must-gather-wrzbj/perf-node-gather-daemonset-h7fzd" Jul 10 16:37:42.075751 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:42.075657 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/40a03f31-c2d9-4391-8025-2d024732570c-lib-modules\") pod \"perf-node-gather-daemonset-h7fzd\" (UID: \"40a03f31-c2d9-4391-8025-2d024732570c\") " pod="openshift-must-gather-wrzbj/perf-node-gather-daemonset-h7fzd" Jul 10 16:37:42.075751 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:42.075675 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40a03f31-c2d9-4391-8025-2d024732570c-sys\") pod \"perf-node-gather-daemonset-h7fzd\" (UID: \"40a03f31-c2d9-4391-8025-2d024732570c\") " pod="openshift-must-gather-wrzbj/perf-node-gather-daemonset-h7fzd" Jul 10 16:37:42.075751 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:42.075725 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gl8p\" (UniqueName: \"kubernetes.io/projected/40a03f31-c2d9-4391-8025-2d024732570c-kube-api-access-2gl8p\") pod \"perf-node-gather-daemonset-h7fzd\" (UID: \"40a03f31-c2d9-4391-8025-2d024732570c\") " pod="openshift-must-gather-wrzbj/perf-node-gather-daemonset-h7fzd" Jul 10 16:37:42.076030 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:42.075753 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/40a03f31-c2d9-4391-8025-2d024732570c-proc\") pod \"perf-node-gather-daemonset-h7fzd\" (UID: \"40a03f31-c2d9-4391-8025-2d024732570c\") " pod="openshift-must-gather-wrzbj/perf-node-gather-daemonset-h7fzd" Jul 10 16:37:42.076030 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:42.075878 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/40a03f31-c2d9-4391-8025-2d024732570c-podres\") pod \"perf-node-gather-daemonset-h7fzd\" (UID: \"40a03f31-c2d9-4391-8025-2d024732570c\") " pod="openshift-must-gather-wrzbj/perf-node-gather-daemonset-h7fzd" Jul 10 16:37:42.076030 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:42.075960 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/40a03f31-c2d9-4391-8025-2d024732570c-lib-modules\") pod \"perf-node-gather-daemonset-h7fzd\" (UID: \"40a03f31-c2d9-4391-8025-2d024732570c\") " pod="openshift-must-gather-wrzbj/perf-node-gather-daemonset-h7fzd" Jul 10 16:37:42.086504 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:42.086473 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gl8p\" (UniqueName: \"kubernetes.io/projected/40a03f31-c2d9-4391-8025-2d024732570c-kube-api-access-2gl8p\") pod \"perf-node-gather-daemonset-h7fzd\" (UID: \"40a03f31-c2d9-4391-8025-2d024732570c\") " pod="openshift-must-gather-wrzbj/perf-node-gather-daemonset-h7fzd" Jul 10 16:37:42.231637 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:42.231533 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wrzbj/perf-node-gather-daemonset-h7fzd" Jul 10 16:37:42.439455 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:42.439403 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wrzbj/perf-node-gather-daemonset-h7fzd"] Jul 10 16:37:42.447254 ip-10-0-136-164 kubenswrapper[2562]: W0710 16:37:42.444968 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod40a03f31_c2d9_4391_8025_2d024732570c.slice/crio-10f000e4c2911e76c66936adac8cc58e2619ab7ad4e8f6f4e18254b1f8841c74 WatchSource:0}: Error finding container 10f000e4c2911e76c66936adac8cc58e2619ab7ad4e8f6f4e18254b1f8841c74: Status 404 returned error can't find the container with id 10f000e4c2911e76c66936adac8cc58e2619ab7ad4e8f6f4e18254b1f8841c74 Jul 10 16:37:43.381774 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:43.381748 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-66fc78f9fb-7kj98_3a729033-2e3a-4a2d-a578-d0defb737a20/console/0.log" Jul 10 16:37:43.397092 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:43.397059 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wrzbj/perf-node-gather-daemonset-h7fzd" event={"ID":"40a03f31-c2d9-4391-8025-2d024732570c","Type":"ContainerStarted","Data":"3ed998b41645e8ea30b8de710dfe6bb56d4c012cef24fadd7d919ef257eed53b"} Jul 10 16:37:43.397295 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:43.397109 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wrzbj/perf-node-gather-daemonset-h7fzd" event={"ID":"40a03f31-c2d9-4391-8025-2d024732570c","Type":"ContainerStarted","Data":"10f000e4c2911e76c66936adac8cc58e2619ab7ad4e8f6f4e18254b1f8841c74"} Jul 10 16:37:43.397295 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:43.397271 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wrzbj/perf-node-gather-daemonset-h7fzd" Jul 10 16:37:43.417892 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:43.417854 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-pllvl_6ac43d12-b6fd-4a8d-b41d-ecd8f9e60dba/download-server/0.log" Jul 10 16:37:45.206848 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:45.206807 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zt4rl_3b56a757-fb1d-4ec7-ad8c-4ea916d2657b/dns/0.log" Jul 10 16:37:45.229811 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:45.229786 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zt4rl_3b56a757-fb1d-4ec7-ad8c-4ea916d2657b/kube-rbac-proxy/0.log" Jul 10 16:37:45.254693 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:45.254656 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9j2fq_992584b5-85e4-4c18-aef4-254269d9b483/dns-node-resolver/0.log" Jul 10 16:37:45.950545 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:45.950508 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m94m9_2bcb7a5c-1cb1-4c2e-aa53-fd5dad33c1ce/node-ca/0.log" Jul 10 16:37:47.093124 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:47.093090 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8457fcdff5-tzc4s_82efda26-5970-4087-9fb1-9aab625139f5/kube-auth-proxy/0.log" Jul 10 16:37:48.007243 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:48.007197 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lmp9p_48d56fc3-18e8-4b9e-9a0c-9709df62dc73/serve-healthcheck-canary/0.log" Jul 10 16:37:48.613193 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:48.613167 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jnx2h_f8d26c3e-e5d8-41f5-99f9-549e804fbeaa/kube-rbac-proxy/0.log" Jul 10 16:37:48.635236 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:48.635207 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jnx2h_f8d26c3e-e5d8-41f5-99f9-549e804fbeaa/exporter/0.log" Jul 10 16:37:48.658706 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:48.658679 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jnx2h_f8d26c3e-e5d8-41f5-99f9-549e804fbeaa/extractor/0.log" Jul 10 16:37:49.417094 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:49.417068 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wrzbj/perf-node-gather-daemonset-h7fzd" Jul 10 16:37:49.439346 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:49.439296 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wrzbj/perf-node-gather-daemonset-h7fzd" podStartSLOduration=8.439278705 podStartE2EDuration="8.439278705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 16:37:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:37:43.417553015 +0000 UTC m=+2562.850038010" watchObservedRunningTime="2026-07-10 16:37:49.439278705 +0000 UTC m=+2568.871763699" Jul 10 16:37:51.720034 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:51.719971 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c56c8c4bf-ms96f_a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2/manager/0.log" Jul 10 16:37:51.744076 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:51.744045 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c56c8c4bf-ms96f_a8bd47f7-de0d-498e-8b46-d7ff1e4c7db2/copy-manifests/0.log" Jul 10 16:37:52.948144 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:52.948089 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8457fcdff5-tzc4s_82efda26-5970-4087-9fb1-9aab625139f5/kube-auth-proxy/0.log" Jul 10 16:37:53.129024 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:53.129001 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-66568bbc8f-dxbvr_e59ebea2-11fb-42f7-bd7f-8b14c30aebd5/manager/0.log" Jul 10 16:37:53.160778 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:53.160747 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-v9q6b_d5f661a1-47a6-4c6e-b97f-73bcfb0149fb/openshift-lws-operator/0.log" Jul 10 16:37:54.427292 ip-10-0-136-164 kubenswrapper[2562]: I0710 16:37:54.427254 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8457fcdff5-tzc4s_82efda26-5970-4087-9fb1-9aab625139f5/kube-auth-proxy/0.log"